-- Logs begin at Thu 2022-09-15 00:04:22 UTC, end at Thu 2022-09-15 01:05:26 UTC. -- Sep 15 00:29:59.374636 dv-cinder-857528-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 15 00:29:59.385527 dv-cinder-857528-2-smb devstack@keystone.service[81600]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 15 00:29:59.388193 dv-cinder-857528-2-smb devstack@keystone.service[81600]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 15 00:29:59 2022] *** Sep 15 00:29:59.388376 dv-cinder-857528-2-smb devstack@keystone.service[81600]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 00:29:59.388546 dv-cinder-857528-2-smb devstack@keystone.service[81600]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 00:29:59.388701 dv-cinder-857528-2-smb devstack@keystone.service[81600]: nodename: dv-cinder-857528-2-smb Sep 15 00:29:59.388853 dv-cinder-857528-2-smb devstack@keystone.service[81600]: machine: x86_64 Sep 15 00:29:59.388994 dv-cinder-857528-2-smb devstack@keystone.service[81600]: clock source: unix Sep 15 00:29:59.389206 dv-cinder-857528-2-smb devstack@keystone.service[81600]: pcre jit disabled Sep 15 00:29:59.389311 dv-cinder-857528-2-smb devstack@keystone.service[81600]: detected number of CPU cores: 4 Sep 15 00:29:59.389420 dv-cinder-857528-2-smb devstack@keystone.service[81600]: current working directory: / Sep 15 00:29:59.389520 dv-cinder-857528-2-smb devstack@keystone.service[81600]: detected binary path: /usr/bin/uwsgi-core Sep 15 00:29:59.389626 dv-cinder-857528-2-smb devstack@keystone.service[81600]: your processes number limit is 47680 Sep 15 00:29:59.389726 dv-cinder-857528-2-smb devstack@keystone.service[81600]: your memory page size is 4096 bytes Sep 15 00:29:59.389828 dv-cinder-857528-2-smb devstack@keystone.service[81600]: detected max file descriptor number: 2048 Sep 15 00:29:59.389935 dv-cinder-857528-2-smb devstack@keystone.service[81600]: lock engine: pthread robust mutexes Sep 15 00:29:59.390187 dv-cinder-857528-2-smb devstack@keystone.service[81600]: thunder lock: enabled Sep 15 00:29:59.390472 dv-cinder-857528-2-smb devstack@keystone.service[81600]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 15 00:29:59.390656 dv-cinder-857528-2-smb devstack@keystone.service[81600]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 15 00:29:59.429306 dv-cinder-857528-2-smb devstack@keystone.service[81600]: Python main interpreter initialized at 0x5643f2bdc9c0 Sep 15 00:29:59.429306 dv-cinder-857528-2-smb devstack@keystone.service[81600]: python threads support enabled Sep 15 00:29:59.429306 dv-cinder-857528-2-smb devstack@keystone.service[81600]: your server socket listen backlog is limited to 100 connections Sep 15 00:29:59.429306 dv-cinder-857528-2-smb devstack@keystone.service[81600]: your mercy for graceful operations on workers is 90 seconds Sep 15 00:29:59.429688 dv-cinder-857528-2-smb devstack@keystone.service[81600]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 00:29:59.429770 dv-cinder-857528-2-smb devstack@keystone.service[81600]: *** Operational MODE: preforking *** Sep 15 00:29:59.430032 dv-cinder-857528-2-smb devstack@keystone.service[81600]: *** uWSGI is running in multiple interpreter mode *** Sep 15 00:29:59.430032 dv-cinder-857528-2-smb devstack@keystone.service[81600]: spawned uWSGI master process (pid: 81600) Sep 15 00:29:59.430198 dv-cinder-857528-2-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 15 00:29:59.432455 dv-cinder-857528-2-smb devstack@keystone.service[81600]: spawned uWSGI worker 1 (pid: 81615, cores: 1) Sep 15 00:29:59.432455 dv-cinder-857528-2-smb devstack@keystone.service[81600]: spawned uWSGI worker 2 (pid: 81616, cores: 1) Sep 15 00:29:59.432455 dv-cinder-857528-2-smb devstack@keystone.service[81600]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 00:30:03.759277 dv-cinder-857528-2-smb devstack@keystone.service[81616]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 00:30:03.759277 dv-cinder-857528-2-smb devstack@keystone.service[81616]: from cryptography.utils import int_from_bytes Sep 15 00:30:03.760020 dv-cinder-857528-2-smb devstack@keystone.service[81616]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 00:30:03.760020 dv-cinder-857528-2-smb devstack@keystone.service[81616]: from cryptography.utils import int_from_bytes Sep 15 00:30:03.760137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 00:30:03.760137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: from cryptography.utils import int_from_bytes Sep 15 00:30:03.760137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 00:30:03.760137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: from cryptography.utils import int_from_bytes Sep 15 00:30:03.809433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 00:30:03.809615 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 00:30:03.809805 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] command line args: [] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 00:30:03.809927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 00:30:03.810039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 00:30:03.810157 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 00:30:03.810284 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] command line args: [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 00:30:03.810398 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ================================================================================ {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 00:30:03.810512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 00:30:03.810628 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] admin_token = **** {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.810742 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ================================================================================ {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 00:30:03.810847 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] config_dir = [] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.810970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] admin_token = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.811082 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.811082 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] config_source = [] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.811289 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] config_dir = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.811403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] debug = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.811509 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.811635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.813208 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] config_source = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.813208 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] debug = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.813427 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.813535 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.813641 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.813729 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.813809 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.813895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.813979 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.814065 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.814148 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] list_limit = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.814229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.814311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] log_config_append = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.814396 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] list_limit = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.814476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.814563 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] log_config_append = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.814648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] log_dir = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.814728 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.814802 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] log_file = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.814872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] log_dir = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.814950 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.815034 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] log_file = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.815120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.815199 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.815284 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.815358 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.815438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.815537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.815617 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.815697 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.815782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.815864 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.815954 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.816035 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.816127 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.816212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.816295 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.816386 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.816471 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.816545 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.816628 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.816628 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.816780 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.816859 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.816953 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.817028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.817146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.817229 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.817318 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.817318 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.817462 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.817543 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.817622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] publish_errors = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.817622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.817762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.817839 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.817916 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] publish_errors = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.817994 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.818082 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.818148 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.818225 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.818465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.818617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.818731 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] standard_threads = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.818837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.818945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.819044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.819142 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.819255 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] standard_threads = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.819400 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.819546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.819709 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] use_journal = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.819709 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] use_json = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.819926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.820098 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] use_stderr = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.820202 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.820313 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] use_syslog = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.820420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] use_journal = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.820420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] use_json = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.820622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.820740 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] use_stderr = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.820896 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.821016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] use_syslog = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.821140 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.821264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 00:30:03.821369 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.821488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.821602 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.821712 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.821819 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.821927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.822034 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.822152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.822271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.822377 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.822495 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.822609 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.822722 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.822839 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.822945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.823051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.823207 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.823314 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.823423 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.823543 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.823649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.823756 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.823874 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.823989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.824094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.824219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.824325 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.824433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.824540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.824649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.824771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.824899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.825020 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.825159 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.825271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.825378 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.825570 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.825684 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.825791 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.825908 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.826023 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.826136 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.826258 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.826366 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.826473 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.826581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.826697 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.826809 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.826927 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.827041 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.827146 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.827254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.827369 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.827475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.827594 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.827699 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.827820 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.827925 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.828034 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.828142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.828264 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.828368 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.828484 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.828599 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.828713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.828817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.828941 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.829048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.829173 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.829301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.829408 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.829523 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.829644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.829750 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.829857 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.829965 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.830073 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.830180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.830299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.830404 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.830512 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.830627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.830733 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.830849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.831034 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.831141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.831257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.831379 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.831484 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.831596 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.831719 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.831826 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.831933 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.832049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.832156 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.832272 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.832398 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.832515 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.832621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.832729 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.832844 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.832951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.833073 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.833342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.833448 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.833556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.833672 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.833777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.833896 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.834001 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.834109 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.834315 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.834485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.834650 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.834803 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.834952 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.835101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.835250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.835405 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.835405 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.835728 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.835728 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.836056 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.836162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.836838 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.836959 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.837129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.837129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.837390 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.837503 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.837661 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.837661 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.837926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.838091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.838199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.838368 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.838474 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.838625 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.838747 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.838911 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.839035 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.839190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.839315 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.839433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.839551 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.839727 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.839832 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.840017 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.840124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.840291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.840397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.840562 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.840671 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.840802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.840966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.841072 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.841244 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.841379 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.841484 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.841607 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.841712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.841819 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.841948 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.842065 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.842173 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.842288 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.842396 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.842504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.842614 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.842743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.842850 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.842968 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.843075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.843184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.843293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.843424 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.843531 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.843640 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.843753 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.843863 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.843970 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.843970 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.844257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.844366 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.844473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.844582 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.844703 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.844821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.844944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.845050 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.845179 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.845291 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.845418 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.845523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.845644 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.845751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.845860 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.845981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.846088 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.846197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.846317 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.846423 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.846532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.846646 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.846765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.846874 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.847003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.847124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.847230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.847338 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] auth.external = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.847447 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.847591 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.847709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.847826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.847951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.848068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.848185 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] auth.external = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.848293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] auth.password = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.848400 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.848517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] auth.token = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.848637 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.848745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.848855 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.848964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.849073 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] auth.password = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.849213 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.849339 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] auth.token = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.849446 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.849557 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.849666 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.849776 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.849886 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.850007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.850118 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.850227 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.850337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] credential.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.850446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.850556 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.850676 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.850783 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.850893 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.851002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.851112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] credential.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.851221 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.851341 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.851449 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.851562 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.851671 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.851780 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.853505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.853650 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.853751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.853848 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.853944 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.854040 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.854134 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.854239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.854333 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.854428 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.854527 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.854631 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.854726 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.854831 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.854926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.855022 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.855111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.855194 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.855284 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] federation.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.855375 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.855459 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.855550 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.855641 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.855723 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.855804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.855898 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.855982 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.856062 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.856147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.856246 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.856345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.856438 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.856782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.856893 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.857001 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.857129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.857259 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.857367 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.857463 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.857569 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.857679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.857795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.857914 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.858020 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.858128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.858237 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.858341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.858448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.858655 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.858768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.858878 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.858988 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.859097 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.859205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.859331 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.859440 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.859547 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.859655 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.859764 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.859872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.859991 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.860102 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.860202 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.860308 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.860417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.860417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.860622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.860734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.860843 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.860938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.861032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.861147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.861269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.861269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.861466 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.861598 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.861709 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.861830 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.861950 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.862058 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.862175 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.862282 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.862391 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.862391 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.862594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.862703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.862814 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.862917 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.863018 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.863126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.863247 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.863354 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.863463 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.863572 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.863681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.863788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.863907 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.864014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.864135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.864249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.864361 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.864475 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.864601 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.864704 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.864819 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.864934 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.865048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.865344 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.865454 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.865560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.865660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.865770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.865874 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.865994 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.866223 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.866338 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.866456 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.866569 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.866686 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.866819 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.867015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.867123 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.867238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.867353 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.867466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.867598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.867716 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.867716 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.867928 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.868095 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.868238 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.868357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.868470 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.868590 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.868703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.868703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.868915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.869038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.869222 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.869329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.869439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.869550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.869674 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.869794 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.869918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.870027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.870186 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.870307 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.870419 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.870540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.870649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.870759 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.870870 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.870980 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.871091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.871212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.871369 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.871476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.871589 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.871699 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.871815 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.871937 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.872046 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.872155 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.872275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.872383 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.872493 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.872614 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.872721 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.872832 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.872943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.873052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.873220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.873345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.873458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.873569 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.873727 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.873836 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.873951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.874077 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.874188 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.874301 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.874414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.874526 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.874640 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.874769 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.874882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.875005 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.875121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.875237 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.875354 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.875481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.875593 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.875711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.875827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.875943 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.876068 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.876194 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.876307 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.876424 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.876540 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.876661 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.876778 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.876906 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.877018 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.877212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.877212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.877421 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.877421 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.877650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.877758 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.877872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.877872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.878090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.878204 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.878337 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.878447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] resource.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.878556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.878672 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.878785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.878898 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.879023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.879023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.879233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.879342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.879453 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.879566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.879690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.879690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.879889 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.879999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.880112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.880225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.880349 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.880459 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.880572 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.880687 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] role.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.880803 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.880999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] role.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.881139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.881259 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.881374 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.881494 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.881605 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.881737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.881847 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.881963 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.882077 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] role.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.882191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.882306 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] role.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.882432 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.882543 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.882657 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.882771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.882886 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.883002 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.883634 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.883750 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.883870 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.883988 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.884104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.884104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.884328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.884440 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.884557 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.884675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.884792 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.884792 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.885011 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.885192 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.885305 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.885424 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.885542 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.885659 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.885787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.885901 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.886018 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.886136 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.886254 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.886254 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.886478 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.886590 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.886713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.886830 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.886947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.887076 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.887189 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.887307 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.887424 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.887541 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.887662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.887790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.887904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.888021 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.888021 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.888225 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.888338 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.888467 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.888581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.888700 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.888817 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.888934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.889050 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.889237 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.889349 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] token.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.889463 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.889577 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.889691 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.889804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.889937 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.890047 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.890160 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.890274 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.890387 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.890501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.890626 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.890745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.890745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.890745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.890745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.890745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.890745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.890745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.890745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.890745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.891642 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.891642 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.891642 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.891642 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.connection = **** {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.891642 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.892175 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.892175 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.892175 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.892479 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.892600 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.892760 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.892874 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.893032 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.893165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.893285 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.893415 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.893524 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.893638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.893751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.893861 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.893975 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.894102 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.894212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.894326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.894439 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.894558 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.894673 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.894797 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.894908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.895021 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.895134 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.895246 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.895360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.895486 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 00:30:03.895605 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.895715 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.895947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.896202 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.896483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.898684 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.899704 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.900016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.900311 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.connection = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.900582 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.900849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.901121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.901377 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.901627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.901877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.902124 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.902371 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.902624 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.902869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.903119 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.903364 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.903620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.903862 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.904112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.904349 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.904595 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.904835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 00:30:03.905008 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 00:30:03.924904 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:03.925160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:03.925387 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:03.929450 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:03.929686 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:03.929910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:03.933700 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:03.938093 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:03.962394 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:03.962621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:03.964849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:03.965093 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.015881 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.016008 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.063930 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.064153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.064239 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.064388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.218955 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.219187 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.219398 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.219507 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.219617 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.219826 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.219911 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.220040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.220237 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.220525 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.220743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.220966 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.243866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.244017 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.244103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.244181 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.244276 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.244359 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.244493 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.244579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.244706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.244800 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.244916 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.244998 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.245146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.245233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.256213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.256346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.269369 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.269481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.269548 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.269704 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.269788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.269929 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.270013 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.270153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.270235 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.270371 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.270456 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.270580 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.270662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.270790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 00:30:04.287110 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.287321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 00:30:04.287642 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.287726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.287848 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 00:30:04.287931 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 00:30:04.288125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.288212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.288372 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 00:30:04.288454 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.288636 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.288727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.288895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.288977 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.289187 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.289488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.298420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.298704 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.298965 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.299049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.299248 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.299332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.299522 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.299811 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.306696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.309606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.309896 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.310138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.310230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.310459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.310752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.311019 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.311296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.311575 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.311850 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.312126 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.312397 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.313023 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.313340 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.313629 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.313913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.314200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.314467 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.314741 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.315018 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.315291 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.315567 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.315837 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.335273 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.336763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.337051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.338854 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.340316 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.340608 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.341796 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.341980 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.342266 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.345260 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.345550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.345834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.348630 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.348867 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.352132 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.352426 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.354541 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.354840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.355130 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.355422 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.355704 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.355980 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.356250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.356518 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.358370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.358674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.358964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.359251 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.359528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.359806 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.360080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.360350 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.372550 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.372836 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.376156 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.376440 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.376661 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.379887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.380186 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.380300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.384124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.384422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.385104 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.388181 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.388614 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.391695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.391782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.391998 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.392286 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.392582 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.392873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.393186 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.394877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.395179 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.395467 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.395756 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.396035 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.396317 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.408779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.409070 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.409365 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.409631 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.411785 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.412078 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.412356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.412627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.416405 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.417959 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.419432 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.419567 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.419741 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.420932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.422408 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.422495 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.422698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.422783 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.422997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.423321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.423743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.425555 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.425845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.426130 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.426413 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.426808 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.435282 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.435572 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.435856 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.436139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.436519 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.436811 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.437118 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.438435 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.438717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.438995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.439276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.439656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.439939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.440219 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.452899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.455810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.455966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.458713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.458883 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.460139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.461645 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.461800 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.462136 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.462316 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.463269 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.464711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.464996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.465419 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.468601 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.470089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.471697 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.472955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.473172 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.473381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.473670 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.473946 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.476009 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.476403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.476693 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.477000 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.482010 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.482307 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.482601 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.484969 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.485297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.485593 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.489410 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.489699 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.489983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.490259 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.490532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.490804 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.491082 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.491377 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.491649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.491926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.492207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.492386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 00:30:04.492475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.495354 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.495451 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.495529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.495614 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.495690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.495690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.495690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.495690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.495690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.495690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.496040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.496040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.496040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.496223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.496392 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 00:30:04.530364 dv-cinder-857528-2-smb devstack@keystone.service[81615]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5643f2bdc9c0 pid: 81615 (default app) Sep 15 00:30:04.530512 dv-cinder-857528-2-smb devstack@keystone.service[81616]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5643f2bdc9c0 pid: 81616 (default app) Sep 15 00:30:04.533695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312e50d-33a6-4802-bf0e-360a71933de8 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:04.533984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312e50d-33a6-4802-bf0e-360a71933de8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:04.534258 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312e50d-33a6-4802-bf0e-360a71933de8 None None] PATH_INFO: `/v3` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:04.538417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 791 bytes} [Thu Sep 15 00:30:04 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:11.318564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c0b26-fbd5-4c2b-9b0e-4f4362f458f4 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:11.319065 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c0b26-fbd5-4c2b-9b0e-4f4362f458f4 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:11.319228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c0b26-fbd5-4c2b-9b0e-4f4362f458f4 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:11.324244 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1/2] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:30:11.329605 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e34d10-64be-44de-b70a-f8b7d1d0a557 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:11.330053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e34d10-64be-44de-b70a-f8b7d1d0a557 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:11.330188 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e34d10-64be-44de-b70a-f8b7d1d0a557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:11.399538 dv-cinder-857528-2-smb devstack@keystone.service[81615]: INFO dbcounter [None req-07e34d10-64be-44de-b70a-f8b7d1d0a557 None None] Registered counter for database keystone Sep 15 00:30:11.418678 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG oslo_db.sqlalchemy.engines [None req-07e34d10-64be-44de-b70a-f8b7d1d0a557 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 00:30:11.424847 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writer thread running {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 00:30:11.602789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG passlib.handlers.bcrypt [None req-07e34d10-64be-44de-b70a-f8b7d1d0a557 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81615) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 15 00:30:11.603111 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG passlib.handlers.bcrypt [None req-07e34d10-64be-44de-b70a-f8b7d1d0a557 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81615) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 15 00:30:11.660659 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-07e34d10-64be-44de-b70a-f8b7d1d0a557 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:11.662293 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-07e34d10-64be-44de-b70a-f8b7d1d0a557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:11.793265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 2/3] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 15 00:30:12.262465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c0b26-fbd5-4c2b-9b0e-4f4362f458f4 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:12.337600 dv-cinder-857528-2-smb devstack@keystone.service[81616]: INFO dbcounter [None req-989c0b26-fbd5-4c2b-9b0e-4f4362f458f4 None None] Registered counter for database keystone Sep 15 00:30:12.361828 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG oslo_db.sqlalchemy.engines [None req-989c0b26-fbd5-4c2b-9b0e-4f4362f458f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 00:30:12.370061 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writer thread running {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 00:30:12.503139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c0b26-fbd5-4c2b-9b0e-4f4362f458f4 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:12.509988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688d965-bfa3-485a-a71e-be125f31c6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:12.510703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688d965-bfa3-485a-a71e-be125f31c6fc admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:12.510978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688d965-bfa3-485a-a71e-be125f31c6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:12.511242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688d965-bfa3-485a-a71e-be125f31c6fc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:12.519714 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688d965-bfa3-485a-a71e-be125f31c6fc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:12.579147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e688d965-bfa3-485a-a71e-be125f31c6fc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 15 00:30:12.579570 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688d965-bfa3-485a-a71e-be125f31c6fc admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:12.589928 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1324 bytes} [Thu Sep 15 00:30:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 15 00:30:12.595988 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e34d10-64be-44de-b70a-f8b7d1d0a557 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:12.613361 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e34d10-64be-44de-b70a-f8b7d1d0a557 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:12.618343 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737cd6c-75d5-4700-90ce-eadd0204887f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:12.619453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737cd6c-75d5-4700-90ce-eadd0204887f admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:12.619734 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737cd6c-75d5-4700-90ce-eadd0204887f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:12.620005 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737cd6c-75d5-4700-90ce-eadd0204887f admin admin] PATH_INFO: `/v3/projects/6940b89e115f47bd8dfdf0af975e2ba9` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:12.621626 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737cd6c-75d5-4700-90ce-eadd0204887f admin admin] RBAC: Authorizing `identity:get_project(project_id=6940b89e115f47bd8dfdf0af975e2ba9)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:12.674413 dv-cinder-857528-2-smb devstack@keystone.service[81615]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d737cd6c-75d5-4700-90ce-eadd0204887f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 15 00:30:12.674760 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737cd6c-75d5-4700-90ce-eadd0204887f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:12.679379 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 3/5] 10.222.0.52 () {56 vars in 1207 bytes} [Thu Sep 15 00:30:12 2022] GET /identity/v3/projects/6940b89e115f47bd8dfdf0af975e2ba9 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:14.801025 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa0708-abe6-4828-a9f5-c0a638d603d0 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:14.801540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa0708-abe6-4828-a9f5-c0a638d603d0 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:14.801540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa0708-abe6-4828-a9f5-c0a638d603d0 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:14.806207 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 3/6] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:30:14.811494 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a0686-f133-466d-a7d3-25eadaf4d5bd None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:14.811858 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a0686-f133-466d-a7d3-25eadaf4d5bd None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:14.812041 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a0686-f133-466d-a7d3-25eadaf4d5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:14.832207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-df2a0686-f133-466d-a7d3-25eadaf4d5bd None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:14.833740 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-df2a0686-f133-466d-a7d3-25eadaf4d5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:14.841628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 15 00:30:15.106611 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa0708-abe6-4828-a9f5-c0a638d603d0 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:15.119705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa0708-abe6-4828-a9f5-c0a638d603d0 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:15.123893 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a590a-027e-41e0-ae65-4c006e012e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:15.124484 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a590a-027e-41e0-ae65-4c006e012e6b admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:15.124762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a590a-027e-41e0-ae65-4c006e012e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:15.125030 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a590a-027e-41e0-ae65-4c006e012e6b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:15.132669 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a590a-027e-41e0-ae65-4c006e012e6b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:15.134500 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a590a-027e-41e0-ae65-4c006e012e6b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:15.143299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1324 bytes} [Thu Sep 15 00:30:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 00:30:15.148526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a0686-f133-466d-a7d3-25eadaf4d5bd None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:15.157571 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a0686-f133-466d-a7d3-25eadaf4d5bd None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:15.161931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce026b-f2ca-414f-91ea-f92420f4bcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:15.162548 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce026b-f2ca-414f-91ea-f92420f4bcb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:15.162827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce026b-f2ca-414f-91ea-f92420f4bcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:15.163096 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce026b-f2ca-414f-91ea-f92420f4bcb7 admin admin] PATH_INFO: `/v3/users/bdfcc581c0884ebba7a2c2ed953e039a` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:15.164398 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce026b-f2ca-414f-91ea-f92420f4bcb7 admin admin] RBAC: Authorizing `identity:get_user(user_id=bdfcc581c0884ebba7a2c2ed953e039a)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:15.166782 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce026b-f2ca-414f-91ea-f92420f4bcb7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:15.168287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 5/9] 10.222.0.52 () {56 vars in 1198 bytes} [Thu Sep 15 00:30:15 2022] GET /identity/v3/users/bdfcc581c0884ebba7a2c2ed953e039a => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:17.370677 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7d05e-4698-4dd4-9f78-cd36fb4fee5d None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:17.371132 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7d05e-4698-4dd4-9f78-cd36fb4fee5d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:17.371232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7d05e-4698-4dd4-9f78-cd36fb4fee5d None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:17.372556 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 5/10] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:17.377736 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436ee76-ec62-492f-8849-284cb2e03d93 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:17.378123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436ee76-ec62-492f-8849-284cb2e03d93 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:17.378290 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436ee76-ec62-492f-8849-284cb2e03d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:17.395965 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b436ee76-ec62-492f-8849-284cb2e03d93 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:17.397184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b436ee76-ec62-492f-8849-284cb2e03d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:17.410127 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b1645-0037-4a90-9b45-4478923801eb None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:17.410412 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b1645-0037-4a90-9b45-4478923801eb None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:17.410688 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b1645-0037-4a90-9b45-4478923801eb None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:17.412000 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 6/11] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:30:17.417739 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9ab52-f5a6-44f0-9c71-9df411199579 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:17.418028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9ab52-f5a6-44f0-9c71-9df411199579 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:17.418304 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9ab52-f5a6-44f0-9c71-9df411199579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:17.460135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG passlib.handlers.bcrypt [None req-adc9ab52-f5a6-44f0-9c71-9df411199579 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81616) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 15 00:30:17.460531 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG passlib.handlers.bcrypt [None req-adc9ab52-f5a6-44f0-9c71-9df411199579 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81616) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 15 00:30:17.479914 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 6/12] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:17.510467 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-adc9ab52-f5a6-44f0-9c71-9df411199579 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:17.512054 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-adc9ab52-f5a6-44f0-9c71-9df411199579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:17.610737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 7/13] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:30:17.745843 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436ee76-ec62-492f-8849-284cb2e03d93 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:17.770832 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:17.852038 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436ee76-ec62-492f-8849-284cb2e03d93 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:17.881210 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9ab52-f5a6-44f0-9c71-9df411199579 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:17.886526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c58a5-42ee-467d-af1d-71963722f5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:17.887158 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c58a5-42ee-467d-af1d-71963722f5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:17.887437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c58a5-42ee-467d-af1d-71963722f5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:17.887711 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c58a5-42ee-467d-af1d-71963722f5f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:17.898933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c58a5-42ee-467d-af1d-71963722f5f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:17.908250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-c04c58a5-42ee-467d-af1d-71963722f5f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:30:17.908250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:17.908250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:17.908250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:17.908250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:17.908250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:17.908250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:17.908250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:17.908250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:17.908250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:17.908250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:17.908250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:17.908250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:17.908250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:17.908250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:17.908250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:17.909352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:17.909352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:17.909352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:17.909352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:17.909352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:17.909352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:17.909352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:17.909352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:17.909352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:17.909352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:17.909352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:17.909352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:17.909352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:17.909352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:17.909352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:17.909352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:17.910325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:17.910325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:17.910325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:17.910325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:17.910325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:17.910325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:17.910325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:17.910325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:17.910325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:17.910325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:17.910325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:30:17.910325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:30:17.910325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 7/14] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:30:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:17.917745 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c58a5-42ee-467d-af1d-71963722f5f6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:17.982853 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9ab52-f5a6-44f0-9c71-9df411199579 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:17.985220 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:17.998488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:18.016906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c58a5-42ee-467d-af1d-71963722f5f6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:18.020316 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de06b71-494e-4eb0-bd6e-a815cd9dd088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:18.021277 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de06b71-494e-4eb0-bd6e-a815cd9dd088 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:18.021556 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de06b71-494e-4eb0-bd6e-a815cd9dd088 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:18.021823 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de06b71-494e-4eb0-bd6e-a815cd9dd088 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:18.050319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0bf60-dce9-4d24-9b2a-f8473f5644de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:18.050922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0bf60-dce9-4d24-9b2a-f8473f5644de None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:18.051198 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0bf60-dce9-4d24-9b2a-f8473f5644de None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:18.051470 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0bf60-dce9-4d24-9b2a-f8473f5644de None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:18.052133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0bf60-dce9-4d24-9b2a-f8473f5644de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:18.052441 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0bf60-dce9-4d24-9b2a-f8473f5644de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:18.053863 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0bf60-dce9-4d24-9b2a-f8473f5644de None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:18.065613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 8/15] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:30:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:30:18.071216 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0bf60-dce9-4d24-9b2a-f8473f5644de None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:18.091292 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de06b71-494e-4eb0-bd6e-a815cd9dd088 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:18.092808 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de06b71-494e-4eb0-bd6e-a815cd9dd088 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:18.172426 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0bf60-dce9-4d24-9b2a-f8473f5644de None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:18.191400 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 8/16] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:30:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 00:30:18.197487 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de06b71-494e-4eb0-bd6e-a815cd9dd088 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:18.200353 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:18.206390 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f133fc-dce8-4dab-8309-c5d51609e98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:18.207024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f133fc-dce8-4dab-8309-c5d51609e98d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:18.207305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f133fc-dce8-4dab-8309-c5d51609e98d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:18.207583 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f133fc-dce8-4dab-8309-c5d51609e98d None admin] PATH_INFO: `/v3/users/bdfcc581c0884ebba7a2c2ed953e039a` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:18.208738 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f133fc-dce8-4dab-8309-c5d51609e98d None admin] RBAC: Authorizing `identity:get_user(user_id=bdfcc581c0884ebba7a2c2ed953e039a)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:18.210298 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f133fc-dce8-4dab-8309-c5d51609e98d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:18.212640 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 9/17] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:18 2022] GET /identity/v3/users/bdfcc581c0884ebba7a2c2ed953e039a => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:30:18.217940 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f133fc-dce8-4dab-8309-c5d51609e98d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:18.232334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:18.296836 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de06b71-494e-4eb0-bd6e-a815cd9dd088 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:18.316367 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f133fc-dce8-4dab-8309-c5d51609e98d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:18.330071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2cab3-76c9-4590-9c9b-f84d2a5a211c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:18.330927 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2cab3-76c9-4590-9c9b-f84d2a5a211c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:18.331210 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2cab3-76c9-4590-9c9b-f84d2a5a211c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:18.331486 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2cab3-76c9-4590-9c9b-f84d2a5a211c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:18.350481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2cab3-76c9-4590-9c9b-f84d2a5a211c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:18.350686 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9efaf2-edde-446e-88f9-7eae2f1b912c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:18.351315 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9efaf2-edde-446e-88f9-7eae2f1b912c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:18.351595 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9efaf2-edde-446e-88f9-7eae2f1b912c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:18.351868 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9efaf2-edde-446e-88f9-7eae2f1b912c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:18.351952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2cab3-76c9-4590-9c9b-f84d2a5a211c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:18.353050 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9efaf2-edde-446e-88f9-7eae2f1b912c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:18.354525 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9efaf2-edde-446e-88f9-7eae2f1b912c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:18.356067 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 10/18] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:30:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:30:18.362144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9efaf2-edde-446e-88f9-7eae2f1b912c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:18.370488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-a2b2cab3-76c9-4590-9c9b-f84d2a5a211c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:30:18.370488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:18.370488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:18.370488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:18.370488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:18.370488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:18.370488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:18.370488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:18.370488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:18.370488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:18.370488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:18.370488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:18.370488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:30:18.370488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:30:18.370488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:30:18.370488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:30:18.371797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:18.371797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:18.371797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:18.371797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:18.371797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:18.371797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:18.371797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:18.371797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:18.371797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:18.371797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:18.371797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:18.371797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:18.371797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:18.371797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:18.371797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:18.371797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:18.371797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:30:18.372598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:30:18.372598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:30:18.372598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:30:18.372598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 9/19] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:30:18.377278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2cab3-76c9-4590-9c9b-f84d2a5a211c None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:18.433401 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:18.441733 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:18.460877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9efaf2-edde-446e-88f9-7eae2f1b912c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:18.479157 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2cab3-76c9-4590-9c9b-f84d2a5a211c None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:18.496419 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607760ad-30ec-4566-852f-6db0c64f51b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:18.497026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607760ad-30ec-4566-852f-6db0c64f51b2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:18.497346 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607760ad-30ec-4566-852f-6db0c64f51b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:18.497621 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607760ad-30ec-4566-852f-6db0c64f51b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:18.498341 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607760ad-30ec-4566-852f-6db0c64f51b2 None admin] RBAC: Adding query filter params (role.id=0ee2daa9cb3c41fb901603e3d8caf784, scope.domain.id=default, user.id=bdfcc581c0884ebba7a2c2ed953e039a) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:18.498646 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607760ad-30ec-4566-852f-6db0c64f51b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:18.500083 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607760ad-30ec-4566-852f-6db0c64f51b2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:18.506932 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 11/20] 10.222.0.52 () {56 vars in 1322 bytes} [Thu Sep 15 00:30:18 2022] GET /identity/v3/role_assignments?user.id=bdfcc581c0884ebba7a2c2ed953e039a&scope.domain.id=default&role.id=0ee2daa9cb3c41fb901603e3d8caf784 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:30:18.516995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4850d-8e0e-4f69-a38e-3d2ac2a7ec81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:18.517657 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4850d-8e0e-4f69-a38e-3d2ac2a7ec81 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:18.517934 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4850d-8e0e-4f69-a38e-3d2ac2a7ec81 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:18.518201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4850d-8e0e-4f69-a38e-3d2ac2a7ec81 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:18.518859 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4850d-8e0e-4f69-a38e-3d2ac2a7ec81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:18.519159 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4850d-8e0e-4f69-a38e-3d2ac2a7ec81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:18.520570 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4850d-8e0e-4f69-a38e-3d2ac2a7ec81 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:18.541296 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 10/21] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:30:20.770411 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0429d-45ed-469c-be2f-12d7ded5aa82 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:20.770411 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0429d-45ed-469c-be2f-12d7ded5aa82 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:20.770411 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0429d-45ed-469c-be2f-12d7ded5aa82 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:20.771458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 12/22] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:20.776024 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73b95-a8ab-415f-9481-648a4d7112d5 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:20.776796 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73b95-a8ab-415f-9481-648a4d7112d5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:20.777318 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73b95-a8ab-415f-9481-648a4d7112d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:20.803747 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-a6b73b95-a8ab-415f-9481-648a4d7112d5 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:20.805286 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a6b73b95-a8ab-415f-9481-648a4d7112d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:20.919391 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 11/23] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:21.358430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0429d-45ed-469c-be2f-12d7ded5aa82 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:21.533773 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0429d-45ed-469c-be2f-12d7ded5aa82 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:21.594262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af218da-20c7-4890-8f87-f5995b2dc6fd None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:21.594894 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af218da-20c7-4890-8f87-f5995b2dc6fd None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:21.595357 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af218da-20c7-4890-8f87-f5995b2dc6fd None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:21.596780 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56811b-d4ea-458f-a602-6443f2cd8452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:21.597275 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 12/24] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:21.601161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56811b-d4ea-458f-a602-6443f2cd8452 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:21.601161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56811b-d4ea-458f-a602-6443f2cd8452 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:21.601161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56811b-d4ea-458f-a602-6443f2cd8452 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:21.612168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6e965-f916-4583-8567-8b12d2128b3e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:21.612783 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6e965-f916-4583-8567-8b12d2128b3e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:21.613279 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6e965-f916-4583-8567-8b12d2128b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:21.623922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56811b-d4ea-458f-a602-6443f2cd8452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:21.633459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-de56811b-d4ea-458f-a602-6443f2cd8452 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:30:21.633459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:21.633459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:21.633459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:21.633459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:21.633459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:21.633459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:21.633459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:21.633459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:21.633459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:21.633459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:21.633459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:21.633459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:21.633459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:21.633459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:21.633459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:21.634963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:21.634963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:21.634963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:21.634963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:21.634963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:21.634963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:21.634963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:21.634963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:21.634963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:21.634963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:21.634963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:21.634963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:21.634963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:21.634963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:21.634963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:21.634963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:21.635905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:21.635905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:21.635905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:21.635905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:21.635905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:21.635905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:21.635905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:21.635905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:21.635905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:21.635905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:21.635905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:30:21.635905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:30:21.637928 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 13/25] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:30:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:21.654619 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87332-669d-4919-91ac-ae20f27cca39 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:21.655138 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87332-669d-4919-91ac-ae20f27cca39 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:21.655570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87332-669d-4919-91ac-ae20f27cca39 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:21.657724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 14/26] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:21.658592 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d87332-669d-4919-91ac-ae20f27cca39 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:21.666417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-9cb6e965-f916-4583-8567-8b12d2128b3e None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:21.667842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9cb6e965-f916-4583-8567-8b12d2128b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:21.672145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:21.730103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:21.758325 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 13/27] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:30:21.760669 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ab3d1-5a0c-43b8-a501-2ed2598f8136 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:21.761247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ab3d1-5a0c-43b8-a501-2ed2598f8136 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:21.761742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ab3d1-5a0c-43b8-a501-2ed2598f8136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:21.788191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b61ab3d1-5a0c-43b8-a501-2ed2598f8136 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:21.789401 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b61ab3d1-5a0c-43b8-a501-2ed2598f8136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:21.808812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d87332-669d-4919-91ac-ae20f27cca39 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:21.859097 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab9fa2-1d46-465e-9f3f-112ffa951ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:21.860182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab9fa2-1d46-465e-9f3f-112ffa951ace None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:21.860677 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab9fa2-1d46-465e-9f3f-112ffa951ace None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:21.861195 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab9fa2-1d46-465e-9f3f-112ffa951ace None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:21.862266 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab9fa2-1d46-465e-9f3f-112ffa951ace None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:21.862910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab9fa2-1d46-465e-9f3f-112ffa951ace None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:21.864498 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab9fa2-1d46-465e-9f3f-112ffa951ace None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:21.867135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 14/28] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:21.869201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d06d2f-4197-4059-8e70-c1ef37ee5642 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:21.869686 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d06d2f-4197-4059-8e70-c1ef37ee5642 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:21.870160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d06d2f-4197-4059-8e70-c1ef37ee5642 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:21.871874 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 15/29] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:21.877557 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a4aa8-b587-4c81-84c9-6556a6c3a40d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:21.878129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a4aa8-b587-4c81-84c9-6556a6c3a40d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:21.878603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a4aa8-b587-4c81-84c9-6556a6c3a40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:21.881792 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 15/30] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:30:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:21.890203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab9fa2-1d46-465e-9f3f-112ffa951ace None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:21.911018 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b89a4aa8-b587-4c81-84c9-6556a6c3a40d None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:21.912718 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b89a4aa8-b587-4c81-84c9-6556a6c3a40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:22.018512 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 16/31] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:30:22.025241 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:22.096774 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab9fa2-1d46-465e-9f3f-112ffa951ace None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:22.129375 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a4aa8-b587-4c81-84c9-6556a6c3a40d None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:22.173647 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc679a2-f660-44b3-ae96-18ab2c6f9838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:22.174293 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc679a2-f660-44b3-ae96-18ab2c6f9838 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:22.174733 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc679a2-f660-44b3-ae96-18ab2c6f9838 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:22.175145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc679a2-f660-44b3-ae96-18ab2c6f9838 None admin] PATH_INFO: `/v3/users/bdfcc581c0884ebba7a2c2ed953e039a` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:22.176457 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc679a2-f660-44b3-ae96-18ab2c6f9838 None admin] RBAC: Authorizing `identity:get_user(user_id=bdfcc581c0884ebba7a2c2ed953e039a)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:22.178107 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc679a2-f660-44b3-ae96-18ab2c6f9838 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:22.181821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 16/32] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:21 2022] GET /identity/v3/users/bdfcc581c0884ebba7a2c2ed953e039a => generated 247 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:22.184845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:22.190040 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc679a2-f660-44b3-ae96-18ab2c6f9838 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:22.334614 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a4aa8-b587-4c81-84c9-6556a6c3a40d None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:22.381516 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc679a2-f660-44b3-ae96-18ab2c6f9838 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:22.392160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c847c-7662-41b2-8683-c0780af7d09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:22.393031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c847c-7662-41b2-8683-c0780af7d09b None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:22.393553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c847c-7662-41b2-8683-c0780af7d09b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:22.394034 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c847c-7662-41b2-8683-c0780af7d09b None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:22.394895 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c847c-7662-41b2-8683-c0780af7d09b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:22.396485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c847c-7662-41b2-8683-c0780af7d09b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:22.420858 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220dbea4-3efa-4034-b0fd-1954a6dbdd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:22.421797 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dbea4-3efa-4034-b0fd-1954a6dbdd95 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:22.422324 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dbea4-3efa-4034-b0fd-1954a6dbdd95 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:22.422782 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dbea4-3efa-4034-b0fd-1954a6dbdd95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:22.424076 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220dbea4-3efa-4034-b0fd-1954a6dbdd95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:22.425782 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220dbea4-3efa-4034-b0fd-1954a6dbdd95 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:22.427566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 17/33] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:30:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:22.428563 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220dbea4-3efa-4034-b0fd-1954a6dbdd95 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:22.432292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:22.545241 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220dbea4-3efa-4034-b0fd-1954a6dbdd95 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:22.548353 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 17/34] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Sep 15 00:30:22 2022] POST /identity/v3/roles => generated 225 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:30:22.549291 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c847c-7662-41b2-8683-c0780af7d09b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:22.619907 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028c5df-52d3-426a-ae08-3c0d5f8783a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:22.620825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028c5df-52d3-426a-ae08-3c0d5f8783a3 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:22.621289 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028c5df-52d3-426a-ae08-3c0d5f8783a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:22.621705 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028c5df-52d3-426a-ae08-3c0d5f8783a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:22.622547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028c5df-52d3-426a-ae08-3c0d5f8783a3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:22.633187 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028c5df-52d3-426a-ae08-3c0d5f8783a3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:22.681404 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:22.688926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c847c-7662-41b2-8683-c0780af7d09b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:22.764909 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8616fd5-6eaa-489f-82a2-ae3138ad8dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:22.765624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8616fd5-6eaa-489f-82a2-ae3138ad8dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:22.765906 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8616fd5-6eaa-489f-82a2-ae3138ad8dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:22.766187 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8616fd5-6eaa-489f-82a2-ae3138ad8dd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:22.778337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8616fd5-6eaa-489f-82a2-ae3138ad8dd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:22.779948 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8616fd5-6eaa-489f-82a2-ae3138ad8dd3 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:22.787738 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 18/35] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Sep 15 00:30:22 2022] POST /identity/v3/roles => generated 219 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:30:22.789246 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028c5df-52d3-426a-ae08-3c0d5f8783a3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:22.803984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-e8616fd5-6eaa-489f-82a2-ae3138ad8dd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:30:22.803984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:22.803984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:22.803984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:22.803984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:22.803984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:22.803984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:22.803984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:22.803984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:22.803984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:22.803984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:22.803984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:22.803984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:30:22.803984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:30:22.803984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:30:22.803984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:30:22.805261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:22.805261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:22.805261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:22.805261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:22.805261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:22.805261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:22.805261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:22.805261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:22.805261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:22.805261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:22.805261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:22.805261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:22.805261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:22.805261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:22.805261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:22.805261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:22.805261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:30:22.807273 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:30:22.807273 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:30:22.807273 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:30:22.807273 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 18/36] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:30:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:22.807273 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ad0b8-0cb8-4cbd-af6e-5bdb5a3f91da None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:22.807537 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ad0b8-0cb8-4cbd-af6e-5bdb5a3f91da None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:22.807602 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ad0b8-0cb8-4cbd-af6e-5bdb5a3f91da None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:22.809053 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 19/37] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:22.818019 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5ea25-5c14-45f5-ba02-88d6267bc792 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:22.818317 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5ea25-5c14-45f5-ba02-88d6267bc792 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:22.818593 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5ea25-5c14-45f5-ba02-88d6267bc792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:22.855157 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-6ac5ea25-5c14-45f5-ba02-88d6267bc792 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:22.856856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6ac5ea25-5c14-45f5-ba02-88d6267bc792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:22.895027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:22.958490 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028c5df-52d3-426a-ae08-3c0d5f8783a3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:22.974665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 20/38] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:22.975742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5ea25-5c14-45f5-ba02-88d6267bc792 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:23.014638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9dc3f5-d930-4de4-9458-1d93de0e9440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:23.015330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dc3f5-d930-4de4-9458-1d93de0e9440 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:23.016277 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dc3f5-d930-4de4-9458-1d93de0e9440 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:23.016701 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dc3f5-d930-4de4-9458-1d93de0e9440 None admin] PATH_INFO: `/v3/domains/default/users/bdfcc581c0884ebba7a2c2ed953e039a/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:23.019067 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9dc3f5-d930-4de4-9458-1d93de0e9440 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bdfcc581c0884ebba7a2c2ed953e039a, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:23.021310 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9dc3f5-d930-4de4-9458-1d93de0e9440 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:23.041872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 19/39] 10.222.0.52 () {58 vars in 1361 bytes} [Thu Sep 15 00:30:22 2022] PUT /identity/v3/domains/default/users/bdfcc581c0884ebba7a2c2ed953e039a/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:30:23.043733 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371b266-1e2a-4ad7-861d-4192fff5ecdf None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:23.044159 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371b266-1e2a-4ad7-861d-4192fff5ecdf None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:23.044501 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371b266-1e2a-4ad7-861d-4192fff5ecdf None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:23.046430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 20/40] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:23.058386 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15557cc7-bbde-4f1d-9c9e-dbd23e5222e9 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:23.058722 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15557cc7-bbde-4f1d-9c9e-dbd23e5222e9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:23.058949 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15557cc7-bbde-4f1d-9c9e-dbd23e5222e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:23.101502 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:23.122363 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5ea25-5c14-45f5-ba02-88d6267bc792 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:23.176902 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc8520-bcd0-43fb-80ed-181068370eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:23.177496 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc8520-bcd0-43fb-80ed-181068370eff None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:23.178016 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc8520-bcd0-43fb-80ed-181068370eff None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:23.178016 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc8520-bcd0-43fb-80ed-181068370eff None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:23.178696 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc8520-bcd0-43fb-80ed-181068370eff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:23.179003 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc8520-bcd0-43fb-80ed-181068370eff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:23.181362 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc8520-bcd0-43fb-80ed-181068370eff None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:23.210073 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 21/41] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:23.220235 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-15557cc7-bbde-4f1d-9c9e-dbd23e5222e9 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:23.221027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc8520-bcd0-43fb-80ed-181068370eff None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:23.222052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-15557cc7-bbde-4f1d-9c9e-dbd23e5222e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:23.317042 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 21/42] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:23.353617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15557cc7-bbde-4f1d-9c9e-dbd23e5222e9 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:23.363310 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc8520-bcd0-43fb-80ed-181068370eff None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:23.413112 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5bcd0-f022-4f59-99c1-b655be3ec2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:23.413332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5bcd0-f022-4f59-99c1-b655be3ec2be None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:23.413624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5bcd0-f022-4f59-99c1-b655be3ec2be None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:23.413907 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5bcd0-f022-4f59-99c1-b655be3ec2be None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:23.415427 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5bcd0-f022-4f59-99c1-b655be3ec2be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:23.417294 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5bcd0-f022-4f59-99c1-b655be3ec2be None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:23.424733 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:23.433597 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:23.460904 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 22/43] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 15 00:30:23 2022] POST /identity/v3/projects => generated 301 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:30:23.489227 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15557cc7-bbde-4f1d-9c9e-dbd23e5222e9 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:23.531852 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f68115-d3ce-4430-a07a-f0433c1e7a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:23.532585 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f68115-d3ce-4430-a07a-f0433c1e7a57 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:23.532919 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f68115-d3ce-4430-a07a-f0433c1e7a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:23.533222 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f68115-d3ce-4430-a07a-f0433c1e7a57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:23.534627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f68115-d3ce-4430-a07a-f0433c1e7a57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:23.536280 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f68115-d3ce-4430-a07a-f0433c1e7a57 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:23.538101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 22/44] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:30:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:30:23.544429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5bcd0-f022-4f59-99c1-b655be3ec2be None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:23.597756 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f68115-d3ce-4430-a07a-f0433c1e7a57 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:23.687156 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5bcd0-f022-4f59-99c1-b655be3ec2be None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:23.721217 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f68115-d3ce-4430-a07a-f0433c1e7a57 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:23.735921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84642e17-e0ad-4ffa-8c6a-ca9e41cd3192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:23.736543 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84642e17-e0ad-4ffa-8c6a-ca9e41cd3192 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:23.737151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84642e17-e0ad-4ffa-8c6a-ca9e41cd3192 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:23.737611 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84642e17-e0ad-4ffa-8c6a-ca9e41cd3192 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:23.738440 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84642e17-e0ad-4ffa-8c6a-ca9e41cd3192 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:23.740977 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84642e17-e0ad-4ffa-8c6a-ca9e41cd3192 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:23.755280 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:23.770721 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 23/45] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 15 00:30:23 2022] POST /identity/v3/projects => generated 312 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:30:23.772147 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8d9c8-5607-4f8e-a547-c7a8f04d7f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:23.772759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8d9c8-5607-4f8e-a547-c7a8f04d7f29 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:23.773045 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8d9c8-5607-4f8e-a547-c7a8f04d7f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:23.773355 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8d9c8-5607-4f8e-a547-c7a8f04d7f29 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:23.774039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8d9c8-5607-4f8e-a547-c7a8f04d7f29 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:23.775487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8d9c8-5607-4f8e-a547-c7a8f04d7f29 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:23.791283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 23/46] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Sep 15 00:30:23 2022] POST /identity/v3/roles => generated 223 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:30:25.347632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec9ab7-0f1c-41dc-aa15-60028d3de7b9 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:25.348033 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec9ab7-0f1c-41dc-aa15-60028d3de7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:25.348198 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec9ab7-0f1c-41dc-aa15-60028d3de7b9 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:25.349587 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 24/47] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:25.354931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c5553-5258-454b-ba83-7e195704dfa9 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:25.355354 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c5553-5258-454b-ba83-7e195704dfa9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:25.355518 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c5553-5258-454b-ba83-7e195704dfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:25.374202 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-de3c5553-5258-454b-ba83-7e195704dfa9 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:25.375376 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-de3c5553-5258-454b-ba83-7e195704dfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:25.440802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 24/48] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:25.707597 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec9ab7-0f1c-41dc-aa15-60028d3de7b9 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:25.754641 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:25.811938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec9ab7-0f1c-41dc-aa15-60028d3de7b9 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:25.845310 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b101530-16f1-438d-aabe-949f814c5b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:25.845984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b101530-16f1-438d-aabe-949f814c5b25 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:25.846265 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b101530-16f1-438d-aabe-949f814c5b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:25.846533 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b101530-16f1-438d-aabe-949f814c5b25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:25.860816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b101530-16f1-438d-aabe-949f814c5b25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:25.867043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-8b101530-16f1-438d-aabe-949f814c5b25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:30:25.867043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:25.867043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:25.867043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:25.867043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:25.867043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:25.867043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:25.867043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:25.867043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:25.867043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:25.867043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:25.867043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:25.867043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:25.867043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:25.867043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:25.867043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:25.868052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:25.868052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:25.868052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:25.868052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:25.868052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:25.868052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:25.868052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:25.868052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:25.868052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:25.868052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:25.868052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:25.868052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:25.868052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:25.868052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:25.868052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:25.868052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:25.869601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:25.869601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:25.869601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:25.869601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:25.869601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:25.869601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:25.869601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:25.869601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:25.869601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:25.869601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:25.869601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:30:25.869601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:30:25.869601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 25/49] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:30:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:25.874846 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c5553-5258-454b-ba83-7e195704dfa9 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:25.961036 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86d7eb-cd8c-4828-b77b-a811a97af712 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:25.961289 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86d7eb-cd8c-4828-b77b-a811a97af712 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:25.961580 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86d7eb-cd8c-4828-b77b-a811a97af712 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:25.963425 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 26/50] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:30:25.968284 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219098ed-1c03-4c3d-9f73-f400515ddb79 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:25.968569 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219098ed-1c03-4c3d-9f73-f400515ddb79 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:25.968845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219098ed-1c03-4c3d-9f73-f400515ddb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:25.974713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c5553-5258-454b-ba83-7e195704dfa9 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:25.986178 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:25.987946 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-219098ed-1c03-4c3d-9f73-f400515ddb79 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:25.989279 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-219098ed-1c03-4c3d-9f73-f400515ddb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:26.010873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446aec5a-d357-48c5-b6cd-30a7640e6fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:26.011455 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446aec5a-d357-48c5-b6cd-30a7640e6fbb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:26.011720 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446aec5a-d357-48c5-b6cd-30a7640e6fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:26.011990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446aec5a-d357-48c5-b6cd-30a7640e6fbb None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:26.012643 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446aec5a-d357-48c5-b6cd-30a7640e6fbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:26.012945 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446aec5a-d357-48c5-b6cd-30a7640e6fbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:26.014428 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446aec5a-d357-48c5-b6cd-30a7640e6fbb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:26.022532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 25/51] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:30:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:26.028681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446aec5a-d357-48c5-b6cd-30a7640e6fbb None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:26.060879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 27/52] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:30:26.124358 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446aec5a-d357-48c5-b6cd-30a7640e6fbb None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:26.156155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e52c60-a81e-4bd0-b3d0-797dbdef48fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:26.156776 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e52c60-a81e-4bd0-b3d0-797dbdef48fe None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:26.157051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e52c60-a81e-4bd0-b3d0-797dbdef48fe None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:26.157480 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e52c60-a81e-4bd0-b3d0-797dbdef48fe None admin] PATH_INFO: `/v3/users/bdfcc581c0884ebba7a2c2ed953e039a` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:26.158469 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e52c60-a81e-4bd0-b3d0-797dbdef48fe None admin] RBAC: Authorizing `identity:get_user(user_id=bdfcc581c0884ebba7a2c2ed953e039a)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:26.159913 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e52c60-a81e-4bd0-b3d0-797dbdef48fe None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:26.163046 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:26 2022] GET /identity/v3/users/bdfcc581c0884ebba7a2c2ed953e039a => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:30:26.167526 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219098ed-1c03-4c3d-9f73-f400515ddb79 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:26.197330 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:26.265643 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219098ed-1c03-4c3d-9f73-f400515ddb79 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:26.301925 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898da81c-3360-41c3-9766-34654abe87b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:26.302544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898da81c-3360-41c3-9766-34654abe87b1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:26.302821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898da81c-3360-41c3-9766-34654abe87b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:26.303092 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898da81c-3360-41c3-9766-34654abe87b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:26.304186 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898da81c-3360-41c3-9766-34654abe87b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:26.305674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898da81c-3360-41c3-9766-34654abe87b1 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:26.307407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 28/54] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:30:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:26.312923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e52c60-a81e-4bd0-b3d0-797dbdef48fe None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:26.328732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898da81c-3360-41c3-9766-34654abe87b1 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:26.356885 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:26.420949 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e52c60-a81e-4bd0-b3d0-797dbdef48fe None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:26.456485 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d544b0d-3ca9-4f10-b05c-26cf9d5b4817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:26.457111 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d544b0d-3ca9-4f10-b05c-26cf9d5b4817 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:26.457406 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d544b0d-3ca9-4f10-b05c-26cf9d5b4817 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:26.457683 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d544b0d-3ca9-4f10-b05c-26cf9d5b4817 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:26.458421 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d544b0d-3ca9-4f10-b05c-26cf9d5b4817 None admin] RBAC: Adding query filter params (role.id=0ee2daa9cb3c41fb901603e3d8caf784, scope.domain.id=default, user.id=bdfcc581c0884ebba7a2c2ed953e039a) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:26.458735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d544b0d-3ca9-4f10-b05c-26cf9d5b4817 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:26.460194 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d544b0d-3ca9-4f10-b05c-26cf9d5b4817 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:26.467402 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1322 bytes} [Thu Sep 15 00:30:26 2022] GET /identity/v3/role_assignments?user.id=bdfcc581c0884ebba7a2c2ed953e039a&scope.domain.id=default&role.id=0ee2daa9cb3c41fb901603e3d8caf784 => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:26.536869 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:26.540305 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898da81c-3360-41c3-9766-34654abe87b1 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:26.577182 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3db2df-c9f3-439f-acd4-4b90885fdeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:26.577837 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3db2df-c9f3-439f-acd4-4b90885fdeef None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:26.578124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3db2df-c9f3-439f-acd4-4b90885fdeef None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:26.578400 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3db2df-c9f3-439f-acd4-4b90885fdeef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:26.579547 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3db2df-c9f3-439f-acd4-4b90885fdeef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:26.581023 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3db2df-c9f3-439f-acd4-4b90885fdeef None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:26.582678 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 29/56] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:30:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:30:26.589030 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d544b0d-3ca9-4f10-b05c-26cf9d5b4817 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:26.692395 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d544b0d-3ca9-4f10-b05c-26cf9d5b4817 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:26.695003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:26.727269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262c029-eb96-4511-8644-5aeb97cce57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:26.727896 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262c029-eb96-4511-8644-5aeb97cce57d None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:26.728177 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262c029-eb96-4511-8644-5aeb97cce57d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:26.728450 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262c029-eb96-4511-8644-5aeb97cce57d None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:26.729153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262c029-eb96-4511-8644-5aeb97cce57d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:26.730583 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262c029-eb96-4511-8644-5aeb97cce57d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:26.759959 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 28/57] 10.222.0.52 () {60 vars in 1140 bytes} [Thu Sep 15 00:30:26 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:30:28.917992 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e5038-ec68-4b01-831a-bc778cce1d43 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:28.918495 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e5038-ec68-4b01-831a-bc778cce1d43 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:28.918581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e5038-ec68-4b01-831a-bc778cce1d43 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:28.919891 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 30/58] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:28.925416 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682f36d-2c62-4aec-9e8a-6b158f6fbf9c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:28.925818 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682f36d-2c62-4aec-9e8a-6b158f6fbf9c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:28.925974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682f36d-2c62-4aec-9e8a-6b158f6fbf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:28.944469 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5682f36d-2c62-4aec-9e8a-6b158f6fbf9c None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:28.945690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5682f36d-2c62-4aec-9e8a-6b158f6fbf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:29.017753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 29/59] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:29.292083 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e5038-ec68-4b01-831a-bc778cce1d43 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:29.398063 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e5038-ec68-4b01-831a-bc778cce1d43 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:29.431971 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ba5fb-4f6e-4063-b099-7dfb39cb3fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:29.432604 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ba5fb-4f6e-4063-b099-7dfb39cb3fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:29.432885 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ba5fb-4f6e-4063-b099-7dfb39cb3fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:29.433186 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ba5fb-4f6e-4063-b099-7dfb39cb3fb7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:29.434304 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ba5fb-4f6e-4063-b099-7dfb39cb3fb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:29.435742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ba5fb-4f6e-4063-b099-7dfb39cb3fb7 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:29.437354 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 31/60] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:30:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:29.442922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682f36d-2c62-4aec-9e8a-6b158f6fbf9c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:29.529959 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:29.546515 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682f36d-2c62-4aec-9e8a-6b158f6fbf9c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:29.580547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4886203-5c30-4851-b891-b461f9c3c1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:29.581309 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4886203-5c30-4851-b891-b461f9c3c1cd None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:29.581592 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4886203-5c30-4851-b891-b461f9c3c1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:29.581869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4886203-5c30-4851-b891-b461f9c3c1cd None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:29.582526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4886203-5c30-4851-b891-b461f9c3c1cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:29.583978 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4886203-5c30-4851-b891-b461f9c3c1cd None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:29.611722 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 30/61] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 15 00:30:29 2022] POST /identity/v3/users => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:30:33.357255 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20eeef-d150-479a-baf8-ef444149e6a3 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:33.358331 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20eeef-d150-479a-baf8-ef444149e6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:33.358771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20eeef-d150-479a-baf8-ef444149e6a3 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:33.360250 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 32/62] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:33.367997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cab9c4-af0b-4cf6-9f1e-5a8289310931 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:33.369119 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cab9c4-af0b-4cf6-9f1e-5a8289310931 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:33.369195 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cab9c4-af0b-4cf6-9f1e-5a8289310931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:33.398136 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f7cab9c4-af0b-4cf6-9f1e-5a8289310931 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:33.399410 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f7cab9c4-af0b-4cf6-9f1e-5a8289310931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:33.529038 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 31/63] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:33.563369 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b704088-5b89-462c-ad06-fe6eadcd33e5 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:33.563369 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b704088-5b89-462c-ad06-fe6eadcd33e5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:33.563369 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b704088-5b89-462c-ad06-fe6eadcd33e5 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:33.565395 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 33/64] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:33.573124 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec298f1-0bde-4feb-8366-33a482a77971 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:33.573124 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec298f1-0bde-4feb-8366-33a482a77971 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:33.573124 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec298f1-0bde-4feb-8366-33a482a77971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:33.598789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9ec298f1-0bde-4feb-8366-33a482a77971 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:33.600299 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9ec298f1-0bde-4feb-8366-33a482a77971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:33.696861 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38027c2-4880-4def-a659-a52c60761b43 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:33.697527 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38027c2-4880-4def-a659-a52c60761b43 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:33.698417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38027c2-4880-4def-a659-a52c60761b43 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:33.704435 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 34/65] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:33.706604 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e460d42-f519-4c1c-9457-8d3b03e35b58 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:33.707103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e460d42-f519-4c1c-9457-8d3b03e35b58 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:33.707577 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e460d42-f519-4c1c-9457-8d3b03e35b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:33.739718 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 32/66] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:33.746379 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-3e460d42-f519-4c1c-9457-8d3b03e35b58 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:33.747846 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3e460d42-f519-4c1c-9457-8d3b03e35b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:33.826960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:33.894734 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec298f1-0bde-4feb-8366-33a482a77971 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:33.901508 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:33.927843 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 35/67] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:30:33.964689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb63cf-e713-4f69-b2f7-9b94be0d17de None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:33.965357 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb63cf-e713-4f69-b2f7-9b94be0d17de None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:33.965835 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb63cf-e713-4f69-b2f7-9b94be0d17de None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:33.969800 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 36/68] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:33.976091 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d14d74-68f0-4a38-857a-32615f905d70 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:33.976552 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d14d74-68f0-4a38-857a-32615f905d70 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:33.976989 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d14d74-68f0-4a38-857a-32615f905d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:34.012432 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-51d14d74-68f0-4a38-857a-32615f905d70 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:34.015458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-51d14d74-68f0-4a38-857a-32615f905d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:34.082116 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec298f1-0bde-4feb-8366-33a482a77971 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:34.108067 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 37/69] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:34.109812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8e180-b558-47cb-8379-33e142af5d54 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:34.110108 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8e180-b558-47cb-8379-33e142af5d54 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:34.110379 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8e180-b558-47cb-8379-33e142af5d54 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:34.115842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 38/70] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:34.116643 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8e180-b558-47cb-8379-33e142af5d54 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:34.123364 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e587b-b483-4beb-89d1-f0de1d13497d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:34.124013 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e587b-b483-4beb-89d1-f0de1d13497d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:34.124296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e587b-b483-4beb-89d1-f0de1d13497d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:34.124574 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e587b-b483-4beb-89d1-f0de1d13497d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:34.136277 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e587b-b483-4beb-89d1-f0de1d13497d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:34.141488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-054e587b-b483-4beb-89d1-f0de1d13497d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:30:34.141488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:34.141488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:34.141488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:34.141488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:34.141488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:34.141488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:34.141488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:34.141488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:34.141488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:34.141488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:34.141488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:34.141488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:34.141488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:34.141488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:34.141488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:34.142304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:34.142304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:34.142304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:34.142304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:34.142304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:34.142304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:34.142304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:34.142304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:34.142304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:34.142304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:34.142304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:34.142304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:34.142304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:34.142304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:34.142304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:34.142304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:34.143066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:34.143066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:34.143066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:34.143066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:34.143066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:34.143066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:34.143066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:34.143066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:34.143066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:34.143066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:34.143066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:30:34.143066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:30:34.143066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 33/71] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:30:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:30:34.149440 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb1d3a-37d0-4aea-9194-f171094e3ee8 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:34.150028 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb1d3a-37d0-4aea-9194-f171094e3ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:34.150506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb1d3a-37d0-4aea-9194-f171094e3ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:34.170400 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c6fb1d3a-37d0-4aea-9194-f171094e3ee8 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:34.171917 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c6fb1d3a-37d0-4aea-9194-f171094e3ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:34.261417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:34.269954 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:34.270408 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8e180-b558-47cb-8379-33e142af5d54 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:34.283250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 34/72] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:34.283993 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb1d3a-37d0-4aea-9194-f171094e3ee8 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:34.355991 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654c82b-39d1-4848-afae-821c5c9006d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:34.356921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654c82b-39d1-4848-afae-821c5c9006d9 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:34.357415 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654c82b-39d1-4848-afae-821c5c9006d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:34.358624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654c82b-39d1-4848-afae-821c5c9006d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:34.381463 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654c82b-39d1-4848-afae-821c5c9006d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:34.387334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-6654c82b-39d1-4848-afae-821c5c9006d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:30:34.387334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:34.387334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:34.387334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:34.387334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:34.387334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:34.387334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:34.387334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:34.387334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:34.387334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:34.387334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:34.387334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:34.387334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:34.387334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:34.387334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:34.387334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:34.388168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:34.388168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:34.388168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:34.388168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:34.388168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:34.388168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:34.388168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:34.388168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:34.388168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:34.388168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:34.388168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:34.388168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:34.388168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:34.388168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:34.388168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:34.388168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:34.388924 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:34.388924 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:34.388924 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:34.388924 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:34.388924 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:34.388924 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:34.388924 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:34.388924 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:34.388924 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:34.388924 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:34.388924 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:30:34.388924 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:30:34.392151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 39/73] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:30:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:34.394471 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654c82b-39d1-4848-afae-821c5c9006d9 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:34.450826 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb1d3a-37d0-4aea-9194-f171094e3ee8 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:34.489322 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902de7a-8d97-4537-a1fc-c35d22f37a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:34.490075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902de7a-8d97-4537-a1fc-c35d22f37a31 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:34.490269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902de7a-8d97-4537-a1fc-c35d22f37a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:34.490577 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902de7a-8d97-4537-a1fc-c35d22f37a31 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:34.491261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902de7a-8d97-4537-a1fc-c35d22f37a31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:34.491567 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902de7a-8d97-4537-a1fc-c35d22f37a31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:34.492960 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902de7a-8d97-4537-a1fc-c35d22f37a31 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:34.504453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 35/74] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:30:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:34.505936 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902de7a-8d97-4537-a1fc-c35d22f37a31 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:34.515471 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654c82b-39d1-4848-afae-821c5c9006d9 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:34.556884 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dd6d5-63f8-4d06-a725-044f30ae7daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:34.557549 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dd6d5-63f8-4d06-a725-044f30ae7daf None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:34.557830 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dd6d5-63f8-4d06-a725-044f30ae7daf None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:34.558100 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dd6d5-63f8-4d06-a725-044f30ae7daf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:34.570793 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dd6d5-63f8-4d06-a725-044f30ae7daf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:34.576995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-e99dd6d5-63f8-4d06-a725-044f30ae7daf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:30:34.576995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:34.576995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:34.576995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:34.576995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:34.576995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:34.576995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:34.576995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:34.576995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:34.576995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:34.576995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:34.576995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:34.576995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:34.576995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:34.576995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:34.576995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:34.577888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:34.577888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:34.577888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:34.577888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:34.577888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:34.577888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:34.577888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:34.577888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:34.577888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:34.577888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:34.577888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:34.577888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:34.577888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:34.577888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:34.577888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:34.577888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:34.581364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:34.581364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:34.581364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:34.581364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:34.581364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:34.581364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:34.581364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:34.581364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:34.581364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:34.581364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:34.581364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:30:34.581364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:30:34.581969 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:34.582039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 40/75] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 15 00:30:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:34.582039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dd6d5-63f8-4d06-a725-044f30ae7daf None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:34.600780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:34.630426 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902de7a-8d97-4537-a1fc-c35d22f37a31 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:34.669132 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bb44e-d65b-4629-9b62-30a48ea1e2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:34.669132 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bb44e-d65b-4629-9b62-30a48ea1e2ac None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:34.669132 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bb44e-d65b-4629-9b62-30a48ea1e2ac None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:34.669132 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bb44e-d65b-4629-9b62-30a48ea1e2ac None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:34.669542 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bb44e-d65b-4629-9b62-30a48ea1e2ac None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:34.669542 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bb44e-d65b-4629-9b62-30a48ea1e2ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:34.670016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bb44e-d65b-4629-9b62-30a48ea1e2ac None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:34.678763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 36/76] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:30:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:34.684982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bb44e-d65b-4629-9b62-30a48ea1e2ac None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:34.702365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dd6d5-63f8-4d06-a725-044f30ae7daf None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:34.740647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2386b28-1555-4006-b1d8-0053d7b2c0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:34.741518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2386b28-1555-4006-b1d8-0053d7b2c0bb None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:34.741624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2386b28-1555-4006-b1d8-0053d7b2c0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:34.741868 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2386b28-1555-4006-b1d8-0053d7b2c0bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:34.753608 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2386b28-1555-4006-b1d8-0053d7b2c0bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:34.758744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-c2386b28-1555-4006-b1d8-0053d7b2c0bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:30:34.758744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:34.758744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:34.758744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:34.758744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:34.758744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:34.758744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:34.758744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:34.758744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:34.758744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:34.758744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:34.758744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:34.758744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:34.758744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:34.758744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:34.758744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:34.759598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:34.759598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:34.759598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:34.759598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:34.759598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:34.759598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:34.759598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:34.759598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:34.759598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:34.759598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:34.759598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:34.759598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:34.759598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:34.759598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:34.759598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:34.759598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:34.760748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:34.760748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:34.760748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:34.760748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:34.760748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:34.760748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:34.760748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:34.760748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:34.760748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:34.760748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:34.760748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:30:34.760748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:30:34.760748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 41/77] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:30:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:34.760748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2386b28-1555-4006-b1d8-0053d7b2c0bb None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:34.811606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bb44e-d65b-4629-9b62-30a48ea1e2ac None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:34.828677 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:34.847967 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:34.849346 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345b060-fa5a-4e55-9aae-d93785d92b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:34.850040 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345b060-fa5a-4e55-9aae-d93785d92b8b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:34.850188 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345b060-fa5a-4e55-9aae-d93785d92b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:34.850487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345b060-fa5a-4e55-9aae-d93785d92b8b None admin] PATH_INFO: `/v3/users/bdfcc581c0884ebba7a2c2ed953e039a` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:34.851759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345b060-fa5a-4e55-9aae-d93785d92b8b None admin] RBAC: Authorizing `identity:get_user(user_id=bdfcc581c0884ebba7a2c2ed953e039a)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:34.853816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345b060-fa5a-4e55-9aae-d93785d92b8b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:34.855411 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 37/78] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:34 2022] GET /identity/v3/users/bdfcc581c0884ebba7a2c2ed953e039a => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:34.856354 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345b060-fa5a-4e55-9aae-d93785d92b8b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:34.875806 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2386b28-1555-4006-b1d8-0053d7b2c0bb None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:34.914008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a51853-ba2a-495a-baf8-f8d07f36b050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:34.914652 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a51853-ba2a-495a-baf8-f8d07f36b050 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:34.914934 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a51853-ba2a-495a-baf8-f8d07f36b050 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:34.915960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a51853-ba2a-495a-baf8-f8d07f36b050 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:34.917135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a51853-ba2a-495a-baf8-f8d07f36b050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:34.918569 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a51853-ba2a-495a-baf8-f8d07f36b050 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:34.920140 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 42/79] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:30:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:34.920907 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a51853-ba2a-495a-baf8-f8d07f36b050 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:34.965578 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345b060-fa5a-4e55-9aae-d93785d92b8b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:35.003828 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa18d71-feb7-4a07-87a9-24ef67d987fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:35.004486 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa18d71-feb7-4a07-87a9-24ef67d987fc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:35.004776 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa18d71-feb7-4a07-87a9-24ef67d987fc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:35.005060 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa18d71-feb7-4a07-87a9-24ef67d987fc None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:35.005763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa18d71-feb7-4a07-87a9-24ef67d987fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:35.006072 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa18d71-feb7-4a07-87a9-24ef67d987fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:35.007450 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa18d71-feb7-4a07-87a9-24ef67d987fc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:35.018537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 38/80] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:30:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:35.019366 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa18d71-feb7-4a07-87a9-24ef67d987fc None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:35.043841 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a51853-ba2a-495a-baf8-f8d07f36b050 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:35.077332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:35.080244 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99567f-504d-440c-a9e7-04b898f2435f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:35.080888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99567f-504d-440c-a9e7-04b898f2435f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:35.081196 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99567f-504d-440c-a9e7-04b898f2435f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:35.081513 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99567f-504d-440c-a9e7-04b898f2435f None admin] PATH_INFO: `/v3/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:35.100119 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99567f-504d-440c-a9e7-04b898f2435f None admin] RBAC: Authorizing `identity:get_user(user_id=95fe5fa6bbd741e3ae8e9bdeafe3d64c)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:35.104234 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99567f-504d-440c-a9e7-04b898f2435f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:35.105889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 43/81] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:34 2022] GET /identity/v3/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:35.106683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99567f-504d-440c-a9e7-04b898f2435f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:35.111411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:35.142894 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa18d71-feb7-4a07-87a9-24ef67d987fc None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:35.177043 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b1927-4126-4d43-810e-7fd69c1f9b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:35.177819 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b1927-4126-4d43-810e-7fd69c1f9b53 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:35.178107 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b1927-4126-4d43-810e-7fd69c1f9b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:35.178711 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b1927-4126-4d43-810e-7fd69c1f9b53 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:35.179385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b1927-4126-4d43-810e-7fd69c1f9b53 None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:35.179698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b1927-4126-4d43-810e-7fd69c1f9b53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:35.181122 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b1927-4126-4d43-810e-7fd69c1f9b53 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:35.189765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 39/82] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:30:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:35.190665 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b1927-4126-4d43-810e-7fd69c1f9b53 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:35.224011 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99567f-504d-440c-a9e7-04b898f2435f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:35.267160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34a7b5-3d92-41e5-b9f1-33243878a92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:35.267879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34a7b5-3d92-41e5-b9f1-33243878a92e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:35.268221 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34a7b5-3d92-41e5-b9f1-33243878a92e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:35.268498 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34a7b5-3d92-41e5-b9f1-33243878a92e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:35.307095 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b1927-4126-4d43-810e-7fd69c1f9b53 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:35.316618 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:35.347118 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b73b66-f007-4dd9-a0c7-ed8baa7038e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:35.347252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34a7b5-3d92-41e5-b9f1-33243878a92e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:35.347729 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b73b66-f007-4dd9-a0c7-ed8baa7038e4 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:35.348011 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b73b66-f007-4dd9-a0c7-ed8baa7038e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:35.348285 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b73b66-f007-4dd9-a0c7-ed8baa7038e4 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:35.348735 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34a7b5-3d92-41e5-b9f1-33243878a92e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:35.348937 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b73b66-f007-4dd9-a0c7-ed8baa7038e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:35.350406 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b73b66-f007-4dd9-a0c7-ed8baa7038e4 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:35.350716 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:35.393488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 40/83] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 15 00:30:35 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:30:35.394473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b73b66-f007-4dd9-a0c7-ed8baa7038e4 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:35.478469 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 44/84] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:30:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:30:35.479532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34a7b5-3d92-41e5-b9f1-33243878a92e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:35.558029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b73b66-f007-4dd9-a0c7-ed8baa7038e4 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:35.610519 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354bc533-711d-4d52-af76-c28c9ce6abff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:35.612059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bc533-711d-4d52-af76-c28c9ce6abff None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:35.612059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bc533-711d-4d52-af76-c28c9ce6abff None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:35.612059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bc533-711d-4d52-af76-c28c9ce6abff None admin] PATH_INFO: `/v3/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:35.613854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354bc533-711d-4d52-af76-c28c9ce6abff None admin] RBAC: Authorizing `identity:get_user(user_id=95fe5fa6bbd741e3ae8e9bdeafe3d64c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:35.614637 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34a7b5-3d92-41e5-b9f1-33243878a92e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:35.615339 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354bc533-711d-4d52-af76-c28c9ce6abff None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:35.616297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:35.618271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 41/85] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:35 2022] GET /identity/v3/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:35.619477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354bc533-711d-4d52-af76-c28c9ce6abff None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:35.682071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5191b-ea26-4c67-a33b-073474bc1378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:35.682071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5191b-ea26-4c67-a33b-073474bc1378 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:35.682071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5191b-ea26-4c67-a33b-073474bc1378 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:35.682071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5191b-ea26-4c67-a33b-073474bc1378 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:35.698003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:35.785294 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354bc533-711d-4d52-af76-c28c9ce6abff None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:35.788948 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5191b-ea26-4c67-a33b-073474bc1378 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:35.791503 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5191b-ea26-4c67-a33b-073474bc1378 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:35.845110 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d5fd6-358b-4434-9fff-6464d06fa67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:35.845110 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d5fd6-358b-4434-9fff-6464d06fa67c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:35.845381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d5fd6-358b-4434-9fff-6464d06fa67c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:35.845450 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d5fd6-358b-4434-9fff-6464d06fa67c None admin] PATH_INFO: `/v3/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:35.849107 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d5fd6-358b-4434-9fff-6464d06fa67c None admin] RBAC: Authorizing `identity:get_user(user_id=95fe5fa6bbd741e3ae8e9bdeafe3d64c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:35.851030 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d5fd6-358b-4434-9fff-6464d06fa67c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:35.851030 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 42/86] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:35 2022] GET /identity/v3/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c => generated 275 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:35.856151 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d5fd6-358b-4434-9fff-6464d06fa67c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:35.969889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 45/87] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:30:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:30:35.977109 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5191b-ea26-4c67-a33b-073474bc1378 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:35.981541 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:36.036397 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:36.041206 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d5fd6-358b-4434-9fff-6464d06fa67c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:36.090176 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56021f4a-96f3-4bc2-9d3b-40c97975b932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:36.090976 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56021f4a-96f3-4bc2-9d3b-40c97975b932 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:36.091349 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56021f4a-96f3-4bc2-9d3b-40c97975b932 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:36.091720 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56021f4a-96f3-4bc2-9d3b-40c97975b932 None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:36.092943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56021f4a-96f3-4bc2-9d3b-40c97975b932 None admin] RBAC: Authorizing `identity:get_project(project_id=313898e8c5c24ba6860f81e2bba41fb6)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:36.094666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56021f4a-96f3-4bc2-9d3b-40c97975b932 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:36.096844 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 43/88] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:30:35 2022] GET /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:36.097722 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56021f4a-96f3-4bc2-9d3b-40c97975b932 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:36.207980 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56021f4a-96f3-4bc2-9d3b-40c97975b932 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:36.261439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f410a71-2672-432a-b358-5882c91d42f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:36.262712 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f410a71-2672-432a-b358-5882c91d42f3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:36.263327 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f410a71-2672-432a-b358-5882c91d42f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:36.263841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f410a71-2672-432a-b358-5882c91d42f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:36.306358 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5191b-ea26-4c67-a33b-073474bc1378 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:36.355238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:36.380896 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e4ef8-3d6b-472c-8e16-95ab63d9219b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:36.385116 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e4ef8-3d6b-472c-8e16-95ab63d9219b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:36.385116 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e4ef8-3d6b-472c-8e16-95ab63d9219b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:36.386157 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e4ef8-3d6b-472c-8e16-95ab63d9219b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:36.492355 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f410a71-2672-432a-b358-5882c91d42f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:36.498696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f410a71-2672-432a-b358-5882c91d42f3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:36.685109 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e4ef8-3d6b-472c-8e16-95ab63d9219b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:36.693107 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e4ef8-3d6b-472c-8e16-95ab63d9219b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:36.701112 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:36.839375 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 44/89] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:30:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 742 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:30:36.843428 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f410a71-2672-432a-b358-5882c91d42f3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:36.898721 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 46/90] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:30:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 928 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:30:36.900213 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e4ef8-3d6b-472c-8e16-95ab63d9219b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:36.920156 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:37.005188 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f410a71-2672-432a-b358-5882c91d42f3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:37.009110 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e4ef8-3d6b-472c-8e16-95ab63d9219b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:37.009110 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:37.051356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce271d-a688-4013-9ee9-d681b263e609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:37.051977 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce271d-a688-4013-9ee9-d681b263e609 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:37.052260 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce271d-a688-4013-9ee9-d681b263e609 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:37.052529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce271d-a688-4013-9ee9-d681b263e609 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:37.053287 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce271d-a688-4013-9ee9-d681b263e609 None admin] RBAC: Adding query filter params (role.id=0ee2daa9cb3c41fb901603e3d8caf784, scope.project.id=313898e8c5c24ba6860f81e2bba41fb6, user.id=bdfcc581c0884ebba7a2c2ed953e039a) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:37.053596 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce271d-a688-4013-9ee9-d681b263e609 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:37.056508 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce271d-a688-4013-9ee9-d681b263e609 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:37.068165 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 47/91] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:30:36 2022] GET /identity/v3/role_assignments?user.id=bdfcc581c0884ebba7a2c2ed953e039a&scope.project.id=313898e8c5c24ba6860f81e2bba41fb6&role.id=0ee2daa9cb3c41fb901603e3d8caf784 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:37.068961 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce271d-a688-4013-9ee9-d681b263e609 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:37.069114 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc2d0a-be64-4e05-b741-0dc46b6b6763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:37.069643 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc2d0a-be64-4e05-b741-0dc46b6b6763 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:37.069924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc2d0a-be64-4e05-b741-0dc46b6b6763 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:37.070194 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc2d0a-be64-4e05-b741-0dc46b6b6763 None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:37.071909 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc2d0a-be64-4e05-b741-0dc46b6b6763 None admin] RBAC: Authorizing `identity:get_project(project_id=313898e8c5c24ba6860f81e2bba41fb6)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:37.073441 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc2d0a-be64-4e05-b741-0dc46b6b6763 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:37.075416 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 45/92] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:30:36 2022] GET /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:37.075962 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc2d0a-be64-4e05-b741-0dc46b6b6763 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:37.194583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce271d-a688-4013-9ee9-d681b263e609 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:37.244240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a739e9-cf7d-44de-8df9-a50c3babe93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:37.244903 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a739e9-cf7d-44de-8df9-a50c3babe93c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:37.245216 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a739e9-cf7d-44de-8df9-a50c3babe93c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:37.245492 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a739e9-cf7d-44de-8df9-a50c3babe93c None admin] PATH_INFO: `/v3/projects/cc8d1c7260494154a66e1f9288dc540c` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:37.248000 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a739e9-cf7d-44de-8df9-a50c3babe93c None admin] RBAC: Authorizing `identity:get_project(project_id=cc8d1c7260494154a66e1f9288dc540c)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:37.249505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a739e9-cf7d-44de-8df9-a50c3babe93c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:37.251652 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 48/93] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:30:37 2022] GET /identity/v3/projects/cc8d1c7260494154a66e1f9288dc540c => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:37.251975 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a739e9-cf7d-44de-8df9-a50c3babe93c None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:37.316907 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:37.318267 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc2d0a-be64-4e05-b741-0dc46b6b6763 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:37.378155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010d507-ad2b-4329-af86-171f113b3384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:37.378800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010d507-ad2b-4329-af86-171f113b3384 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:37.379081 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010d507-ad2b-4329-af86-171f113b3384 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:37.379353 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010d507-ad2b-4329-af86-171f113b3384 None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:37.381371 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010d507-ad2b-4329-af86-171f113b3384 None admin] RBAC: Authorizing `identity:get_project(project_id=313898e8c5c24ba6860f81e2bba41fb6)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:37.382833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010d507-ad2b-4329-af86-171f113b3384 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:37.384505 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 46/94] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:30:37 2022] GET /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6 => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:37.385297 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010d507-ad2b-4329-af86-171f113b3384 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:37.397030 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:37.435445 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a739e9-cf7d-44de-8df9-a50c3babe93c None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:37.499225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367499e9-7c29-470f-bbe1-ad96d79e27fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:37.499843 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367499e9-7c29-470f-bbe1-ad96d79e27fd None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:37.500126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367499e9-7c29-470f-bbe1-ad96d79e27fd None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:37.500400 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367499e9-7c29-470f-bbe1-ad96d79e27fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:37.501163 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367499e9-7c29-470f-bbe1-ad96d79e27fd None admin] RBAC: Adding query filter params (role.id=24171c44541e4c4782ec7d3f03b50467, scope.project.id=313898e8c5c24ba6860f81e2bba41fb6, user.id=95fe5fa6bbd741e3ae8e9bdeafe3d64c) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:37.501479 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367499e9-7c29-470f-bbe1-ad96d79e27fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:37.505000 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367499e9-7c29-470f-bbe1-ad96d79e27fd None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:37.519080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 49/95] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:30:37 2022] GET /identity/v3/role_assignments?user.id=95fe5fa6bbd741e3ae8e9bdeafe3d64c&scope.project.id=313898e8c5c24ba6860f81e2bba41fb6&role.id=24171c44541e4c4782ec7d3f03b50467 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:37.520322 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367499e9-7c29-470f-bbe1-ad96d79e27fd None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:37.581621 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010d507-ad2b-4329-af86-171f113b3384 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:37.647123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1db465-bb3c-484a-810c-9aa4dd16dc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:37.648187 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1db465-bb3c-484a-810c-9aa4dd16dc60 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:37.648616 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1db465-bb3c-484a-810c-9aa4dd16dc60 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:37.649032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1db465-bb3c-484a-810c-9aa4dd16dc60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:37.651142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1db465-bb3c-484a-810c-9aa4dd16dc60 None admin] RBAC: Adding query filter params (role.id=24171c44541e4c4782ec7d3f03b50467, scope.project.id=cc8d1c7260494154a66e1f9288dc540c, user.id=95fe5fa6bbd741e3ae8e9bdeafe3d64c) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:37.651634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1db465-bb3c-484a-810c-9aa4dd16dc60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:37.653445 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1db465-bb3c-484a-810c-9aa4dd16dc60 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:37.665869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 47/96] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:30:37 2022] GET /identity/v3/role_assignments?user.id=95fe5fa6bbd741e3ae8e9bdeafe3d64c&scope.project.id=cc8d1c7260494154a66e1f9288dc540c&role.id=24171c44541e4c4782ec7d3f03b50467 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:37.757060 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:37.761545 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367499e9-7c29-470f-bbe1-ad96d79e27fd None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:37.828460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffcb11-6f1c-4471-9710-fa11cfe6eda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:37.829137 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffcb11-6f1c-4471-9710-fa11cfe6eda1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:37.829427 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffcb11-6f1c-4471-9710-fa11cfe6eda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:37.829705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffcb11-6f1c-4471-9710-fa11cfe6eda1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:37.830473 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffcb11-6f1c-4471-9710-fa11cfe6eda1 None admin] RBAC: Adding query filter params (role.id=1c9b176504fd4d24b34942f724e63acf, scope.project.id=313898e8c5c24ba6860f81e2bba41fb6, user.id=95fe5fa6bbd741e3ae8e9bdeafe3d64c) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:37.830792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffcb11-6f1c-4471-9710-fa11cfe6eda1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:37.832370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffcb11-6f1c-4471-9710-fa11cfe6eda1 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:37.842263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 50/97] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:30:37 2022] GET /identity/v3/role_assignments?user.id=95fe5fa6bbd741e3ae8e9bdeafe3d64c&scope.project.id=313898e8c5c24ba6860f81e2bba41fb6&role.id=1c9b176504fd4d24b34942f724e63acf => generated 259 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:38.027516 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a67fbf-e634-4993-a608-8de00b790097 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:38.027516 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a67fbf-e634-4993-a608-8de00b790097 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:38.027516 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a67fbf-e634-4993-a608-8de00b790097 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:38.027516 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 48/98] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:38.033218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d25b8c-9278-472a-bf0c-93ffef45857d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:38.033744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d25b8c-9278-472a-bf0c-93ffef45857d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:38.034289 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d25b8c-9278-472a-bf0c-93ffef45857d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:38.056454 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b1d25b8c-9278-472a-bf0c-93ffef45857d None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:38.057974 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b1d25b8c-9278-472a-bf0c-93ffef45857d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:38.076822 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe8287-a205-4530-af1e-5e0b57ae15de None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:38.077423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe8287-a205-4530-af1e-5e0b57ae15de None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:38.077891 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe8287-a205-4530-af1e-5e0b57ae15de None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:38.079430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 49/99] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:30:38.085127 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd8b23-db7d-49c5-ad13-7d86a5f95296 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:38.085659 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd8b23-db7d-49c5-ad13-7d86a5f95296 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:38.086088 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd8b23-db7d-49c5-ad13-7d86a5f95296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:38.117687 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-75dd8b23-db7d-49c5-ad13-7d86a5f95296 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:38.120907 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-75dd8b23-db7d-49c5-ad13-7d86a5f95296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:38.215114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 51/100] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:38.255722 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:38.267191 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 50/101] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:30:38.632119 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d25b8c-9278-472a-bf0c-93ffef45857d None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:38.694991 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd8b23-db7d-49c5-ad13-7d86a5f95296 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:38.801116 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:38.828388 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d25b8c-9278-472a-bf0c-93ffef45857d None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:38.851627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd8b23-db7d-49c5-ad13-7d86a5f95296 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:38.891821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ca8b6-cf2a-4049-883d-52cba0f3ceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:38.892817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ca8b6-cf2a-4049-883d-52cba0f3ceb1 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:38.893303 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ca8b6-cf2a-4049-883d-52cba0f3ceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:38.893749 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ca8b6-cf2a-4049-883d-52cba0f3ceb1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:38.895028 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ca8b6-cf2a-4049-883d-52cba0f3ceb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:38.896667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ca8b6-cf2a-4049-883d-52cba0f3ceb1 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:38.898440 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 51/102] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:30:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:30:38.901777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417d6fd-97ba-48ac-a366-ee3cc35619af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:38.902608 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417d6fd-97ba-48ac-a366-ee3cc35619af None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:38.903076 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417d6fd-97ba-48ac-a366-ee3cc35619af None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:38.903567 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417d6fd-97ba-48ac-a366-ee3cc35619af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:38.904993 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ca8b6-cf2a-4049-883d-52cba0f3ceb1 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:38.926941 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417d6fd-97ba-48ac-a366-ee3cc35619af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:38.934332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-b417d6fd-97ba-48ac-a366-ee3cc35619af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 00:30:38.934332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:38.934332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:38.934332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:38.934332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:38.934332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:38.934332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:38.934332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:38.934332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:38.934332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:38.934332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:38.934332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:38.934332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:38.934332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:38.934332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:38.934332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:38.935191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:38.935191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:38.935191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:38.935191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:38.935191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:38.935191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:38.935191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:38.935191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:38.935191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:38.935191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:38.935191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:38.935191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:38.935191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:38.935191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:38.935191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:38.935191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:38.935942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:38.935942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:38.935942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:38.935942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:38.935942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:38.935942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:38.935942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:38.935942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:38.935942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:38.935942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:38.935942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 00:30:38.935942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:30:38.942763 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 52/103] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:30:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:38.951713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417d6fd-97ba-48ac-a366-ee3cc35619af None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:39.018573 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:39.085305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ca8b6-cf2a-4049-883d-52cba0f3ceb1 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:39.152975 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c937c-99cb-4a39-8c5b-8de741084252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:39.153845 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c937c-99cb-4a39-8c5b-8de741084252 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:39.154269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c937c-99cb-4a39-8c5b-8de741084252 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:39.154684 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c937c-99cb-4a39-8c5b-8de741084252 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:39.155475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c937c-99cb-4a39-8c5b-8de741084252 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:39.157077 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c937c-99cb-4a39-8c5b-8de741084252 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:39.199269 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417d6fd-97ba-48ac-a366-ee3cc35619af None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:39.209596 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 52/104] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 15 00:30:38 2022] POST /identity/v3/projects => generated 302 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:30:39.268405 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52188de6-ce11-4390-814c-234589586ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:39.269301 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52188de6-ce11-4390-814c-234589586ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:39.269731 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52188de6-ce11-4390-814c-234589586ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:39.270176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52188de6-ce11-4390-814c-234589586ba8 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:39.270991 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52188de6-ce11-4390-814c-234589586ba8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:39.271445 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52188de6-ce11-4390-814c-234589586ba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:39.272965 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52188de6-ce11-4390-814c-234589586ba8 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:39.295374 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 53/105] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:30:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:39.301303 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c937c-99cb-4a39-8c5b-8de741084252 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:39.469291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c937c-99cb-4a39-8c5b-8de741084252 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:39.488127 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:39.509428 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed2039-d7ee-40dd-87d1-d5311c7ed7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:39.510073 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed2039-d7ee-40dd-87d1-d5311c7ed7ee None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:39.510404 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed2039-d7ee-40dd-87d1-d5311c7ed7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:39.510683 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed2039-d7ee-40dd-87d1-d5311c7ed7ee None admin] PATH_INFO: `/v3/users/8d01565c1ae94eaf9d33aed394f0f814` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:39.524489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed2039-d7ee-40dd-87d1-d5311c7ed7ee None admin] RBAC: Authorizing `identity:get_user(user_id=8d01565c1ae94eaf9d33aed394f0f814)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:39.526066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed2039-d7ee-40dd-87d1-d5311c7ed7ee None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:39.528019 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 53/106] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:39 2022] GET /identity/v3/users/8d01565c1ae94eaf9d33aed394f0f814 => generated 289 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:39.533246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52188de6-ce11-4390-814c-234589586ba8 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:39.549533 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:39.655290 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52188de6-ce11-4390-814c-234589586ba8 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:39.701839 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d4a57-3c3a-4cff-9077-f3e34b8ff829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:39.702546 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d4a57-3c3a-4cff-9077-f3e34b8ff829 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:39.702972 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d4a57-3c3a-4cff-9077-f3e34b8ff829 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:39.703260 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d4a57-3c3a-4cff-9077-f3e34b8ff829 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:39.791999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d4a57-3c3a-4cff-9077-f3e34b8ff829 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:39.793475 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d4a57-3c3a-4cff-9077-f3e34b8ff829 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:39.810341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:39.925828 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 54/107] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:30:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 00:30:39.932257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed2039-d7ee-40dd-87d1-d5311c7ed7ee None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:39.995596 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a8a3a-b07c-48e8-aaa2-b79bd94adf28 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:39.995906 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a8a3a-b07c-48e8-aaa2-b79bd94adf28 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:39.996152 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a8a3a-b07c-48e8-aaa2-b79bd94adf28 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:39.997975 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 55/108] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:30:40.010645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aff0b4-e881-4616-877d-c350da733de8 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:40.010988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aff0b4-e881-4616-877d-c350da733de8 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:40.011222 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aff0b4-e881-4616-877d-c350da733de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:40.041991 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-17aff0b4-e881-4616-877d-c350da733de8 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:40.043259 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-17aff0b4-e881-4616-877d-c350da733de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:40.100597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed2039-d7ee-40dd-87d1-d5311c7ed7ee None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:40.172399 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703eb1d-4344-4b88-b46d-21fb4d9af104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:40.175158 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703eb1d-4344-4b88-b46d-21fb4d9af104 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:40.175436 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703eb1d-4344-4b88-b46d-21fb4d9af104 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:40.175714 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703eb1d-4344-4b88-b46d-21fb4d9af104 None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:40.177541 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 56/109] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:30:40.178190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703eb1d-4344-4b88-b46d-21fb4d9af104 None admin] RBAC: Authorizing `identity:get_project(project_id=313898e8c5c24ba6860f81e2bba41fb6)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:40.179761 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703eb1d-4344-4b88-b46d-21fb4d9af104 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:40.182097 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 54/110] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:30:39 2022] GET /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:40.191088 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aff0b4-e881-4616-877d-c350da733de8 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:40.249847 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:40.323792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aff0b4-e881-4616-877d-c350da733de8 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:40.368203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc65d4-653c-42a8-81ad-a3f7c46d6dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:40.368795 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc65d4-653c-42a8-81ad-a3f7c46d6dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:40.369076 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc65d4-653c-42a8-81ad-a3f7c46d6dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:40.369375 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc65d4-653c-42a8-81ad-a3f7c46d6dc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:40.370103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc65d4-653c-42a8-81ad-a3f7c46d6dc1 None admin] RBAC: Adding query filter params (role.id=995303a8ffbd4ff2a1e28bbd53e9391e, scope.project.id=313898e8c5c24ba6860f81e2bba41fb6, user.id=8d01565c1ae94eaf9d33aed394f0f814) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:40.370411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc65d4-653c-42a8-81ad-a3f7c46d6dc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:40.371839 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc65d4-653c-42a8-81ad-a3f7c46d6dc1 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:40.377745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 57/111] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:30:40 2022] GET /identity/v3/role_assignments?user.id=8d01565c1ae94eaf9d33aed394f0f814&scope.project.id=313898e8c5c24ba6860f81e2bba41fb6&role.id=995303a8ffbd4ff2a1e28bbd53e9391e => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:40.713220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703eb1d-4344-4b88-b46d-21fb4d9af104 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:40.772020 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:40.846888 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703eb1d-4344-4b88-b46d-21fb4d9af104 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:40.889990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283debed-8059-4b66-83d5-aeab918d7bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:40.890631 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283debed-8059-4b66-83d5-aeab918d7bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:40.890915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283debed-8059-4b66-83d5-aeab918d7bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:40.891191 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283debed-8059-4b66-83d5-aeab918d7bc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:40.905535 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283debed-8059-4b66-83d5-aeab918d7bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:40.910906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-283debed-8059-4b66-83d5-aeab918d7bc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:30:40.910906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:40.910906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:40.910906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:40.910906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:40.910906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:40.910906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:40.910906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:40.910906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:40.910906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:40.910906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:40.910906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:40.910906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:40.910906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:40.910906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:40.910906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:40.911753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:40.911753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:40.911753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:40.911753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:40.911753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:40.911753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:40.911753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:40.911753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:40.911753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:40.911753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:40.911753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:40.911753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:40.911753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:40.911753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:40.911753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:40.911753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:40.912517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:40.912517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:40.912517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:40.912517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:40.912517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:40.912517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:40.912517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:40.912517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:40.912517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:40.912517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:40.912517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:30:40.912517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:30:40.912517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 55/112] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:30:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:40.919657 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc65d4-653c-42a8-81ad-a3f7c46d6dc1 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:41.059837 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc65d4-653c-42a8-81ad-a3f7c46d6dc1 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:41.069221 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:41.100251 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19276c-7e8e-46f0-a3c9-9d5420a11f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:41.100867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19276c-7e8e-46f0-a3c9-9d5420a11f25 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:41.101176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19276c-7e8e-46f0-a3c9-9d5420a11f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:41.101453 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19276c-7e8e-46f0-a3c9-9d5420a11f25 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:41.102121 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19276c-7e8e-46f0-a3c9-9d5420a11f25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:41.102429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19276c-7e8e-46f0-a3c9-9d5420a11f25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:41.104397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19276c-7e8e-46f0-a3c9-9d5420a11f25 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:41.113325 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 58/113] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:30:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:41.118758 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283debed-8059-4b66-83d5-aeab918d7bc4 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:41.282768 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5562d98-4903-49f1-ac14-33aa6e404d14 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:41.283077 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5562d98-4903-49f1-ac14-33aa6e404d14 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:41.283329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5562d98-4903-49f1-ac14-33aa6e404d14 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:41.284692 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 59/114] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:30:41.293244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283debed-8059-4b66-83d5-aeab918d7bc4 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:41.298308 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:41.310376 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8de775-2b3b-4937-9878-4174671b44ff None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:41.310632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8de775-2b3b-4937-9878-4174671b44ff None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:41.310862 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8de775-2b3b-4937-9878-4174671b44ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:41.335287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39de233-7ccf-4931-9f51-65f10958df70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:41.335976 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39de233-7ccf-4931-9f51-65f10958df70 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:41.336256 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39de233-7ccf-4931-9f51-65f10958df70 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:41.336532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39de233-7ccf-4931-9f51-65f10958df70 None admin] PATH_INFO: `/v3/users/bdfcc581c0884ebba7a2c2ed953e039a` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:41.340345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39de233-7ccf-4931-9f51-65f10958df70 None admin] RBAC: Authorizing `identity:get_user(user_id=bdfcc581c0884ebba7a2c2ed953e039a)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:41.340345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39de233-7ccf-4931-9f51-65f10958df70 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:41.341930 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 56/115] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:41 2022] GET /identity/v3/users/bdfcc581c0884ebba7a2c2ed953e039a => generated 247 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:41.348027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39de233-7ccf-4931-9f51-65f10958df70 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:41.360889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-1a8de775-2b3b-4937-9878-4174671b44ff None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:41.362486 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1a8de775-2b3b-4937-9878-4174671b44ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:41.438608 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 60/116] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:30:41.440534 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712c865-5b90-4d99-8eaa-b295e838e0c5 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:41.441176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712c865-5b90-4d99-8eaa-b295e838e0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:41.442126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712c865-5b90-4d99-8eaa-b295e838e0c5 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:41.443894 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 61/117] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:41.445618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e025db8-1eb8-45b8-965c-3480128f0d61 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:41.446097 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e025db8-1eb8-45b8-965c-3480128f0d61 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:41.447131 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e025db8-1eb8-45b8-965c-3480128f0d61 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:41.448847 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 62/118] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:41.454480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b69050-9514-492f-8d4c-ead215754861 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:41.455001 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b69050-9514-492f-8d4c-ead215754861 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:41.455467 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b69050-9514-492f-8d4c-ead215754861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:41.493886 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-69b69050-9514-492f-8d4c-ead215754861 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:41.495366 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-69b69050-9514-492f-8d4c-ead215754861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:41.547518 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39de233-7ccf-4931-9f51-65f10958df70 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:41.596990 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 63/119] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:41.598948 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6272a2-a49c-4e8e-9be9-1633e7c3eb19 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:41.599432 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6272a2-a49c-4e8e-9be9-1633e7c3eb19 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:41.599918 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6272a2-a49c-4e8e-9be9-1633e7c3eb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:41.619818 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-9d6272a2-a49c-4e8e-9be9-1633e7c3eb19 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:41.621392 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9d6272a2-a49c-4e8e-9be9-1633e7c3eb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:41.647040 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb4448-c393-4191-9edf-f6d3d03e458d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:41.647450 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb4448-c393-4191-9edf-f6d3d03e458d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:41.647733 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb4448-c393-4191-9edf-f6d3d03e458d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:41.648011 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb4448-c393-4191-9edf-f6d3d03e458d None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:41.653805 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb4448-c393-4191-9edf-f6d3d03e458d None admin] RBAC: Authorizing `identity:get_project(project_id=313898e8c5c24ba6860f81e2bba41fb6)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:41.655262 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb4448-c393-4191-9edf-f6d3d03e458d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:41.657072 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 57/120] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:30:41 2022] GET /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6 => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:41.657470 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:41.666109 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb4448-c393-4191-9edf-f6d3d03e458d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:41.698170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 64/121] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:41.759909 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:41.782921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6272a2-a49c-4e8e-9be9-1633e7c3eb19 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:41.883370 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb4448-c393-4191-9edf-f6d3d03e458d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:41.896391 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6272a2-a49c-4e8e-9be9-1633e7c3eb19 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:41.934830 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794443b8-7628-4dd6-aa47-10b8c37d893e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:41.936692 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794443b8-7628-4dd6-aa47-10b8c37d893e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:41.937199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794443b8-7628-4dd6-aa47-10b8c37d893e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:41.937722 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794443b8-7628-4dd6-aa47-10b8c37d893e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:41.949819 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794443b8-7628-4dd6-aa47-10b8c37d893e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:41.955246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-794443b8-7628-4dd6-aa47-10b8c37d893e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:30:41.955246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:41.955246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:41.955246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:41.955246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:41.955246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:41.955246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:41.955246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:41.955246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:41.955246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:41.955246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:41.955246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:41.955246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:41.955246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:41.955246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:41.955246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:41.956068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:41.956068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:41.956068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:41.956068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:41.956068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:41.956068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:41.956068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:41.956068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:41.956068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:41.956068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:41.956068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:41.956068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:41.956068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:41.956068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:41.956068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:41.956068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:41.956834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:41.956834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:41.956834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:41.956834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:41.956834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:41.956834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:41.956834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:41.956834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:41.956834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:41.956834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:41.956834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:30:41.956834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:30:41.958701 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 65/122] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:30:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:41.965060 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794443b8-7628-4dd6-aa47-10b8c37d893e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:41.989879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c4945-e05e-4ce1-a457-b33eca078310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:41.990573 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c4945-e05e-4ce1-a457-b33eca078310 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:41.990873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c4945-e05e-4ce1-a457-b33eca078310 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:41.991419 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c4945-e05e-4ce1-a457-b33eca078310 None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6/users/bdfcc581c0884ebba7a2c2ed953e039a/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:41.994060 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c4945-e05e-4ce1-a457-b33eca078310 None admin] RBAC: Authorizing `identity:create_grant(project_id=313898e8c5c24ba6860f81e2bba41fb6, user_id=bdfcc581c0884ebba7a2c2ed953e039a, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:41.994716 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:41.996691 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c4945-e05e-4ce1-a457-b33eca078310 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:42.018789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 58/123] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:30:41 2022] PUT /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6/users/bdfcc581c0884ebba7a2c2ed953e039a/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:30:42.019706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c4945-e05e-4ce1-a457-b33eca078310 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:42.083031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794443b8-7628-4dd6-aa47-10b8c37d893e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:42.122874 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b5abe-8f06-4202-bbd3-d8c5f124b335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:42.123841 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b5abe-8f06-4202-bbd3-d8c5f124b335 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:42.124263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b5abe-8f06-4202-bbd3-d8c5f124b335 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:42.124671 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b5abe-8f06-4202-bbd3-d8c5f124b335 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:42.125567 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b5abe-8f06-4202-bbd3-d8c5f124b335 None admin] RBAC: Adding query filter params (name=member) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:42.126293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b5abe-8f06-4202-bbd3-d8c5f124b335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:42.127810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b5abe-8f06-4202-bbd3-d8c5f124b335 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:42.137471 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 66/124] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:30:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:30:42.143309 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b5abe-8f06-4202-bbd3-d8c5f124b335 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:42.207592 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:42.215699 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c4945-e05e-4ce1-a457-b33eca078310 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:42.265817 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b5abe-8f06-4202-bbd3-d8c5f124b335 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:42.269484 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:42.282095 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fae14d-9143-4682-b827-a186ff04bbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:42.282798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fae14d-9143-4682-b827-a186ff04bbfe None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:42.283036 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fae14d-9143-4682-b827-a186ff04bbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:42.283318 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fae14d-9143-4682-b827-a186ff04bbfe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:42.307791 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf5ab5-3bdc-4d6e-9eb1-7ebf0ccb75e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:42.308681 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf5ab5-3bdc-4d6e-9eb1-7ebf0ccb75e2 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:42.309125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf5ab5-3bdc-4d6e-9eb1-7ebf0ccb75e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:42.309762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf5ab5-3bdc-4d6e-9eb1-7ebf0ccb75e2 None admin] PATH_INFO: `/v3/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:42.310145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fae14d-9143-4682-b827-a186ff04bbfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:42.311271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf5ab5-3bdc-4d6e-9eb1-7ebf0ccb75e2 None admin] RBAC: Authorizing `identity:get_user(user_id=95fe5fa6bbd741e3ae8e9bdeafe3d64c)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:42.312988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf5ab5-3bdc-4d6e-9eb1-7ebf0ccb75e2 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:42.315214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 67/125] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:42 2022] GET /identity/v3/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:42.316171 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf5ab5-3bdc-4d6e-9eb1-7ebf0ccb75e2 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:42.322215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-77fae14d-9143-4682-b827-a186ff04bbfe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:30:42.322215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:42.322215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:42.322215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:42.322215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:42.322215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:42.322215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:42.322215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:42.322215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:42.322215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:42.322215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:42.322215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:42.322215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:42.322215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:42.322215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:42.322215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:42.323230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:42.323230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:42.323230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:42.323230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:42.323230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:42.323230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:42.323230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:42.323230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:42.323230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:42.323230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:42.323230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:42.323230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:42.323230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:42.323230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:42.323230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:42.323230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:42.324129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:42.324129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:42.324129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:42.324129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:42.324129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:42.324129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:42.324129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:42.324129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:42.324129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:42.324129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:42.324129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:30:42.324129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:30:42.324129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 59/126] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 15 00:30:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:42.331744 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fae14d-9143-4682-b827-a186ff04bbfe None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:42.430898 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf5ab5-3bdc-4d6e-9eb1-7ebf0ccb75e2 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:42.452963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fae14d-9143-4682-b827-a186ff04bbfe None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:42.467166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d1deb-f215-4e18-819b-ab58d26988e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:42.468013 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d1deb-f215-4e18-819b-ab58d26988e6 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:42.468453 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d1deb-f215-4e18-819b-ab58d26988e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:42.468881 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d1deb-f215-4e18-819b-ab58d26988e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:42.479903 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d1deb-f215-4e18-819b-ab58d26988e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:42.485810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-287d1deb-f215-4e18-819b-ab58d26988e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:30:42.485810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:42.485810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:42.485810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:42.485810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:42.485810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:42.485810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:42.485810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:42.485810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:42.485810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:42.485810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:42.485810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:42.485810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:42.485810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:42.485810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:42.485810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:42.486827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:42.486827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:42.486827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:42.486827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:42.486827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:42.486827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:42.486827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:42.486827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:42.486827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:42.486827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:42.486827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:42.486827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:42.486827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:42.486827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:42.486827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:42.486827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:42.487776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:42.487776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:42.487776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:42.487776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:42.487776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:42.487776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:42.487776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:42.487776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:42.487776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:42.487776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:42.487776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:30:42.487776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:30:42.490290 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 68/127] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:30:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:42.491404 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d1deb-f215-4e18-819b-ab58d26988e6 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:42.491618 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257da1d-c617-457b-a817-f63f10e74923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:42.492320 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257da1d-c617-457b-a817-f63f10e74923 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:42.492692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257da1d-c617-457b-a817-f63f10e74923 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:42.493056 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257da1d-c617-457b-a817-f63f10e74923 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:42.494429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257da1d-c617-457b-a817-f63f10e74923 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:42.494827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257da1d-c617-457b-a817-f63f10e74923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:42.496425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257da1d-c617-457b-a817-f63f10e74923 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:42.505432 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 60/128] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:30:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:42.506650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:42.507530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825f21d-7c55-4d29-b39e-8d8a224ddc4b None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:42.508008 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825f21d-7c55-4d29-b39e-8d8a224ddc4b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:42.508470 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825f21d-7c55-4d29-b39e-8d8a224ddc4b None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:42.510833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 61/129] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:42.516016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825f21d-7c55-4d29-b39e-8d8a224ddc4b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:42.541405 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:42.603572 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d1deb-f215-4e18-819b-ab58d26988e6 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:42.623129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825f21d-7c55-4d29-b39e-8d8a224ddc4b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:42.639986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7d774-444a-41b9-8fa4-4ca4ef90d78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:42.640568 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7d774-444a-41b9-8fa4-4ca4ef90d78a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:42.640858 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7d774-444a-41b9-8fa4-4ca4ef90d78a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:42.641164 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7d774-444a-41b9-8fa4-4ca4ef90d78a None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:42.642292 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7d774-444a-41b9-8fa4-4ca4ef90d78a None admin] RBAC: Authorizing `identity:get_project(project_id=313898e8c5c24ba6860f81e2bba41fb6)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:42.643843 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7d774-444a-41b9-8fa4-4ca4ef90d78a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:42.645560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 69/130] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:30:42 2022] GET /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:42.646321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7d774-444a-41b9-8fa4-4ca4ef90d78a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:42.661491 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36efb0d-c1de-4c1b-ba83-175a390f44de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:42.662421 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36efb0d-c1de-4c1b-ba83-175a390f44de None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:42.662914 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36efb0d-c1de-4c1b-ba83-175a390f44de None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:42.663372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36efb0d-c1de-4c1b-ba83-175a390f44de None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:42.664219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36efb0d-c1de-4c1b-ba83-175a390f44de None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:42.664708 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36efb0d-c1de-4c1b-ba83-175a390f44de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:42.666337 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36efb0d-c1de-4c1b-ba83-175a390f44de None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:42.674751 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 62/131] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:30:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:42.676378 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c82fd4-7773-455e-9b39-9a1b2e7d30de None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:42.676859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c82fd4-7773-455e-9b39-9a1b2e7d30de None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:42.677372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c82fd4-7773-455e-9b39-9a1b2e7d30de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:42.695758 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-14c82fd4-7773-455e-9b39-9a1b2e7d30de None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:42.697844 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-14c82fd4-7773-455e-9b39-9a1b2e7d30de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:42.731140 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:42.755748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7d774-444a-41b9-8fa4-4ca4ef90d78a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:42.768131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 63/132] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:42.774094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c82fd4-7773-455e-9b39-9a1b2e7d30de None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:42.793726 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d468a9-5720-413f-bac9-1b34623615d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:42.794363 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d468a9-5720-413f-bac9-1b34623615d4 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:42.794643 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d468a9-5720-413f-bac9-1b34623615d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:42.794916 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d468a9-5720-413f-bac9-1b34623615d4 None admin] PATH_INFO: `/v3/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:42.797371 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d468a9-5720-413f-bac9-1b34623615d4 None admin] RBAC: Authorizing `identity:get_user(user_id=95fe5fa6bbd741e3ae8e9bdeafe3d64c)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:42.799552 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d468a9-5720-413f-bac9-1b34623615d4 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:42.801141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 70/133] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:42 2022] GET /identity/v3/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:42.802147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d468a9-5720-413f-bac9-1b34623615d4 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:42.806803 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:42.953195 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d468a9-5720-413f-bac9-1b34623615d4 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:42.968915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c82fd4-7773-455e-9b39-9a1b2e7d30de None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:42.985561 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71bf0f-1430-4166-96c9-2a253ba0446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:42.985967 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71bf0f-1430-4166-96c9-2a253ba0446c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:42.986249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71bf0f-1430-4166-96c9-2a253ba0446c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:42.986524 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71bf0f-1430-4166-96c9-2a253ba0446c None admin] PATH_INFO: `/v3/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:42.987652 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71bf0f-1430-4166-96c9-2a253ba0446c None admin] RBAC: Authorizing `identity:get_user(user_id=95fe5fa6bbd741e3ae8e9bdeafe3d64c)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:42.989238 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71bf0f-1430-4166-96c9-2a253ba0446c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:42.990735 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 71/134] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:42 2022] GET /identity/v3/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:42.997111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71bf0f-1430-4166-96c9-2a253ba0446c None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:43.008577 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:43.041805 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9a8d3-35bf-421e-b9a1-f72f907245bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:43.042483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9a8d3-35bf-421e-b9a1-f72f907245bc None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:43.042764 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9a8d3-35bf-421e-b9a1-f72f907245bc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:43.043038 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9a8d3-35bf-421e-b9a1-f72f907245bc None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:43.045007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9a8d3-35bf-421e-b9a1-f72f907245bc None admin] RBAC: Authorizing `identity:create_grant(project_id=313898e8c5c24ba6860f81e2bba41fb6, user_id=95fe5fa6bbd741e3ae8e9bdeafe3d64c, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:43.046489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9a8d3-35bf-421e-b9a1-f72f907245bc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:43.083879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 64/135] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:30:42 2022] PUT /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:30:43.084779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9a8d3-35bf-421e-b9a1-f72f907245bc None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:43.107037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71bf0f-1430-4166-96c9-2a253ba0446c None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:43.146727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e85ff-9114-4cb9-a247-93d5fdb53a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:43.147801 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e85ff-9114-4cb9-a247-93d5fdb53a45 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:43.148294 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e85ff-9114-4cb9-a247-93d5fdb53a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:43.148763 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e85ff-9114-4cb9-a247-93d5fdb53a45 None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:43.150393 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e85ff-9114-4cb9-a247-93d5fdb53a45 None admin] RBAC: Authorizing `identity:get_project(project_id=313898e8c5c24ba6860f81e2bba41fb6)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:43.152117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e85ff-9114-4cb9-a247-93d5fdb53a45 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:43.154174 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 72/136] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:30:42 2022] GET /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:43.162502 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e85ff-9114-4cb9-a247-93d5fdb53a45 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:43.200196 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:43.232124 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9a8d3-35bf-421e-b9a1-f72f907245bc None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:43.256916 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:43.279382 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e85ff-9114-4cb9-a247-93d5fdb53a45 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:43.304822 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b72ac2-f52d-4ff8-8d4c-a84e6922e2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:43.306143 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b72ac2-f52d-4ff8-8d4c-a84e6922e2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:43.306563 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b72ac2-f52d-4ff8-8d4c-a84e6922e2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:43.306826 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b72ac2-f52d-4ff8-8d4c-a84e6922e2b8 None admin] PATH_INFO: `/v3/projects/cc8d1c7260494154a66e1f9288dc540c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:43.308108 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b72ac2-f52d-4ff8-8d4c-a84e6922e2b8 None admin] RBAC: Authorizing `identity:get_project(project_id=cc8d1c7260494154a66e1f9288dc540c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:43.309707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b72ac2-f52d-4ff8-8d4c-a84e6922e2b8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:43.311497 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 65/137] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:30:43 2022] GET /identity/v3/projects/cc8d1c7260494154a66e1f9288dc540c => generated 312 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:43.312357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b72ac2-f52d-4ff8-8d4c-a84e6922e2b8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:43.320099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05053ea4-eea5-4ea4-b3b8-782543f1dbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:43.321140 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05053ea4-eea5-4ea4-b3b8-782543f1dbb7 None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:43.322270 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05053ea4-eea5-4ea4-b3b8-782543f1dbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:43.322794 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05053ea4-eea5-4ea4-b3b8-782543f1dbb7 None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c/roles/1c9b176504fd4d24b34942f724e63acf` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:43.328579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05053ea4-eea5-4ea4-b3b8-782543f1dbb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=313898e8c5c24ba6860f81e2bba41fb6, user_id=95fe5fa6bbd741e3ae8e9bdeafe3d64c, role_id=1c9b176504fd4d24b34942f724e63acf)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:43.330353 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05053ea4-eea5-4ea4-b3b8-782543f1dbb7 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:43.354586 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 73/138] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:30:43 2022] PUT /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c/roles/1c9b176504fd4d24b34942f724e63acf => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:30:43.355737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05053ea4-eea5-4ea4-b3b8-782543f1dbb7 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:43.466029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b72ac2-f52d-4ff8-8d4c-a84e6922e2b8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:43.511635 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9ab05-2bac-4202-9dd2-99235a677c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:43.512478 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9ab05-2bac-4202-9dd2-99235a677c6d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:43.512945 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9ab05-2bac-4202-9dd2-99235a677c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:43.513413 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9ab05-2bac-4202-9dd2-99235a677c6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:43.514792 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9ab05-2bac-4202-9dd2-99235a677c6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:43.515415 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05053ea4-eea5-4ea4-b3b8-782543f1dbb7 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:43.516569 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9ab05-2bac-4202-9dd2-99235a677c6d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:43.519707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 66/139] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:30:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:43.525652 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9ab05-2bac-4202-9dd2-99235a677c6d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:43.543613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:43.557858 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17d1d6-f346-4c04-85c5-81aa9835d4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:43.558826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17d1d6-f346-4c04-85c5-81aa9835d4a4 None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:43.559279 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17d1d6-f346-4c04-85c5-81aa9835d4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:43.559756 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17d1d6-f346-4c04-85c5-81aa9835d4a4 None admin] PATH_INFO: `/v3/projects/cc8d1c7260494154a66e1f9288dc540c/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:43.561974 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17d1d6-f346-4c04-85c5-81aa9835d4a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc8d1c7260494154a66e1f9288dc540c, user_id=95fe5fa6bbd741e3ae8e9bdeafe3d64c, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:43.563634 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17d1d6-f346-4c04-85c5-81aa9835d4a4 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:43.592998 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 74/140] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:30:43 2022] PUT /identity/v3/projects/cc8d1c7260494154a66e1f9288dc540c/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:30:43.642753 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d01a4-1c04-4c8e-9f00-f7f9a28c8f67 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:43.643379 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d01a4-1c04-4c8e-9f00-f7f9a28c8f67 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:43.643879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d01a4-1c04-4c8e-9f00-f7f9a28c8f67 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:43.645654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 75/141] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:30:43.656933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9ab05-2bac-4202-9dd2-99235a677c6d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:43.659165 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70344fcc-7edd-47b6-9aa3-1a2aa317f0be None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:43.659779 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70344fcc-7edd-47b6-9aa3-1a2aa317f0be None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:43.660243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70344fcc-7edd-47b6-9aa3-1a2aa317f0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:43.669052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:43.698165 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-70344fcc-7edd-47b6-9aa3-1a2aa317f0be None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:43.699431 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-70344fcc-7edd-47b6-9aa3-1a2aa317f0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:43.731598 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b3fd7-df56-4d95-b00b-13095957ee1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:43.732219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b3fd7-df56-4d95-b00b-13095957ee1b None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:43.732501 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b3fd7-df56-4d95-b00b-13095957ee1b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:43.732777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b3fd7-df56-4d95-b00b-13095957ee1b None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:43.733753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b3fd7-df56-4d95-b00b-13095957ee1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:43.735228 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b3fd7-df56-4d95-b00b-13095957ee1b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:43.791249 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 67/142] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 15 00:30:43 2022] POST /identity/v3/users => generated 283 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:30:43.816108 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 76/143] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:30:44.174695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b3fd7-df56-4d95-b00b-13095957ee1b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:44.256116 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:44.304701 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b3fd7-df56-4d95-b00b-13095957ee1b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:44.350768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d5ed1-f6d9-4a18-899e-4964861663f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:44.351418 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d5ed1-f6d9-4a18-899e-4964861663f4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:44.351701 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d5ed1-f6d9-4a18-899e-4964861663f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:44.351975 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d5ed1-f6d9-4a18-899e-4964861663f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:44.370700 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d5ed1-f6d9-4a18-899e-4964861663f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:44.376165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-aa6d5ed1-f6d9-4a18-899e-4964861663f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 00:30:44.376165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:44.376165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:44.376165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:44.376165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:44.376165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:44.376165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:44.376165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:44.376165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:44.376165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:44.376165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:44.376165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:44.376165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:44.376165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:44.376165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:44.376165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:44.377029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:44.377029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:44.377029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:44.377029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:44.377029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:44.377029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:44.377029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:44.377029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:44.377029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:44.377029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:44.377029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:44.377029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:44.377029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:44.377029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:44.377029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:44.377029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:44.377841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:44.377841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:44.377841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:44.377841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:44.377841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:44.377841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:44.377841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:44.377841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:44.377841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:44.377841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:44.377841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 00:30:44.377841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:30:44.377841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 68/144] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:30:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:44.383313 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70344fcc-7edd-47b6-9aa3-1a2aa317f0be None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:44.511929 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70344fcc-7edd-47b6-9aa3-1a2aa317f0be None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:44.546122 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:44.551776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11412e05-40f5-438c-9797-f2ca5c5f940e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:44.552407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11412e05-40f5-438c-9797-f2ca5c5f940e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:44.552690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11412e05-40f5-438c-9797-f2ca5c5f940e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:44.556908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11412e05-40f5-438c-9797-f2ca5c5f940e None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:44.557917 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11412e05-40f5-438c-9797-f2ca5c5f940e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:44.558427 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11412e05-40f5-438c-9797-f2ca5c5f940e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:44.559870 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11412e05-40f5-438c-9797-f2ca5c5f940e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:44.569071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 77/145] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:30:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:44.574936 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d5ed1-f6d9-4a18-899e-4964861663f4 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:44.686171 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d5ed1-f6d9-4a18-899e-4964861663f4 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:44.722373 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:44.726211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f886fd-e91b-442b-a76a-e4e1eec24aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:44.726869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f886fd-e91b-442b-a76a-e4e1eec24aeb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:44.727151 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f886fd-e91b-442b-a76a-e4e1eec24aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:44.727501 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f886fd-e91b-442b-a76a-e4e1eec24aeb None admin] PATH_INFO: `/v3/users/8d01565c1ae94eaf9d33aed394f0f814` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:44.729061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f886fd-e91b-442b-a76a-e4e1eec24aeb None admin] RBAC: Authorizing `identity:get_user(user_id=8d01565c1ae94eaf9d33aed394f0f814)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:44.735006 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f886fd-e91b-442b-a76a-e4e1eec24aeb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:44.737002 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 69/146] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:44 2022] GET /identity/v3/users/8d01565c1ae94eaf9d33aed394f0f814 => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:44.742276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11412e05-40f5-438c-9797-f2ca5c5f940e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:44.857611 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11412e05-40f5-438c-9797-f2ca5c5f940e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:44.899047 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35a31c-f89d-4bd8-af00-5466c2bf26cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:44.900232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35a31c-f89d-4bd8-af00-5466c2bf26cc None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:44.900514 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35a31c-f89d-4bd8-af00-5466c2bf26cc None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:44.900790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35a31c-f89d-4bd8-af00-5466c2bf26cc None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:44.902071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35a31c-f89d-4bd8-af00-5466c2bf26cc None admin] RBAC: Authorizing `identity:get_project(project_id=313898e8c5c24ba6860f81e2bba41fb6)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:44.903575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35a31c-f89d-4bd8-af00-5466c2bf26cc None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:44.907565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 78/147] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:30:44 2022] GET /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:44.912992 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f886fd-e91b-442b-a76a-e4e1eec24aeb None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:45.029603 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f886fd-e91b-442b-a76a-e4e1eec24aeb None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:45.068621 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70503785-4fd7-47ac-b860-1983fd1faf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:45.069332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70503785-4fd7-47ac-b860-1983fd1faf19 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:45.069617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70503785-4fd7-47ac-b860-1983fd1faf19 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:45.069892 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70503785-4fd7-47ac-b860-1983fd1faf19 None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6/users/8d01565c1ae94eaf9d33aed394f0f814/roles/995303a8ffbd4ff2a1e28bbd53e9391e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:45.072456 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70503785-4fd7-47ac-b860-1983fd1faf19 None admin] RBAC: Authorizing `identity:create_grant(project_id=313898e8c5c24ba6860f81e2bba41fb6, user_id=8d01565c1ae94eaf9d33aed394f0f814, role_id=995303a8ffbd4ff2a1e28bbd53e9391e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:45.073951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70503785-4fd7-47ac-b860-1983fd1faf19 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:45.094932 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 70/148] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:30:44 2022] PUT /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6/users/8d01565c1ae94eaf9d33aed394f0f814/roles/995303a8ffbd4ff2a1e28bbd53e9391e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:30:45.587397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baca642-b2d3-47a4-b9fd-eb292eae93ca None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:45.587925 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baca642-b2d3-47a4-b9fd-eb292eae93ca None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:45.587925 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baca642-b2d3-47a4-b9fd-eb292eae93ca None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:45.589315 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 79/149] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:45.594859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d10e3-417e-4620-9a51-4432cde68cd0 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:45.595263 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d10e3-417e-4620-9a51-4432cde68cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:45.595352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d10e3-417e-4620-9a51-4432cde68cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:45.617272 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2f7d10e3-417e-4620-9a51-4432cde68cd0 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:45.619016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2f7d10e3-417e-4620-9a51-4432cde68cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:45.673598 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:45.701538 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 71/150] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:46.104484 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baca642-b2d3-47a4-b9fd-eb292eae93ca None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:46.183279 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:46.231804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baca642-b2d3-47a4-b9fd-eb292eae93ca None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:46.270862 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853174f-dfb3-4340-ba23-7bfce04b2810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:46.271832 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853174f-dfb3-4340-ba23-7bfce04b2810 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:46.272321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853174f-dfb3-4340-ba23-7bfce04b2810 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:46.272816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853174f-dfb3-4340-ba23-7bfce04b2810 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:46.283697 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1853174f-dfb3-4340-ba23-7bfce04b2810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:46.289288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-1853174f-dfb3-4340-ba23-7bfce04b2810 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:30:46.289288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:46.289288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:46.289288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:46.289288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:46.289288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:46.289288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:46.289288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:46.289288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:46.289288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:46.289288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:46.289288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:46.289288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:46.289288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:46.289288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:46.289288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:46.290214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:46.290214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:46.290214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:46.290214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:46.290214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:46.290214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:46.290214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:46.290214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:46.290214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:46.290214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:46.290214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:46.290214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:46.290214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:46.290214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:46.290214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:46.290214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:46.290983 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:46.290983 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:46.290983 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:46.290983 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:46.290983 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:46.290983 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:46.290983 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:46.290983 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:46.290983 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:46.290983 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:46.290983 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:30:46.290983 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:30:46.293283 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 80/151] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:30:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:46.302341 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d10e3-417e-4620-9a51-4432cde68cd0 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:46.438208 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d10e3-417e-4620-9a51-4432cde68cd0 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:46.474696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca79949-a7eb-4543-871e-229b57ebac14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:46.475639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca79949-a7eb-4543-871e-229b57ebac14 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:46.476153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca79949-a7eb-4543-871e-229b57ebac14 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:46.476649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca79949-a7eb-4543-871e-229b57ebac14 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:46.477676 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca79949-a7eb-4543-871e-229b57ebac14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:46.478179 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca79949-a7eb-4543-871e-229b57ebac14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:46.479747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca79949-a7eb-4543-871e-229b57ebac14 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:46.491254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 72/152] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:30:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:46.497603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853174f-dfb3-4340-ba23-7bfce04b2810 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:46.617723 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853174f-dfb3-4340-ba23-7bfce04b2810 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:46.644161 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:46.661755 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158acfef-4d41-44c1-bfd8-6aae73a19a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:46.662765 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158acfef-4d41-44c1-bfd8-6aae73a19a69 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:46.663256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158acfef-4d41-44c1-bfd8-6aae73a19a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:46.663738 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158acfef-4d41-44c1-bfd8-6aae73a19a69 None admin] PATH_INFO: `/v3/users/bdfcc581c0884ebba7a2c2ed953e039a` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:46.669859 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158acfef-4d41-44c1-bfd8-6aae73a19a69 None admin] RBAC: Authorizing `identity:get_user(user_id=bdfcc581c0884ebba7a2c2ed953e039a)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:46.671553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158acfef-4d41-44c1-bfd8-6aae73a19a69 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:46.673408 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 81/153] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:46 2022] GET /identity/v3/users/bdfcc581c0884ebba7a2c2ed953e039a => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:46.679034 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca79949-a7eb-4543-871e-229b57ebac14 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:46.732781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:46.796206 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca79949-a7eb-4543-871e-229b57ebac14 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:46.837059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1e7e5-e7a0-419f-8b32-af8581cfa64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:46.838049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1e7e5-e7a0-419f-8b32-af8581cfa64f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:46.838534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1e7e5-e7a0-419f-8b32-af8581cfa64f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:46.839012 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1e7e5-e7a0-419f-8b32-af8581cfa64f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:46.915720 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1e7e5-e7a0-419f-8b32-af8581cfa64f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:46.917587 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1e7e5-e7a0-419f-8b32-af8581cfa64f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:46.972938 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:47.032846 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 73/154] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:30:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:30:47.038819 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158acfef-4d41-44c1-bfd8-6aae73a19a69 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:47.164874 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158acfef-4d41-44c1-bfd8-6aae73a19a69 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:47.204468 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a414be-2a1a-43ca-b686-2cbe8af66bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:47.205157 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a414be-2a1a-43ca-b686-2cbe8af66bfb None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:47.205438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a414be-2a1a-43ca-b686-2cbe8af66bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:47.205709 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a414be-2a1a-43ca-b686-2cbe8af66bfb None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:47.206993 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a414be-2a1a-43ca-b686-2cbe8af66bfb None admin] RBAC: Authorizing `identity:get_project(project_id=313898e8c5c24ba6860f81e2bba41fb6)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:47.208540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a414be-2a1a-43ca-b686-2cbe8af66bfb None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:47.210342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 82/155] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:30:47 2022] GET /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:30:47.217127 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1e7e5-e7a0-419f-8b32-af8581cfa64f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:47.342684 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1e7e5-e7a0-419f-8b32-af8581cfa64f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:47.394871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941f3c3-367d-4c8c-8995-bfe3f2bb3d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:47.395473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941f3c3-367d-4c8c-8995-bfe3f2bb3d2d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:47.395749 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941f3c3-367d-4c8c-8995-bfe3f2bb3d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:47.396019 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941f3c3-367d-4c8c-8995-bfe3f2bb3d2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:47.396745 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941f3c3-367d-4c8c-8995-bfe3f2bb3d2d None admin] RBAC: Adding query filter params (role.id=0ee2daa9cb3c41fb901603e3d8caf784, scope.project.id=313898e8c5c24ba6860f81e2bba41fb6, user.id=bdfcc581c0884ebba7a2c2ed953e039a) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:47.397047 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941f3c3-367d-4c8c-8995-bfe3f2bb3d2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:47.398505 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941f3c3-367d-4c8c-8995-bfe3f2bb3d2d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:47.405319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 74/156] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:30:47 2022] GET /identity/v3/role_assignments?user.id=bdfcc581c0884ebba7a2c2ed953e039a&scope.project.id=313898e8c5c24ba6860f81e2bba41fb6&role.id=0ee2daa9cb3c41fb901603e3d8caf784 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:30:47.461034 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ac43b-7858-4a6e-8cfb-ab8a1267802b None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:47.461374 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ac43b-7858-4a6e-8cfb-ab8a1267802b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:47.461610 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ac43b-7858-4a6e-8cfb-ab8a1267802b None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:47.463772 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 83/157] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:47.466610 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52be40-3d58-4c59-99cf-62db29ea8f72 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:47.466892 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52be40-3d58-4c59-99cf-62db29ea8f72 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:47.467160 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52be40-3d58-4c59-99cf-62db29ea8f72 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:47.468487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 75/158] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:47.473148 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5803b23-b387-4312-87a8-20fb9ccded9e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:47.473430 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5803b23-b387-4312-87a8-20fb9ccded9e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:47.473700 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5803b23-b387-4312-87a8-20fb9ccded9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:47.478938 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e76504-1d08-41db-a0f6-dd2a0400cb19 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:47.479204 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e76504-1d08-41db-a0f6-dd2a0400cb19 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:47.479466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e76504-1d08-41db-a0f6-dd2a0400cb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:47.514536 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f5803b23-b387-4312-87a8-20fb9ccded9e None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:47.518123 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f5803b23-b387-4312-87a8-20fb9ccded9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:47.532158 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f6e76504-1d08-41db-a0f6-dd2a0400cb19 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:47.533472 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f6e76504-1d08-41db-a0f6-dd2a0400cb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:47.539154 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:47.657665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:47.695945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 84/159] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:30:47.700872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f15b7-48bd-479a-ba3d-d6fc269c0499 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:47.701174 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f15b7-48bd-479a-ba3d-d6fc269c0499 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:47.701443 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f15b7-48bd-479a-ba3d-d6fc269c0499 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:47.702711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 85/160] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:47.708182 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d36a9e-e46f-4ff7-a657-9a96226a4912 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:47.708461 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d36a9e-e46f-4ff7-a657-9a96226a4912 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:47.708732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d36a9e-e46f-4ff7-a657-9a96226a4912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:47.717838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 76/161] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:47.742094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-c5d36a9e-e46f-4ff7-a657-9a96226a4912 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:47.743819 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c5d36a9e-e46f-4ff7-a657-9a96226a4912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:47.841314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 86/162] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:30:48.172235 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e76504-1d08-41db-a0f6-dd2a0400cb19 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:48.210566 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d36a9e-e46f-4ff7-a657-9a96226a4912 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:48.299246 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e76504-1d08-41db-a0f6-dd2a0400cb19 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:48.366269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b0d8f-b91b-4bc6-8610-d945fd1411f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:48.368422 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b0d8f-b91b-4bc6-8610-d945fd1411f4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:48.368995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b0d8f-b91b-4bc6-8610-d945fd1411f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:48.369863 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b0d8f-b91b-4bc6-8610-d945fd1411f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:48.387876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:48.392978 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b0d8f-b91b-4bc6-8610-d945fd1411f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:48.398162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-cc4b0d8f-b91b-4bc6-8610-d945fd1411f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:30:48.398162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:48.398162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:48.398162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:48.398162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:48.398162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:48.398162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:48.398162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:48.398162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:48.398162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:48.398162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:48.398162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:48.398162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:48.398162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:48.398162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:48.398162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:48.399433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:48.399433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:48.399433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:48.399433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:48.399433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:48.399433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:48.399433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:48.399433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:48.399433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:48.399433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:48.399433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:48.399433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:48.399433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:48.399433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:48.399433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:48.399433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:48.400981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:48.400981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:48.400981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:48.400981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:48.400981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:48.400981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:48.400981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:48.400981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:48.400981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:48.400981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:48.400981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:30:48.400981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:30:48.411890 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 77/163] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:30:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:48.412983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b0d8f-b91b-4bc6-8610-d945fd1411f4 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:48.440102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d36a9e-e46f-4ff7-a657-9a96226a4912 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:48.478879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:48.513935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd3c33-ec0f-443b-9466-b5ebd86e41ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:48.514852 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd3c33-ec0f-443b-9466-b5ebd86e41ee None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:48.515350 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd3c33-ec0f-443b-9466-b5ebd86e41ee None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:48.515759 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd3c33-ec0f-443b-9466-b5ebd86e41ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:48.535744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd3c33-ec0f-443b-9466-b5ebd86e41ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:48.541075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-3fcd3c33-ec0f-443b-9466-b5ebd86e41ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:30:48.541075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:48.541075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:48.541075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:48.541075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:48.541075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:48.541075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:48.541075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:48.541075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:48.541075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:48.541075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:48.541075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:48.541075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:48.541075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:48.541075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:48.541075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:48.541939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:48.541939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:48.541939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:48.541939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:48.541939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:48.541939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:48.541939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:48.541939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:48.541939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:48.541939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:48.541939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:48.541939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:48.541939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:48.541939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:48.541939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:48.541939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:48.542713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:48.542713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:48.542713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:48.542713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:48.542713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:48.542713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:48.542713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:48.542713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:48.542713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:48.542713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:48.542713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:30:48.542713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:30:48.545351 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 87/164] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:30:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:48.546311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd3c33-ec0f-443b-9466-b5ebd86e41ee None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:48.641891 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b0d8f-b91b-4bc6-8610-d945fd1411f4 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:48.654053 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd3c33-ec0f-443b-9466-b5ebd86e41ee None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:48.691560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa156be-1dcc-4171-9d3a-abf245b1bb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:48.692949 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa156be-1dcc-4171-9d3a-abf245b1bb89 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:48.693552 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa156be-1dcc-4171-9d3a-abf245b1bb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:48.693994 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa156be-1dcc-4171-9d3a-abf245b1bb89 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:48.694828 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa156be-1dcc-4171-9d3a-abf245b1bb89 None admin] RBAC: Adding query filter params (name=member) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:48.695325 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa156be-1dcc-4171-9d3a-abf245b1bb89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:48.697659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa156be-1dcc-4171-9d3a-abf245b1bb89 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:48.706705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 88/165] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:30:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:48.708643 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c77c9-9e04-4565-9d15-2c0340b33f21 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:48.709161 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c77c9-9e04-4565-9d15-2c0340b33f21 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:48.709607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c77c9-9e04-4565-9d15-2c0340b33f21 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:48.711004 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 89/166] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:48.711930 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c77c9-9e04-4565-9d15-2c0340b33f21 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:48.769450 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:48.773808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf3152-872b-4217-9661-916d0cfe0bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:48.774483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf3152-872b-4217-9661-916d0cfe0bce None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:48.774770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf3152-872b-4217-9661-916d0cfe0bce None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:48.775105 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf3152-872b-4217-9661-916d0cfe0bce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:48.812090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf3152-872b-4217-9661-916d0cfe0bce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:48.817910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-9fcf3152-872b-4217-9661-916d0cfe0bce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:30:48.817910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:48.817910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:48.817910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:48.817910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:48.817910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:48.817910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:48.817910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:48.817910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:48.817910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:48.817910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:48.817910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:48.817910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:48.817910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:48.817910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:48.817910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:48.818800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:48.818800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:48.818800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:48.818800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:48.818800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:48.818800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:48.818800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:48.818800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:48.818800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:48.818800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:48.818800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:48.818800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:48.818800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:48.818800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:48.818800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:48.818800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:48.819559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:48.819559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:48.819559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:48.819559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:48.819559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:48.819559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:48.819559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:48.819559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:48.819559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:48.819559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:48.819559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:30:48.819559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:30:48.822512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 78/167] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 15 00:30:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:48.823503 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf3152-872b-4217-9661-916d0cfe0bce None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:48.844677 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c77c9-9e04-4565-9d15-2c0340b33f21 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:48.915427 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9176820-0a5f-4e41-8b56-ecb1eeba024b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:48.916044 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9176820-0a5f-4e41-8b56-ecb1eeba024b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:48.916329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9176820-0a5f-4e41-8b56-ecb1eeba024b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:48.916603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9176820-0a5f-4e41-8b56-ecb1eeba024b None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:48.917298 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9176820-0a5f-4e41-8b56-ecb1eeba024b None admin] RBAC: Adding query filter params (name=member) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:48.917603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9176820-0a5f-4e41-8b56-ecb1eeba024b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:48.918982 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9176820-0a5f-4e41-8b56-ecb1eeba024b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:48.935707 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 90/168] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:30:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:48.937312 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c4389-b2ca-4f7d-8537-ae982e363e9b None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:48.937768 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c4389-b2ca-4f7d-8537-ae982e363e9b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:48.938208 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c4389-b2ca-4f7d-8537-ae982e363e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:48.959532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:48.974190 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-d03c4389-b2ca-4f7d-8537-ae982e363e9b None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:48.975406 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d03c4389-b2ca-4f7d-8537-ae982e363e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:49.028593 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf3152-872b-4217-9661-916d0cfe0bce None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:49.065956 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 91/169] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:49.066801 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c4389-b2ca-4f7d-8537-ae982e363e9b None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:49.088809 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193ff36-8b56-4ee7-ab26-377c0faec3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:49.089926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193ff36-8b56-4ee7-ab26-377c0faec3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:49.090412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193ff36-8b56-4ee7-ab26-377c0faec3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:49.090880 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193ff36-8b56-4ee7-ab26-377c0faec3f6 None admin] PATH_INFO: `/v3/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:49.094233 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193ff36-8b56-4ee7-ab26-377c0faec3f6 None admin] RBAC: Authorizing `identity:get_user(user_id=95fe5fa6bbd741e3ae8e9bdeafe3d64c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:49.098340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193ff36-8b56-4ee7-ab26-377c0faec3f6 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:49.101841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 79/170] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:48 2022] GET /identity/v3/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:49.105247 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193ff36-8b56-4ee7-ab26-377c0faec3f6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:49.129458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:49.207272 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c4389-b2ca-4f7d-8537-ae982e363e9b None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:49.246256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7740ce3-3dbd-41a2-baff-063f957222d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:49.246800 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740ce3-3dbd-41a2-baff-063f957222d9 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:49.247085 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740ce3-3dbd-41a2-baff-063f957222d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:49.247419 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740ce3-3dbd-41a2-baff-063f957222d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:49.248211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7740ce3-3dbd-41a2-baff-063f957222d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:49.248556 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7740ce3-3dbd-41a2-baff-063f957222d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:49.250241 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7740ce3-3dbd-41a2-baff-063f957222d9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:49.260969 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 92/171] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:30:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:49.262164 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8db87e-4239-4efc-a9b7-cf35a862d1db None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:49.262452 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8db87e-4239-4efc-a9b7-cf35a862d1db None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:49.268292 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8db87e-4239-4efc-a9b7-cf35a862d1db None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:49.268292 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 93/172] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:49.268292 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8db87e-4239-4efc-a9b7-cf35a862d1db None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:49.331125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193ff36-8b56-4ee7-ab26-377c0faec3f6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:49.371311 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:49.379320 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70300215-7f09-4893-8d50-4d591b80dbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:49.379997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70300215-7f09-4893-8d50-4d591b80dbee None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:49.380281 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70300215-7f09-4893-8d50-4d591b80dbee None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:49.380618 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70300215-7f09-4893-8d50-4d591b80dbee None admin] PATH_INFO: `/v3/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:49.381908 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70300215-7f09-4893-8d50-4d591b80dbee None admin] RBAC: Authorizing `identity:get_user(user_id=95fe5fa6bbd741e3ae8e9bdeafe3d64c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:49.383666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70300215-7f09-4893-8d50-4d591b80dbee None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:49.386084 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 80/173] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:49 2022] GET /identity/v3/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:49.386875 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70300215-7f09-4893-8d50-4d591b80dbee None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:49.409849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:49.419706 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8db87e-4239-4efc-a9b7-cf35a862d1db None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:49.463673 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b5f56-e324-4b35-8181-b40c57c7b291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:49.463673 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b5f56-e324-4b35-8181-b40c57c7b291 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:49.463970 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b5f56-e324-4b35-8181-b40c57c7b291 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:49.464195 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b5f56-e324-4b35-8181-b40c57c7b291 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:49.495212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70300215-7f09-4893-8d50-4d591b80dbee None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:49.531266 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770c242-87b7-4717-a981-d804d8bb6cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:49.531812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770c242-87b7-4717-a981-d804d8bb6cfd None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:49.532089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770c242-87b7-4717-a981-d804d8bb6cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:49.532369 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770c242-87b7-4717-a981-d804d8bb6cfd None admin] PATH_INFO: `/v3/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:49.533530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770c242-87b7-4717-a981-d804d8bb6cfd None admin] RBAC: Authorizing `identity:get_user(user_id=95fe5fa6bbd741e3ae8e9bdeafe3d64c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:49.534976 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770c242-87b7-4717-a981-d804d8bb6cfd None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:49.535996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b5f56-e324-4b35-8181-b40c57c7b291 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:49.536555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 81/174] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:49 2022] GET /identity/v3/users/95fe5fa6bbd741e3ae8e9bdeafe3d64c => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:49.537826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b5f56-e324-4b35-8181-b40c57c7b291 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:49.538158 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d4ab9-3b68-436d-9ffe-eabb376d46f3 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:49.538441 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d4ab9-3b68-436d-9ffe-eabb376d46f3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:49.538711 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d4ab9-3b68-436d-9ffe-eabb376d46f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:49.556540 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f12d4ab9-3b68-436d-9ffe-eabb376d46f3 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:49.557736 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f12d4ab9-3b68-436d-9ffe-eabb376d46f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:49.615125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:49.624218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 82/175] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:49.625007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d4ab9-3b68-436d-9ffe-eabb376d46f3 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:49.631528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:49.641448 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 94/176] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:30:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:30:49.642110 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b5f56-e324-4b35-8181-b40c57c7b291 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:49.731552 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d4ab9-3b68-436d-9ffe-eabb376d46f3 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:49.743987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b5f56-e324-4b35-8181-b40c57c7b291 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:49.769307 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe84d1-9afa-43e0-9014-afd3510a698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:49.770025 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe84d1-9afa-43e0-9014-afd3510a698e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:49.770307 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe84d1-9afa-43e0-9014-afd3510a698e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:49.770581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe84d1-9afa-43e0-9014-afd3510a698e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:49.781880 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda13f8-08d4-455e-86b9-fde3a8bf821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:49.782415 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda13f8-08d4-455e-86b9-fde3a8bf821d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:49.782689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda13f8-08d4-455e-86b9-fde3a8bf821d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:49.782873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe84d1-9afa-43e0-9014-afd3510a698e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:49.783285 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda13f8-08d4-455e-86b9-fde3a8bf821d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:49.788254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-6efe84d1-9afa-43e0-9014-afd3510a698e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:30:49.788254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:49.788254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:49.788254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:49.788254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:49.788254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:49.788254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:49.788254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:49.788254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:49.788254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:49.788254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:49.788254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:49.788254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:49.788254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:49.788254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:49.788254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:49.789144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:49.789144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:49.789144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:49.789144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:49.789144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:49.789144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:49.789144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:49.789144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:49.789144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:49.789144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:49.789144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:49.789144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:49.789144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:49.789144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:49.789144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:49.789144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:49.795682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:49.795682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:49.795682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:49.795682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:49.795682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:49.795682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:49.795682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:49.795682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:49.795682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:49.795682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:49.795682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:30:49.795682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:30:49.795682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 83/177] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:30:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:49.795682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878112e5-db6f-4391-9777-7587e7d0cbcc None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:49.797135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878112e5-db6f-4391-9777-7587e7d0cbcc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:49.797135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878112e5-db6f-4391-9777-7587e7d0cbcc None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:49.797135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 84/178] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:49.797135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9980a17-014e-49f7-9d49-3063f9cd7686 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:49.797135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9980a17-014e-49f7-9d49-3063f9cd7686 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:49.797135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9980a17-014e-49f7-9d49-3063f9cd7686 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:49.797135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 85/179] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:49.797562 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9980a17-014e-49f7-9d49-3063f9cd7686 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:49.856600 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:49.860946 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:49.869395 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda13f8-08d4-455e-86b9-fde3a8bf821d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:49.870859 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda13f8-08d4-455e-86b9-fde3a8bf821d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:49.907803 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9980a17-014e-49f7-9d49-3063f9cd7686 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:49.940545 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940fc10-098f-4d9c-b4c0-0d29b5c6a6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:49.941164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940fc10-098f-4d9c-b4c0-0d29b5c6a6db None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:49.941441 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940fc10-098f-4d9c-b4c0-0d29b5c6a6db None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:49.941708 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940fc10-098f-4d9c-b4c0-0d29b5c6a6db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:49.970568 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 95/180] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:30:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:30:49.971241 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda13f8-08d4-455e-86b9-fde3a8bf821d None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:50.012854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940fc10-098f-4d9c-b4c0-0d29b5c6a6db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:50.014659 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940fc10-098f-4d9c-b4c0-0d29b5c6a6db None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:50.067615 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:50.073909 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:50.075347 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda13f8-08d4-455e-86b9-fde3a8bf821d None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:50.109026 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90903252-e152-4408-b023-46ea2a1da321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:50.109682 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90903252-e152-4408-b023-46ea2a1da321 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:50.109956 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90903252-e152-4408-b023-46ea2a1da321 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:50.110232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90903252-e152-4408-b023-46ea2a1da321 None admin] PATH_INFO: `/v3/projects/cc8d1c7260494154a66e1f9288dc540c` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:50.111332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90903252-e152-4408-b023-46ea2a1da321 None admin] RBAC: Authorizing `identity:get_project(project_id=cc8d1c7260494154a66e1f9288dc540c)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:50.112747 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90903252-e152-4408-b023-46ea2a1da321 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:50.114387 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 96/181] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:30:49 2022] GET /identity/v3/projects/cc8d1c7260494154a66e1f9288dc540c => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:50.115134 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90903252-e152-4408-b023-46ea2a1da321 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:50.123762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 86/182] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:30:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:30:50.124984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5e3a6-d8b3-4e25-8442-cd531e9e6829 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:50.125290 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5e3a6-d8b3-4e25-8442-cd531e9e6829 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:50.125563 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5e3a6-d8b3-4e25-8442-cd531e9e6829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:50.143139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d9f5e3a6-d8b3-4e25-8442-cd531e9e6829 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:50.144323 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d9f5e3a6-d8b3-4e25-8442-cd531e9e6829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:50.208273 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 87/183] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:50.210414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44517d7-5195-4ef1-b6c8-8d4564ef1351 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:50.210879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44517d7-5195-4ef1-b6c8-8d4564ef1351 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:50.211154 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44517d7-5195-4ef1-b6c8-8d4564ef1351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:50.214050 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90903252-e152-4408-b023-46ea2a1da321 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:50.228178 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e44517d7-5195-4ef1-b6c8-8d4564ef1351 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:50.229374 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e44517d7-5195-4ef1-b6c8-8d4564ef1351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:50.250945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6dce9-9adf-4ff4-8671-4c646ecc516d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:50.251548 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6dce9-9adf-4ff4-8671-4c646ecc516d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:50.251827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6dce9-9adf-4ff4-8671-4c646ecc516d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:50.252094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6dce9-9adf-4ff4-8671-4c646ecc516d None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:50.252750 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6dce9-9adf-4ff4-8671-4c646ecc516d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:50.253053 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6dce9-9adf-4ff4-8671-4c646ecc516d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:50.254429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6dce9-9adf-4ff4-8671-4c646ecc516d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:50.268219 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 97/184] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:30:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:50.268219 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6dce9-9adf-4ff4-8671-4c646ecc516d None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:50.293524 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:50.301309 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 88/185] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:50.302140 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44517d7-5195-4ef1-b6c8-8d4564ef1351 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:50.318506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:50.392331 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6dce9-9adf-4ff4-8671-4c646ecc516d None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:50.421479 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44517d7-5195-4ef1-b6c8-8d4564ef1351 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:50.432205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b7fb4-6f83-4e2c-b1b8-5c2327c7337a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:50.433119 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b7fb4-6f83-4e2c-b1b8-5c2327c7337a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:50.433606 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b7fb4-6f83-4e2c-b1b8-5c2327c7337a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:50.434079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b7fb4-6f83-4e2c-b1b8-5c2327c7337a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:50.445585 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b7fb4-6f83-4e2c-b1b8-5c2327c7337a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:50.452071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-214b7fb4-6f83-4e2c-b1b8-5c2327c7337a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:30:50.452071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:50.452071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:50.452071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:50.452071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:50.452071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:50.452071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:50.452071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:50.452071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:50.452071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:50.452071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:50.452071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:50.452071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:50.452071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:50.452071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:50.452071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:50.452938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:50.452938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:50.452938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:50.452938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:50.452938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:50.452938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:50.452938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:50.452938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:50.452938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:50.452938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:50.452938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:50.452938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:50.452938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:50.452938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:50.452938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:50.452938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:50.453771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:50.453771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:50.453771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:50.453771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:50.453771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:50.453771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:50.453771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:50.453771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:50.453771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:50.453771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:50.453771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:30:50.453771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:30:50.453771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 98/186] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 15 00:30:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:50.454502 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b7fb4-6f83-4e2c-b1b8-5c2327c7337a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:50.469172 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8838151-5909-4eb6-84e1-f239b0393e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:50.469956 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8838151-5909-4eb6-84e1-f239b0393e6d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:50.470242 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8838151-5909-4eb6-84e1-f239b0393e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:50.470515 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8838151-5909-4eb6-84e1-f239b0393e6d None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:50.471792 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8838151-5909-4eb6-84e1-f239b0393e6d None admin] RBAC: Authorizing `identity:get_project(project_id=313898e8c5c24ba6860f81e2bba41fb6)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:50.473491 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8838151-5909-4eb6-84e1-f239b0393e6d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:50.475449 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 89/187] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:30:50 2022] GET /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:50.476112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8838151-5909-4eb6-84e1-f239b0393e6d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:50.545302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:50.562859 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b7fb4-6f83-4e2c-b1b8-5c2327c7337a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:50.568363 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:50.588401 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8838151-5909-4eb6-84e1-f239b0393e6d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:50.598985 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952500b5-a38a-471b-a0c4-659e02979607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:50.599593 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952500b5-a38a-471b-a0c4-659e02979607 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:50.599878 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952500b5-a38a-471b-a0c4-659e02979607 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:50.600153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952500b5-a38a-471b-a0c4-659e02979607 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:50.600879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952500b5-a38a-471b-a0c4-659e02979607 None admin] RBAC: Adding query filter params (role.id=24171c44541e4c4782ec7d3f03b50467, scope.project.id=cc8d1c7260494154a66e1f9288dc540c, user.id=95fe5fa6bbd741e3ae8e9bdeafe3d64c) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:50.601398 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952500b5-a38a-471b-a0c4-659e02979607 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:50.603382 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952500b5-a38a-471b-a0c4-659e02979607 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:50.609386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 99/188] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:30:50 2022] GET /identity/v3/role_assignments?user.id=95fe5fa6bbd741e3ae8e9bdeafe3d64c&scope.project.id=cc8d1c7260494154a66e1f9288dc540c&role.id=24171c44541e4c4782ec7d3f03b50467 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:50.610218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952500b5-a38a-471b-a0c4-659e02979607 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:50.625486 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b296d7-576a-44f7-9b2b-712e38d5207a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:50.626451 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b296d7-576a-44f7-9b2b-712e38d5207a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:50.626906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b296d7-576a-44f7-9b2b-712e38d5207a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:50.627192 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b296d7-576a-44f7-9b2b-712e38d5207a None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:50.628457 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b296d7-576a-44f7-9b2b-712e38d5207a None admin] RBAC: Authorizing `identity:get_project(project_id=313898e8c5c24ba6860f81e2bba41fb6)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:50.630013 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b296d7-576a-44f7-9b2b-712e38d5207a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:50.631763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 90/189] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:30:50 2022] GET /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:50.632585 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b296d7-576a-44f7-9b2b-712e38d5207a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:50.749340 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952500b5-a38a-471b-a0c4-659e02979607 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:50.754128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b296d7-576a-44f7-9b2b-712e38d5207a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:50.789700 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c7eaa-36a2-4ad9-af4e-35a3b2115dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:50.790976 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c7eaa-36a2-4ad9-af4e-35a3b2115dba None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:50.791256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c7eaa-36a2-4ad9-af4e-35a3b2115dba None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:50.791526 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c7eaa-36a2-4ad9-af4e-35a3b2115dba None admin] PATH_INFO: `/v3/users/f0ec0b529deb49969d2ea90c07f4a7ad` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:50.794878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c83d5-8e8f-4c3d-a746-cfc2ad8996a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:50.795621 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c83d5-8e8f-4c3d-a746-cfc2ad8996a5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:50.795967 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c83d5-8e8f-4c3d-a746-cfc2ad8996a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:50.796306 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c83d5-8e8f-4c3d-a746-cfc2ad8996a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:50.797056 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c83d5-8e8f-4c3d-a746-cfc2ad8996a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:50.797452 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c83d5-8e8f-4c3d-a746-cfc2ad8996a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:50.798850 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c83d5-8e8f-4c3d-a746-cfc2ad8996a5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:50.808358 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c7eaa-36a2-4ad9-af4e-35a3b2115dba None admin] RBAC: Authorizing `identity:get_user(user_id=f0ec0b529deb49969d2ea90c07f4a7ad)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:50.808663 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 91/190] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:30:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:50.811784 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c7eaa-36a2-4ad9-af4e-35a3b2115dba None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:50.811784 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 100/191] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:50 2022] GET /identity/v3/users/f0ec0b529deb49969d2ea90c07f4a7ad => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:50.812345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c7eaa-36a2-4ad9-af4e-35a3b2115dba None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:50.813050 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c83d5-8e8f-4c3d-a746-cfc2ad8996a5 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:50.824447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:50.832489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:50.920098 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c7eaa-36a2-4ad9-af4e-35a3b2115dba None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:50.922392 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c83d5-8e8f-4c3d-a746-cfc2ad8996a5 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:50.952863 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392d456-71dc-498c-8e29-4e56c9fb2d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:50.953490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392d456-71dc-498c-8e29-4e56c9fb2d2e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:50.953776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392d456-71dc-498c-8e29-4e56c9fb2d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:50.954046 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392d456-71dc-498c-8e29-4e56c9fb2d2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:50.954436 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165651c7-9288-465a-88dd-89952f38d6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:50.954756 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392d456-71dc-498c-8e29-4e56c9fb2d2e None admin] RBAC: Adding query filter params (role.id=24171c44541e4c4782ec7d3f03b50467, scope.project.id=313898e8c5c24ba6860f81e2bba41fb6, user.id=95fe5fa6bbd741e3ae8e9bdeafe3d64c) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:50.955053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165651c7-9288-465a-88dd-89952f38d6cb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:50.955139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392d456-71dc-498c-8e29-4e56c9fb2d2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:50.955332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165651c7-9288-465a-88dd-89952f38d6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:50.955603 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165651c7-9288-465a-88dd-89952f38d6cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:50.956463 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392d456-71dc-498c-8e29-4e56c9fb2d2e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:50.956698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165651c7-9288-465a-88dd-89952f38d6cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:50.958174 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165651c7-9288-465a-88dd-89952f38d6cb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:50.959887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 92/192] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:30:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:50.960478 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165651c7-9288-465a-88dd-89952f38d6cb None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:50.962850 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 101/193] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:30:50 2022] GET /identity/v3/role_assignments?user.id=95fe5fa6bbd741e3ae8e9bdeafe3d64c&scope.project.id=313898e8c5c24ba6860f81e2bba41fb6&role.id=24171c44541e4c4782ec7d3f03b50467 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:50.963618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392d456-71dc-498c-8e29-4e56c9fb2d2e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:51.045867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:51.056062 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:51.078860 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165651c7-9288-465a-88dd-89952f38d6cb None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:51.081868 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392d456-71dc-498c-8e29-4e56c9fb2d2e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:51.116919 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea31f26-e0ab-442d-b0ca-d9269300a64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:51.117680 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea31f26-e0ab-442d-b0ca-d9269300a64c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:51.118034 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea31f26-e0ab-442d-b0ca-d9269300a64c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:51.118504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea31f26-e0ab-442d-b0ca-d9269300a64c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:51.119902 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505de56a-be58-46ca-981b-8159ad2d3143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:51.120529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505de56a-be58-46ca-981b-8159ad2d3143 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:51.120810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505de56a-be58-46ca-981b-8159ad2d3143 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:51.121108 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505de56a-be58-46ca-981b-8159ad2d3143 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:51.121851 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505de56a-be58-46ca-981b-8159ad2d3143 None admin] RBAC: Adding query filter params (role.id=1c9b176504fd4d24b34942f724e63acf, scope.project.id=313898e8c5c24ba6860f81e2bba41fb6, user.id=95fe5fa6bbd741e3ae8e9bdeafe3d64c) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:51.122160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505de56a-be58-46ca-981b-8159ad2d3143 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:51.123628 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505de56a-be58-46ca-981b-8159ad2d3143 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:51.130554 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 102/194] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:30:50 2022] GET /identity/v3/role_assignments?user.id=95fe5fa6bbd741e3ae8e9bdeafe3d64c&scope.project.id=313898e8c5c24ba6860f81e2bba41fb6&role.id=1c9b176504fd4d24b34942f724e63acf => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:51.131322 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505de56a-be58-46ca-981b-8159ad2d3143 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:51.138330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea31f26-e0ab-442d-b0ca-d9269300a64c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:51.145475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-eea31f26-e0ab-442d-b0ca-d9269300a64c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 00:30:51.145475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:51.145475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:51.145475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:51.145475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:51.145475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:51.145475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:51.145475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:51.145475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:51.145475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:51.145475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:51.145475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:51.145475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:51.145475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:51.145475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:51.145475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:51.146429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:51.146429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:51.146429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:51.146429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:51.146429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:51.146429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:51.146429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:51.146429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:51.146429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:51.146429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:51.146429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:51.146429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:51.146429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:51.146429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:51.146429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:51.146429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:51.147205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:51.147205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:51.147205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:51.147205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:51.147205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:51.147205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:51.147205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:51.147205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:51.147205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:51.147205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:51.147205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 00:30:51.147205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:30:51.147797 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 93/195] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:30:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:51.150036 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea31f26-e0ab-442d-b0ca-d9269300a64c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:51.271069 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505de56a-be58-46ca-981b-8159ad2d3143 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:51.278178 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea31f26-e0ab-442d-b0ca-d9269300a64c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:51.309721 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09ba6b-9243-4acf-bca7-276ff9487ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:51.310365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ba6b-9243-4acf-bca7-276ff9487ece None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:51.310647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ba6b-9243-4acf-bca7-276ff9487ece None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:51.310919 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ba6b-9243-4acf-bca7-276ff9487ece None admin] PATH_INFO: `/v3/users/f0ec0b529deb49969d2ea90c07f4a7ad` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:51.312064 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09ba6b-9243-4acf-bca7-276ff9487ece None admin] RBAC: Authorizing `identity:get_user(user_id=f0ec0b529deb49969d2ea90c07f4a7ad)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:51.313533 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09ba6b-9243-4acf-bca7-276ff9487ece None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:51.315129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 103/196] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:51 2022] GET /identity/v3/users/f0ec0b529deb49969d2ea90c07f4a7ad => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:51.315953 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09ba6b-9243-4acf-bca7-276ff9487ece None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:51.323937 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:51.329453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5369c71-df88-4ef2-9bb3-f8e104c93956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:51.330288 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5369c71-df88-4ef2-9bb3-f8e104c93956 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:51.330790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5369c71-df88-4ef2-9bb3-f8e104c93956 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:51.331245 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5369c71-df88-4ef2-9bb3-f8e104c93956 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:51.343728 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:51.410373 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5369c71-df88-4ef2-9bb3-f8e104c93956 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:51.411847 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5369c71-df88-4ef2-9bb3-f8e104c93956 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:51.442001 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09ba6b-9243-4acf-bca7-276ff9487ece None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:51.475384 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10580c-1f4a-4fdf-92fa-cdefdd7be1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:51.475986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10580c-1f4a-4fdf-92fa-cdefdd7be1a3 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:51.476267 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10580c-1f4a-4fdf-92fa-cdefdd7be1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:51.476540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10580c-1f4a-4fdf-92fa-cdefdd7be1a3 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:51.477218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10580c-1f4a-4fdf-92fa-cdefdd7be1a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:51.478652 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10580c-1f4a-4fdf-92fa-cdefdd7be1a3 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:51.505656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 104/197] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 15 00:30:51 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:30:51.506471 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10580c-1f4a-4fdf-92fa-cdefdd7be1a3 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:51.522753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 94/198] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:30:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:30:51.523785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5369c71-df88-4ef2-9bb3-f8e104c93956 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:51.575336 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:51.581011 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:51.630826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10580c-1f4a-4fdf-92fa-cdefdd7be1a3 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:51.645652 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5369c71-df88-4ef2-9bb3-f8e104c93956 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:51.672372 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86655af5-4b27-4b70-a241-bf9206df08a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:51.672990 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86655af5-4b27-4b70-a241-bf9206df08a1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:51.673297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86655af5-4b27-4b70-a241-bf9206df08a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:51.673572 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86655af5-4b27-4b70-a241-bf9206df08a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:51.674239 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86655af5-4b27-4b70-a241-bf9206df08a1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:51.674539 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86655af5-4b27-4b70-a241-bf9206df08a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:51.676132 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86655af5-4b27-4b70-a241-bf9206df08a1 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:51.686067 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 105/199] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:30:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:51.686962 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86655af5-4b27-4b70-a241-bf9206df08a1 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:51.689691 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af8ef0-8524-44cd-8a83-fd4fd41b419e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:51.691312 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af8ef0-8524-44cd-8a83-fd4fd41b419e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:51.691586 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af8ef0-8524-44cd-8a83-fd4fd41b419e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:51.692576 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af8ef0-8524-44cd-8a83-fd4fd41b419e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:51.782339 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af8ef0-8524-44cd-8a83-fd4fd41b419e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:51.783768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af8ef0-8524-44cd-8a83-fd4fd41b419e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:51.806870 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86655af5-4b27-4b70-a241-bf9206df08a1 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:51.829571 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:51.838248 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:51.850563 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab61fa-eeb3-4947-afcc-a2ea95191fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:51.851198 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab61fa-eeb3-4947-afcc-a2ea95191fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:51.851474 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab61fa-eeb3-4947-afcc-a2ea95191fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:51.853718 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab61fa-eeb3-4947-afcc-a2ea95191fd6 None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:51.853823 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab61fa-eeb3-4947-afcc-a2ea95191fd6 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc5711794744f1c9ccc1b886cc1a21b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:51.855314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab61fa-eeb3-4947-afcc-a2ea95191fd6 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:51.857238 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 106/200] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:30:51 2022] GET /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:51.858035 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab61fa-eeb3-4947-afcc-a2ea95191fd6 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:51.913074 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 95/201] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:30:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:30:51.914293 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af8ef0-8524-44cd-8a83-fd4fd41b419e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:51.988733 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab61fa-eeb3-4947-afcc-a2ea95191fd6 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:52.023830 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af8ef0-8524-44cd-8a83-fd4fd41b419e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:52.033656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72355923-c64a-42e0-b52d-73d9dc2e940e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:52.034218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72355923-c64a-42e0-b52d-73d9dc2e940e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:52.034497 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72355923-c64a-42e0-b52d-73d9dc2e940e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:52.034767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72355923-c64a-42e0-b52d-73d9dc2e940e None admin] PATH_INFO: `/v3/users/8d01565c1ae94eaf9d33aed394f0f814` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:52.036274 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72355923-c64a-42e0-b52d-73d9dc2e940e None admin] RBAC: Authorizing `identity:get_user(user_id=8d01565c1ae94eaf9d33aed394f0f814)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:52.038300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72355923-c64a-42e0-b52d-73d9dc2e940e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:52.040578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 107/202] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:51 2022] GET /identity/v3/users/8d01565c1ae94eaf9d33aed394f0f814 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:52.041757 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72355923-c64a-42e0-b52d-73d9dc2e940e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:52.063185 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb5a5a-06c5-47dd-ad52-4380acf6f9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:52.064296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb5a5a-06c5-47dd-ad52-4380acf6f9fb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:52.064814 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb5a5a-06c5-47dd-ad52-4380acf6f9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:52.065376 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb5a5a-06c5-47dd-ad52-4380acf6f9fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:52.066353 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb5a5a-06c5-47dd-ad52-4380acf6f9fb None admin] RBAC: Adding query filter params (role.id=0ee2daa9cb3c41fb901603e3d8caf784, scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b, user.id=f0ec0b529deb49969d2ea90c07f4a7ad) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:52.066873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb5a5a-06c5-47dd-ad52-4380acf6f9fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:52.068571 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb5a5a-06c5-47dd-ad52-4380acf6f9fb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:52.075068 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 96/203] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:30:51 2022] GET /identity/v3/role_assignments?user.id=f0ec0b529deb49969d2ea90c07f4a7ad&scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b&role.id=0ee2daa9cb3c41fb901603e3d8caf784 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:52.076148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb5a5a-06c5-47dd-ad52-4380acf6f9fb None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:52.083237 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:52.129551 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:52.205013 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72355923-c64a-42e0-b52d-73d9dc2e940e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:52.256677 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66070a17-a870-4b04-98d4-744aaeed2390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:52.257739 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66070a17-a870-4b04-98d4-744aaeed2390 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:52.258234 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66070a17-a870-4b04-98d4-744aaeed2390 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:52.258841 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66070a17-a870-4b04-98d4-744aaeed2390 None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:52.260779 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66070a17-a870-4b04-98d4-744aaeed2390 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc5711794744f1c9ccc1b886cc1a21b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:52.263390 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66070a17-a870-4b04-98d4-744aaeed2390 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:52.265852 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 108/204] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:30:52 2022] GET /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:52.277495 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66070a17-a870-4b04-98d4-744aaeed2390 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:52.318030 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb5a5a-06c5-47dd-ad52-4380acf6f9fb None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:52.377830 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddc709-3c9c-4148-a2b7-019c0265f11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:52.378451 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddc709-3c9c-4148-a2b7-019c0265f11c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:52.378728 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddc709-3c9c-4148-a2b7-019c0265f11c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:52.379002 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddc709-3c9c-4148-a2b7-019c0265f11c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:52.404308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66070a17-a870-4b04-98d4-744aaeed2390 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:52.437490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:52.446929 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4b281-0811-432c-b565-892a5ac636c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:52.448443 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4b281-0811-432c-b565-892a5ac636c5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:52.449958 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4b281-0811-432c-b565-892a5ac636c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:52.450429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4b281-0811-432c-b565-892a5ac636c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:52.452656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4b281-0811-432c-b565-892a5ac636c5 None admin] RBAC: Adding query filter params (role.id=1c9b176504fd4d24b34942f724e63acf, scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b, user.id=f0ec0b529deb49969d2ea90c07f4a7ad) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:52.455293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4b281-0811-432c-b565-892a5ac636c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:52.456935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4b281-0811-432c-b565-892a5ac636c5 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:52.470839 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 109/205] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:30:52 2022] GET /identity/v3/role_assignments?user.id=f0ec0b529deb49969d2ea90c07f4a7ad&scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b&role.id=1c9b176504fd4d24b34942f724e63acf => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:52.516577 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eddc709-3c9c-4148-a2b7-019c0265f11c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:52.518445 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eddc709-3c9c-4148-a2b7-019c0265f11c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:52.521889 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:52.681996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 97/206] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:30:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:30:52.687201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4b281-0811-432c-b565-892a5ac636c5 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:52.792860 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4b281-0811-432c-b565-892a5ac636c5 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:52.832483 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427e00e-0433-4848-8831-19bd3256b6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:52.833128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427e00e-0433-4848-8831-19bd3256b6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:52.833399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427e00e-0433-4848-8831-19bd3256b6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:52.833668 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427e00e-0433-4848-8831-19bd3256b6f5 None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:52.834800 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427e00e-0433-4848-8831-19bd3256b6f5 None admin] RBAC: Authorizing `identity:get_project(project_id=313898e8c5c24ba6860f81e2bba41fb6)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:52.836242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427e00e-0433-4848-8831-19bd3256b6f5 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:52.838674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 110/207] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:30:52 2022] GET /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:52.844317 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddc709-3c9c-4148-a2b7-019c0265f11c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:52.972523 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddc709-3c9c-4148-a2b7-019c0265f11c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:52.975307 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:53.020249 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa6a1e-3fbf-43b7-9cdd-3ef1cfc5834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:53.021361 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa6a1e-3fbf-43b7-9cdd-3ef1cfc5834a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:53.021840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa6a1e-3fbf-43b7-9cdd-3ef1cfc5834a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:53.022297 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa6a1e-3fbf-43b7-9cdd-3ef1cfc5834a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:53.023254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa6a1e-3fbf-43b7-9cdd-3ef1cfc5834a None admin] RBAC: Adding query filter params (role.id=995303a8ffbd4ff2a1e28bbd53e9391e, scope.project.id=313898e8c5c24ba6860f81e2bba41fb6, user.id=8d01565c1ae94eaf9d33aed394f0f814) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:53.023753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa6a1e-3fbf-43b7-9cdd-3ef1cfc5834a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:53.026204 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa6a1e-3fbf-43b7-9cdd-3ef1cfc5834a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:53.033036 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 98/208] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:30:52 2022] GET /identity/v3/role_assignments?user.id=8d01565c1ae94eaf9d33aed394f0f814&scope.project.id=313898e8c5c24ba6860f81e2bba41fb6&role.id=995303a8ffbd4ff2a1e28bbd53e9391e => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:54.091428 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c4054-8772-4985-9baa-c3e47782af86 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:54.091965 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c4054-8772-4985-9baa-c3e47782af86 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:54.091965 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c4054-8772-4985-9baa-c3e47782af86 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:54.093819 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 111/209] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:54.095069 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f1b45-5e81-45c4-842a-b8600aad9596 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:54.095921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f1b45-5e81-45c4-842a-b8600aad9596 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:54.096397 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f1b45-5e81-45c4-842a-b8600aad9596 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:54.098025 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 99/210] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:30:54.099095 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668350c-858f-4a05-9c1c-26581e377d10 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:54.099451 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668350c-858f-4a05-9c1c-26581e377d10 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:54.099735 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668350c-858f-4a05-9c1c-26581e377d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:54.104579 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc8cb3-a95f-4f8c-83bf-6e6b58810f2b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:54.105068 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc8cb3-a95f-4f8c-83bf-6e6b58810f2b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:54.105569 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc8cb3-a95f-4f8c-83bf-6e6b58810f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:54.119163 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-6668350c-858f-4a05-9c1c-26581e377d10 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:54.120359 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6668350c-858f-4a05-9c1c-26581e377d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:54.124643 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-05dc8cb3-a95f-4f8c-83bf-6e6b58810f2b None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:54.126270 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-05dc8cb3-a95f-4f8c-83bf-6e6b58810f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:54.175656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:54.194559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 112/211] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:30:54.210909 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 100/212] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:30:54.478665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668350c-858f-4a05-9c1c-26581e377d10 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:54.486674 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc8cb3-a95f-4f8c-83bf-6e6b58810f2b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:54.585734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668350c-858f-4a05-9c1c-26581e377d10 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:54.609826 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:54.613710 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc8cb3-a95f-4f8c-83bf-6e6b58810f2b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:54.624872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b07234-f4e7-42e4-bf20-5b4fe24d896a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:54.625929 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b07234-f4e7-42e4-bf20-5b4fe24d896a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:54.626223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b07234-f4e7-42e4-bf20-5b4fe24d896a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:54.626620 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b07234-f4e7-42e4-bf20-5b4fe24d896a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:54.627896 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b07234-f4e7-42e4-bf20-5b4fe24d896a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:54.629430 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b07234-f4e7-42e4-bf20-5b4fe24d896a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:54.630932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 113/213] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:30:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:54.634948 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d5b3b-7243-4bae-ac6a-3c5398453ab8 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:54.635225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d5b3b-7243-4bae-ac6a-3c5398453ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:54.635489 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d5b3b-7243-4bae-ac6a-3c5398453ab8 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:54.636716 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 114/214] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:54.641296 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d5b3b-7243-4bae-ac6a-3c5398453ab8 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:54.655198 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555f66e-3058-4055-bed3-557a16b9f899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:54.656016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555f66e-3058-4055-bed3-557a16b9f899 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:54.656447 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555f66e-3058-4055-bed3-557a16b9f899 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:54.656726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555f66e-3058-4055-bed3-557a16b9f899 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:54.670543 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555f66e-3058-4055-bed3-557a16b9f899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:54.675533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-1555f66e-3058-4055-bed3-557a16b9f899 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:30:54.675533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:54.675533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:54.675533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:54.675533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:54.675533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:54.675533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:54.675533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:54.675533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:54.675533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:54.675533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:54.675533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:54.675533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:54.675533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:54.675533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:54.675533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:54.676437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:54.676437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:54.676437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:54.676437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:54.676437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:54.676437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:54.676437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:54.676437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:54.676437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:54.676437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:54.676437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:54.676437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:54.676437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:54.676437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:54.676437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:54.676437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:54.677240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:54.677240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:54.677240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:54.677240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:54.677240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:54.677240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:54.677240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:54.677240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:54.677240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:54.677240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:54.677240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:30:54.677240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:30:54.677240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 101/215] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:30:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:54.677897 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbe56d-129b-45a4-9242-335304f44755 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:54.678490 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbe56d-129b-45a4-9242-335304f44755 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:54.678490 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbe56d-129b-45a4-9242-335304f44755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:54.698633 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c3fbe56d-129b-45a4-9242-335304f44755 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:54.699906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c3fbe56d-129b-45a4-9242-335304f44755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:54.706443 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:54.754035 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d5b3b-7243-4bae-ac6a-3c5398453ab8 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:54.773279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 102/216] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:54.783059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbe56d-129b-45a4-9242-335304f44755 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:54.800130 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885373e0-cd98-4e57-8985-0d35e9ec2e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:54.801371 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885373e0-cd98-4e57-8985-0d35e9ec2e32 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:54.802370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885373e0-cd98-4e57-8985-0d35e9ec2e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:54.803162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885373e0-cd98-4e57-8985-0d35e9ec2e32 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:54.804008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885373e0-cd98-4e57-8985-0d35e9ec2e32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:54.806754 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885373e0-cd98-4e57-8985-0d35e9ec2e32 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:54.838126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 115/217] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 15 00:30:54 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:30:54.880754 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464c2eb-1455-45e7-9180-b2b704bf8d28 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:54.880998 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464c2eb-1455-45e7-9180-b2b704bf8d28 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:54.881491 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464c2eb-1455-45e7-9180-b2b704bf8d28 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:54.883322 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 116/218] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:54.890753 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef34c27-d8d3-4f5b-8191-a42d4b08b528 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:54.891114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef34c27-d8d3-4f5b-8191-a42d4b08b528 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:54.891458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef34c27-d8d3-4f5b-8191-a42d4b08b528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:54.896910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:54.912160 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbe56d-129b-45a4-9242-335304f44755 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:54.912694 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-4ef34c27-d8d3-4f5b-8191-a42d4b08b528 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:54.914099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4ef34c27-d8d3-4f5b-8191-a42d4b08b528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:54.952019 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0bd18-93b9-4885-b58b-4b5f0aae66a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:54.952635 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0bd18-93b9-4885-b58b-4b5f0aae66a2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:54.952911 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0bd18-93b9-4885-b58b-4b5f0aae66a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:54.953393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0bd18-93b9-4885-b58b-4b5f0aae66a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:54.954174 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0bd18-93b9-4885-b58b-4b5f0aae66a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:54.954486 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0bd18-93b9-4885-b58b-4b5f0aae66a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:54.955899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0bd18-93b9-4885-b58b-4b5f0aae66a2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:54.965698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 103/219] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:30:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:54.971438 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0bd18-93b9-4885-b58b-4b5f0aae66a2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:54.996561 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 117/220] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:30:55.046826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef34c27-d8d3-4f5b-8191-a42d4b08b528 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:55.092219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0bd18-93b9-4885-b58b-4b5f0aae66a2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:55.100516 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:55.141922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59dcc5d-941c-4666-8190-25f2ff9dc6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:55.142488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dcc5d-941c-4666-8190-25f2ff9dc6d9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:55.142753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dcc5d-941c-4666-8190-25f2ff9dc6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:55.143020 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dcc5d-941c-4666-8190-25f2ff9dc6d9 None admin] PATH_INFO: `/v3/users/92f9e60150a84d9b94c4676ad79737ac` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:55.162503 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59dcc5d-941c-4666-8190-25f2ff9dc6d9 None admin] RBAC: Authorizing `identity:get_user(user_id=92f9e60150a84d9b94c4676ad79737ac)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:55.163838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59dcc5d-941c-4666-8190-25f2ff9dc6d9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:55.166550 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 104/221] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:54 2022] GET /identity/v3/users/92f9e60150a84d9b94c4676ad79737ac => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:55.171803 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59dcc5d-941c-4666-8190-25f2ff9dc6d9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:55.179321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef34c27-d8d3-4f5b-8191-a42d4b08b528 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:55.183079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:55.224895 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b47832-3b7e-479b-8012-0149fc81d1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:55.225617 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b47832-3b7e-479b-8012-0149fc81d1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:55.226155 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b47832-3b7e-479b-8012-0149fc81d1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:55.226443 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b47832-3b7e-479b-8012-0149fc81d1d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:55.240208 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b47832-3b7e-479b-8012-0149fc81d1d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:55.246942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-27b47832-3b7e-479b-8012-0149fc81d1d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:30:55.246942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:55.246942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:55.246942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:55.246942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:55.246942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:55.246942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:55.246942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:55.246942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:55.246942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:55.246942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:55.246942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:55.246942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:55.246942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:55.246942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:55.246942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:55.247829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:55.247829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:55.247829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:55.247829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:55.247829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:55.247829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:55.247829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:55.247829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:55.247829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:55.247829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:55.247829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:55.247829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:55.247829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:55.247829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:55.247829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:55.247829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:55.248598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:55.248598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:55.248598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:55.248598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:55.248598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:55.248598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:55.248598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:55.248598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:55.248598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:55.248598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:55.248598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:30:55.248598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:30:55.248598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 118/222] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:30:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:55.255461 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b47832-3b7e-479b-8012-0149fc81d1d9 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:55.295345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59dcc5d-941c-4666-8190-25f2ff9dc6d9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:55.351442 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61eb91d-1cb1-45ae-8053-6a5c497ad1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:55.352190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61eb91d-1cb1-45ae-8053-6a5c497ad1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:55.353145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61eb91d-1cb1-45ae-8053-6a5c497ad1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:55.353534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61eb91d-1cb1-45ae-8053-6a5c497ad1d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:55.379342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:55.382918 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b47832-3b7e-479b-8012-0149fc81d1d9 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:55.420954 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba31bc2-3487-434f-9711-94e49668c41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:55.421848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba31bc2-3487-434f-9711-94e49668c41f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:55.422268 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba31bc2-3487-434f-9711-94e49668c41f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:55.422680 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba31bc2-3487-434f-9711-94e49668c41f None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:55.423479 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba31bc2-3487-434f-9711-94e49668c41f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:55.423928 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba31bc2-3487-434f-9711-94e49668c41f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:55.425480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba31bc2-3487-434f-9711-94e49668c41f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:55.433452 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61eb91d-1cb1-45ae-8053-6a5c497ad1d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:55.434726 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 119/223] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:30:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:30:55.435075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61eb91d-1cb1-45ae-8053-6a5c497ad1d3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:55.435837 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba31bc2-3487-434f-9711-94e49668c41f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:55.446214 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:55.555009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 105/224] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:30:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:30:55.557854 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba31bc2-3487-434f-9711-94e49668c41f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:55.561074 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61eb91d-1cb1-45ae-8053-6a5c497ad1d3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:55.595818 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c94b94-8694-4330-ad3a-3d4b86615e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:55.596721 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c94b94-8694-4330-ad3a-3d4b86615e1b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:55.597322 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c94b94-8694-4330-ad3a-3d4b86615e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:55.597787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c94b94-8694-4330-ad3a-3d4b86615e1b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:55.612084 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c94b94-8694-4330-ad3a-3d4b86615e1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:55.618560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-66c94b94-8694-4330-ad3a-3d4b86615e1b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:30:55.618560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:55.618560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:55.618560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:55.618560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:55.618560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:55.618560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:55.618560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:55.618560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:55.618560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:55.618560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:55.618560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:55.618560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:55.618560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:55.618560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:55.618560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:55.619635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:55.619635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:55.619635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:55.619635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:55.619635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:55.619635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:55.619635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:55.619635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:55.619635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:55.619635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:55.619635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:55.619635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:55.619635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:55.619635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:55.619635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:55.619635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:55.620636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:55.620636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:55.620636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:55.620636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:55.620636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:55.620636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:55.620636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:55.620636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:55.620636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:55.620636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:55.620636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:30:55.620636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:30:55.623081 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 120/225] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 15 00:30:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:55.624324 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c94b94-8694-4330-ad3a-3d4b86615e1b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:55.659835 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:55.674851 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61eb91d-1cb1-45ae-8053-6a5c497ad1d3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:55.684770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:55.717556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c38642-4e45-4fdf-bede-77104120016b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:55.718366 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c38642-4e45-4fdf-bede-77104120016b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:55.718741 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c38642-4e45-4fdf-bede-77104120016b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:55.719106 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c38642-4e45-4fdf-bede-77104120016b None admin] PATH_INFO: `/v3/users/f0ec0b529deb49969d2ea90c07f4a7ad` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:55.720354 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c38642-4e45-4fdf-bede-77104120016b None admin] RBAC: Authorizing `identity:get_user(user_id=f0ec0b529deb49969d2ea90c07f4a7ad)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:55.722271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c38642-4e45-4fdf-bede-77104120016b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:55.728480 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 106/226] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:55 2022] GET /identity/v3/users/f0ec0b529deb49969d2ea90c07f4a7ad => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:55.728480 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c38642-4e45-4fdf-bede-77104120016b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:55.763479 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c94b94-8694-4330-ad3a-3d4b86615e1b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:55.808934 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068bb66-7886-4054-98a5-d517cf9652e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:55.809872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068bb66-7886-4054-98a5-d517cf9652e2 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:55.810289 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068bb66-7886-4054-98a5-d517cf9652e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:55.810663 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068bb66-7886-4054-98a5-d517cf9652e2 None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:55.812069 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068bb66-7886-4054-98a5-d517cf9652e2 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc5711794744f1c9ccc1b886cc1a21b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:55.813639 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068bb66-7886-4054-98a5-d517cf9652e2 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:55.815488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 121/227] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:30:55 2022] GET /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:55.821384 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068bb66-7886-4054-98a5-d517cf9652e2 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:55.852223 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c38642-4e45-4fdf-bede-77104120016b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:55.892245 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11dd15-d354-44dd-9131-67aea9b6a423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:55.892998 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11dd15-d354-44dd-9131-67aea9b6a423 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:55.893398 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11dd15-d354-44dd-9131-67aea9b6a423 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:55.893850 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11dd15-d354-44dd-9131-67aea9b6a423 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:55.894817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11dd15-d354-44dd-9131-67aea9b6a423 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:55.895113 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11dd15-d354-44dd-9131-67aea9b6a423 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:55.896598 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11dd15-d354-44dd-9131-67aea9b6a423 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:55.905640 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 107/228] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:30:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:55.906880 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11dd15-d354-44dd-9131-67aea9b6a423 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:55.937763 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:55.950070 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068bb66-7886-4054-98a5-d517cf9652e2 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:55.953039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:55.993604 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b80469-a3a1-4465-8a13-c5975bded1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:55.994892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b80469-a3a1-4465-8a13-c5975bded1fa None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:55.995317 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b80469-a3a1-4465-8a13-c5975bded1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:55.995728 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b80469-a3a1-4465-8a13-c5975bded1fa None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:55.997574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b80469-a3a1-4465-8a13-c5975bded1fa None admin] RBAC: Authorizing `identity:get_project(project_id=7cc5711794744f1c9ccc1b886cc1a21b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:55.999066 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b80469-a3a1-4465-8a13-c5975bded1fa None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:56.006057 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 122/229] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:30:55 2022] GET /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:56.006057 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b80469-a3a1-4465-8a13-c5975bded1fa None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:56.032519 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11dd15-d354-44dd-9131-67aea9b6a423 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:56.073244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dec694-77bf-423d-93da-e6ced3d824fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:56.073850 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dec694-77bf-423d-93da-e6ced3d824fc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:56.074180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dec694-77bf-423d-93da-e6ced3d824fc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:56.074460 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dec694-77bf-423d-93da-e6ced3d824fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:56.075295 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dec694-77bf-423d-93da-e6ced3d824fc None admin] RBAC: Adding query filter params (role.id=24171c44541e4c4782ec7d3f03b50467, scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b, user.id=92f9e60150a84d9b94c4676ad79737ac) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:56.075607 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dec694-77bf-423d-93da-e6ced3d824fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:56.077066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dec694-77bf-423d-93da-e6ced3d824fc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:56.083141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 108/230] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:30:55 2022] GET /identity/v3/role_assignments?user.id=92f9e60150a84d9b94c4676ad79737ac&scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b&role.id=24171c44541e4c4782ec7d3f03b50467 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:56.083731 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dec694-77bf-423d-93da-e6ced3d824fc None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:56.160734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b80469-a3a1-4465-8a13-c5975bded1fa None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:56.236622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acac488-4411-4100-bc53-d79b674edacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:56.237227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acac488-4411-4100-bc53-d79b674edacb None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:56.237509 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acac488-4411-4100-bc53-d79b674edacb None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:56.237782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acac488-4411-4100-bc53-d79b674edacb None admin] PATH_INFO: `/v3/users/f0ec0b529deb49969d2ea90c07f4a7ad` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:56.239047 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acac488-4411-4100-bc53-d79b674edacb None admin] RBAC: Authorizing `identity:get_user(user_id=f0ec0b529deb49969d2ea90c07f4a7ad)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:56.240515 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acac488-4411-4100-bc53-d79b674edacb None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:56.242155 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 123/231] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:56 2022] GET /identity/v3/users/f0ec0b529deb49969d2ea90c07f4a7ad => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:56.248743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acac488-4411-4100-bc53-d79b674edacb None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:56.287728 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dec694-77bf-423d-93da-e6ced3d824fc None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:56.289337 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:56.311528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:56.338073 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca43bf0-26f9-49c0-90c2-911052620806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:56.339554 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca43bf0-26f9-49c0-90c2-911052620806 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:56.339984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca43bf0-26f9-49c0-90c2-911052620806 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:56.340401 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca43bf0-26f9-49c0-90c2-911052620806 None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b/users/f0ec0b529deb49969d2ea90c07f4a7ad/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:56.343023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca43bf0-26f9-49c0-90c2-911052620806 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cc5711794744f1c9ccc1b886cc1a21b, user_id=f0ec0b529deb49969d2ea90c07f4a7ad, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:56.345768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca43bf0-26f9-49c0-90c2-911052620806 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:56.365422 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 109/232] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:30:56 2022] PUT /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b/users/f0ec0b529deb49969d2ea90c07f4a7ad/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:30:56.422255 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acac488-4411-4100-bc53-d79b674edacb None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:56.461199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839d47c-b714-405b-b0c0-93d07469a7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:56.462745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839d47c-b714-405b-b0c0-93d07469a7fe None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:56.463183 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839d47c-b714-405b-b0c0-93d07469a7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:56.463599 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839d47c-b714-405b-b0c0-93d07469a7fe None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:56.464904 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839d47c-b714-405b-b0c0-93d07469a7fe None admin] RBAC: Authorizing `identity:get_project(project_id=7cc5711794744f1c9ccc1b886cc1a21b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:56.466669 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839d47c-b714-405b-b0c0-93d07469a7fe None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:56.468607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 124/233] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:30:56 2022] GET /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:56.474717 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca43bf0-26f9-49c0-90c2-911052620806 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:56.603752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca43bf0-26f9-49c0-90c2-911052620806 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:56.641733 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4c566-62de-46e0-89f1-f58c4ffccd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:56.642626 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4c566-62de-46e0-89f1-f58c4ffccd1b None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:56.643050 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4c566-62de-46e0-89f1-f58c4ffccd1b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:56.643488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4c566-62de-46e0-89f1-f58c4ffccd1b None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b/users/f0ec0b529deb49969d2ea90c07f4a7ad/roles/1c9b176504fd4d24b34942f724e63acf` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:56.645809 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4c566-62de-46e0-89f1-f58c4ffccd1b None admin] RBAC: Authorizing `identity:create_grant(project_id=7cc5711794744f1c9ccc1b886cc1a21b, user_id=f0ec0b529deb49969d2ea90c07f4a7ad, role_id=1c9b176504fd4d24b34942f724e63acf)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:56.647416 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4c566-62de-46e0-89f1-f58c4ffccd1b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:56.671020 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 110/234] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:30:56 2022] PUT /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b/users/f0ec0b529deb49969d2ea90c07f4a7ad/roles/1c9b176504fd4d24b34942f724e63acf => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:30:57.500372 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b879ba7-8e8a-4ee7-bbeb-9effe432cb09 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:57.500876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b879ba7-8e8a-4ee7-bbeb-9effe432cb09 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:57.500876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b879ba7-8e8a-4ee7-bbeb-9effe432cb09 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:57.502489 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 125/235] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:57.507891 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47088a-e2e4-4f2e-bb7e-35d91414d7b6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:57.508771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47088a-e2e4-4f2e-bb7e-35d91414d7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:57.509805 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47088a-e2e4-4f2e-bb7e-35d91414d7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:57.530867 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0f47088a-e2e4-4f2e-bb7e-35d91414d7b6 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:57.532437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0f47088a-e2e4-4f2e-bb7e-35d91414d7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:57.557520 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:57.631036 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 111/236] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:57.669040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c39bfc-56dd-444a-b6fb-541227ee7ce9 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:57.669384 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c39bfc-56dd-444a-b6fb-541227ee7ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:57.669633 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c39bfc-56dd-444a-b6fb-541227ee7ce9 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:57.671243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 126/237] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:57.676520 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b2b2b-bf92-4158-9018-3b5d5e96801b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:57.676808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b2b2b-bf92-4158-9018-3b5d5e96801b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:57.677109 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b2b2b-bf92-4158-9018-3b5d5e96801b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:57.702055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-912b2b2b-bf92-4158-9018-3b5d5e96801b None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:57.703255 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-912b2b2b-bf92-4158-9018-3b5d5e96801b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:57.795095 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 112/238] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:57.976890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c39bfc-56dd-444a-b6fb-541227ee7ce9 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:58.100953 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:58.110233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c39bfc-56dd-444a-b6fb-541227ee7ce9 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:58.157467 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3b52e-18a9-4b9e-9a17-89d51c4102d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:58.158435 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3b52e-18a9-4b9e-9a17-89d51c4102d1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:58.158940 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3b52e-18a9-4b9e-9a17-89d51c4102d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:58.159420 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3b52e-18a9-4b9e-9a17-89d51c4102d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:58.175807 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd3b52e-18a9-4b9e-9a17-89d51c4102d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:58.181908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-0bd3b52e-18a9-4b9e-9a17-89d51c4102d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 00:30:58.181908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:58.181908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:58.181908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:58.181908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:58.181908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:58.181908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:58.181908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:58.181908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:58.181908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:58.181908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:58.181908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:58.181908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:58.181908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:58.181908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:58.181908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:58.182762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:58.182762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:58.182762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:58.182762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:58.182762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:58.182762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:58.182762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:58.182762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:58.182762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:58.182762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:58.182762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:58.182762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:58.182762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:58.182762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:58.182762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:58.182762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:58.183544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:58.183544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:58.183544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:58.183544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:58.183544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:58.183544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:58.183544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:58.183544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:58.183544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:58.183544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:58.183544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 00:30:58.183544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:30:58.185805 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 127/239] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:30:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:58.191704 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b2b2b-bf92-4158-9018-3b5d5e96801b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:58.309259 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:58.319991 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3b52e-18a9-4b9e-9a17-89d51c4102d1 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:58.339143 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b2b2b-bf92-4158-9018-3b5d5e96801b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:58.408316 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a1d9f-0861-4149-ba8c-f51cc48437e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:58.409330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a1d9f-0861-4149-ba8c-f51cc48437e5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:58.410707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a1d9f-0861-4149-ba8c-f51cc48437e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:58.411199 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a1d9f-0861-4149-ba8c-f51cc48437e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:58.412290 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a1d9f-0861-4149-ba8c-f51cc48437e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:58.415474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a1d9f-0861-4149-ba8c-f51cc48437e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:58.417162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a1d9f-0861-4149-ba8c-f51cc48437e5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:58.434337 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 113/240] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:30:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:58.439788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a1d9f-0861-4149-ba8c-f51cc48437e5 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:58.505826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3b52e-18a9-4b9e-9a17-89d51c4102d1 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:58.570968 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fd8a2-b872-4b3f-9394-6af1eb687eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:58.572663 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fd8a2-b872-4b3f-9394-6af1eb687eac None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:58.573945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fd8a2-b872-4b3f-9394-6af1eb687eac None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:58.574418 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fd8a2-b872-4b3f-9394-6af1eb687eac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:58.578115 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fd8a2-b872-4b3f-9394-6af1eb687eac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:58.579792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fd8a2-b872-4b3f-9394-6af1eb687eac None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:58.583907 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 128/241] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:30:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:30:58.592991 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fd8a2-b872-4b3f-9394-6af1eb687eac None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:58.624964 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a1d9f-0861-4149-ba8c-f51cc48437e5 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:58.648150 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:58.666553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09daeed1-3a35-4dd0-8d70-1eada9951ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:58.667181 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09daeed1-3a35-4dd0-8d70-1eada9951ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:58.667457 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09daeed1-3a35-4dd0-8d70-1eada9951ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:58.667728 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09daeed1-3a35-4dd0-8d70-1eada9951ba9 None admin] PATH_INFO: `/v3/users/711ea36977e14195b21e7b2114dad4d1` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:58.685740 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09daeed1-3a35-4dd0-8d70-1eada9951ba9 None admin] RBAC: Authorizing `identity:get_user(user_id=711ea36977e14195b21e7b2114dad4d1)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:58.687206 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09daeed1-3a35-4dd0-8d70-1eada9951ba9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:58.688874 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 114/242] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:58 2022] GET /identity/v3/users/711ea36977e14195b21e7b2114dad4d1 => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:30:58.694392 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09daeed1-3a35-4dd0-8d70-1eada9951ba9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:58.698127 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:58.776830 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fd8a2-b872-4b3f-9394-6af1eb687eac None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:58.821111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395829e-4b34-4160-837b-1aa88bce710d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:58.822032 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395829e-4b34-4160-837b-1aa88bce710d None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:58.822455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395829e-4b34-4160-837b-1aa88bce710d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:58.822868 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395829e-4b34-4160-837b-1aa88bce710d None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:58.823666 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395829e-4b34-4160-837b-1aa88bce710d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:58.826109 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395829e-4b34-4160-837b-1aa88bce710d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:58.830768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09daeed1-3a35-4dd0-8d70-1eada9951ba9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:58.859549 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 129/243] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 15 00:30:58 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:30:58.862503 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625513d-7eec-4708-b27c-48aa9c5e3e28 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:58.864705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625513d-7eec-4708-b27c-48aa9c5e3e28 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:58.865369 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625513d-7eec-4708-b27c-48aa9c5e3e28 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:58.869240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 130/244] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:58.874123 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb643bea-7f9f-4e98-83d0-0eef38cd03a2 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:58.874634 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb643bea-7f9f-4e98-83d0-0eef38cd03a2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:58.875097 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb643bea-7f9f-4e98-83d0-0eef38cd03a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:58.902878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de44d8-a30a-442a-9c7f-14c4cde77077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:58.903856 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de44d8-a30a-442a-9c7f-14c4cde77077 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:58.904597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de44d8-a30a-442a-9c7f-14c4cde77077 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:58.905012 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de44d8-a30a-442a-9c7f-14c4cde77077 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:58.918837 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-eb643bea-7f9f-4e98-83d0-0eef38cd03a2 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:58.920417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-eb643bea-7f9f-4e98-83d0-0eef38cd03a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:59.031449 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de44d8-a30a-442a-9c7f-14c4cde77077 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:59.031649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 131/245] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:59.032966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681bde1-fb23-4806-8e6d-45fd9dddd0ec None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:59.033363 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681bde1-fb23-4806-8e6d-45fd9dddd0ec None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:59.033640 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681bde1-fb23-4806-8e6d-45fd9dddd0ec None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:59.033939 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de44d8-a30a-442a-9c7f-14c4cde77077 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:59.036345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:59.039239 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 132/246] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:59.041627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a94f1-defd-48ca-b745-cce41522b1e2 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:59.041992 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a94f1-defd-48ca-b745-cce41522b1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:59.042212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a94f1-defd-48ca-b745-cce41522b1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:59.072443 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-c62a94f1-defd-48ca-b745-cce41522b1e2 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:59.073845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c62a94f1-defd-48ca-b745-cce41522b1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:59.076200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:59.157652 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 133/247] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:59.191414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 115/248] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:30:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:30:59.197140 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a94f1-defd-48ca-b745-cce41522b1e2 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:59.307131 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a94f1-defd-48ca-b745-cce41522b1e2 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:59.323397 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de44d8-a30a-442a-9c7f-14c4cde77077 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:59.346555 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2ffe0-5943-4dc6-9822-4c525852bde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:59.347210 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2ffe0-5943-4dc6-9822-4c525852bde0 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:59.347490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2ffe0-5943-4dc6-9822-4c525852bde0 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:59.347762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2ffe0-5943-4dc6-9822-4c525852bde0 None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:59.349035 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2ffe0-5943-4dc6-9822-4c525852bde0 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc5711794744f1c9ccc1b886cc1a21b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:59.352498 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2ffe0-5943-4dc6-9822-4c525852bde0 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:59.352498 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 134/249] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:30:59 2022] GET /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:30:59.359849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2ffe0-5943-4dc6-9822-4c525852bde0 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:59.370655 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:59.475560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2ffe0-5943-4dc6-9822-4c525852bde0 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:59.483286 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de44d8-a30a-442a-9c7f-14c4cde77077 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:59.486070 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:59.516603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd79cf8-adf2-42cd-877c-331b1d5c0cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:59.517310 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd79cf8-adf2-42cd-877c-331b1d5c0cea None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:59.517581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd79cf8-adf2-42cd-877c-331b1d5c0cea None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:59.517848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd79cf8-adf2-42cd-877c-331b1d5c0cea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:59.518794 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd79cf8-adf2-42cd-877c-331b1d5c0cea None admin] RBAC: Adding query filter params (role.id=995303a8ffbd4ff2a1e28bbd53e9391e, scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b, user.id=711ea36977e14195b21e7b2114dad4d1) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:59.519447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd79cf8-adf2-42cd-877c-331b1d5c0cea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:59.520914 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd79cf8-adf2-42cd-877c-331b1d5c0cea None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:59.527943 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 135/250] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:30:59 2022] GET /identity/v3/role_assignments?user.id=711ea36977e14195b21e7b2114dad4d1&scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b&role.id=995303a8ffbd4ff2a1e28bbd53e9391e => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:30:59.528762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd79cf8-adf2-42cd-877c-331b1d5c0cea None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:59.536285 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6477f-3cc0-4012-b048-f52d225724a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:59.536935 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6477f-3cc0-4012-b048-f52d225724a7 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:59.537268 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6477f-3cc0-4012-b048-f52d225724a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:59.537542 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6477f-3cc0-4012-b048-f52d225724a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:59.554701 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6477f-3cc0-4012-b048-f52d225724a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:59.561549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-2be6477f-3cc0-4012-b048-f52d225724a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:30:59.561549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:59.561549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:59.561549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:59.561549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:59.561549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:59.561549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:59.561549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:59.561549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:59.561549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:59.561549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:59.561549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:59.561549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:59.561549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:59.561549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:59.561549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:59.562481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:59.562481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:59.562481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:59.562481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:59.562481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:59.562481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:59.562481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:59.562481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:59.562481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:59.562481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:59.562481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:59.562481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:59.562481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:59.562481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:59.562481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:59.562481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:59.563261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:59.563261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:59.563261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:59.563261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:59.563261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:59.563261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:59.563261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:59.563261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:59.563261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:59.563261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:59.563261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:30:59.563261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:30:59.563261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 116/251] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:30:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:30:59.564387 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420c7f0-fa11-4e96-be45-e8dc39d768b7 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:59.564478 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420c7f0-fa11-4e96-be45-e8dc39d768b7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:59.564723 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420c7f0-fa11-4e96-be45-e8dc39d768b7 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:59.570744 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 117/252] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:30:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:30:59.573180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420c7f0-fa11-4e96-be45-e8dc39d768b7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:59.612124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:59.653697 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd79cf8-adf2-42cd-877c-331b1d5c0cea None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:59.693461 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22e56a-8250-4e4c-877a-54738b8cc07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:59.694106 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22e56a-8250-4e4c-877a-54738b8cc07a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:59.694491 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22e56a-8250-4e4c-877a-54738b8cc07a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:59.694763 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22e56a-8250-4e4c-877a-54738b8cc07a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:59.709658 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c22e56a-8250-4e4c-877a-54738b8cc07a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:30:59.710778 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420c7f0-fa11-4e96-be45-e8dc39d768b7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:59.716897 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-5c22e56a-8250-4e4c-877a-54738b8cc07a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:30:59.716897 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:30:59.716897 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:30:59.716897 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:30:59.716897 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:30:59.716897 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:30:59.716897 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:30:59.716897 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:30:59.716897 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:30:59.716897 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:30:59.716897 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:30:59.716897 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:30:59.716897 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:30:59.716897 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:30:59.716897 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:30:59.716897 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:30:59.717855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:30:59.717855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:30:59.717855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:30:59.717855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:30:59.717855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:30:59.717855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:30:59.717855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:30:59.717855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:30:59.717855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:30:59.717855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:30:59.717855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:30:59.717855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:30:59.717855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:30:59.717855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:30:59.717855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:30:59.717855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:30:59.718653 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:30:59.718653 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:30:59.718653 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:30:59.718653 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:30:59.718653 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:30:59.718653 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:30:59.718653 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:30:59.718653 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:30:59.718653 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:30:59.718653 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:30:59.718653 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:30:59.718653 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:30:59.718653 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 136/253] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:30:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:30:59.719299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb5b44-b2ee-4a7e-9aeb-56c93b0fbed5 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:59.719860 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb5b44-b2ee-4a7e-9aeb-56c93b0fbed5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:59.723927 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb5b44-b2ee-4a7e-9aeb-56c93b0fbed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:59.746286 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8ebb5b44-b2ee-4a7e-9aeb-56c93b0fbed5 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:30:59.748196 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8ebb5b44-b2ee-4a7e-9aeb-56c93b0fbed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:30:59.752371 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c50da-c9c4-4197-8685-ce55439b08c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:59.752981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c50da-c9c4-4197-8685-ce55439b08c2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:59.753286 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c50da-c9c4-4197-8685-ce55439b08c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:59.753555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c50da-c9c4-4197-8685-ce55439b08c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:59.754224 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c50da-c9c4-4197-8685-ce55439b08c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:59.754525 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c50da-c9c4-4197-8685-ce55439b08c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:59.755901 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c50da-c9c4-4197-8685-ce55439b08c2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:59.772010 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 118/254] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:30:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:30:59.772874 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c50da-c9c4-4197-8685-ce55439b08c2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:59.825159 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:30:59.882575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 137/255] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:30:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:30:59.883428 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb5b44-b2ee-4a7e-9aeb-56c93b0fbed5 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:30:59.944037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c50da-c9c4-4197-8685-ce55439b08c2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:30:59.979682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80991335-9800-44bb-b948-7823c73063a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:30:59.980288 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80991335-9800-44bb-b948-7823c73063a2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:30:59.980566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80991335-9800-44bb-b948-7823c73063a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:30:59.980837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80991335-9800-44bb-b948-7823c73063a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:30:59.981536 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80991335-9800-44bb-b948-7823c73063a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:30:59.981838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80991335-9800-44bb-b948-7823c73063a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:30:59.983228 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80991335-9800-44bb-b948-7823c73063a2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:30:59.992509 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 119/256] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:30:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:00.007135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80991335-9800-44bb-b948-7823c73063a2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:00.020347 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:00.088215 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb5b44-b2ee-4a7e-9aeb-56c93b0fbed5 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:00.113491 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:00.133894 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80991335-9800-44bb-b948-7823c73063a2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:00.145784 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835f73f-d529-476e-a08c-a7001d6f8501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:00.146425 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835f73f-d529-476e-a08c-a7001d6f8501 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:00.146704 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835f73f-d529-476e-a08c-a7001d6f8501 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:00.146975 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835f73f-d529-476e-a08c-a7001d6f8501 None admin] PATH_INFO: `/v3/users/92f9e60150a84d9b94c4676ad79737ac` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:00.149790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835f73f-d529-476e-a08c-a7001d6f8501 None admin] RBAC: Authorizing `identity:get_user(user_id=92f9e60150a84d9b94c4676ad79737ac)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:00.151251 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835f73f-d529-476e-a08c-a7001d6f8501 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:00.153039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 138/257] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:30:59 2022] GET /identity/v3/users/92f9e60150a84d9b94c4676ad79737ac => generated 297 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:00.158231 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835f73f-d529-476e-a08c-a7001d6f8501 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:00.186167 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a7e65-512a-42d9-a74c-9ff0fb9246f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:00.187056 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a7e65-512a-42d9-a74c-9ff0fb9246f8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:00.187338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a7e65-512a-42d9-a74c-9ff0fb9246f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:00.187614 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a7e65-512a-42d9-a74c-9ff0fb9246f8 None admin] PATH_INFO: `/v3/users/f0ec0b529deb49969d2ea90c07f4a7ad` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:00.188755 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a7e65-512a-42d9-a74c-9ff0fb9246f8 None admin] RBAC: Authorizing `identity:get_user(user_id=f0ec0b529deb49969d2ea90c07f4a7ad)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:00.190730 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a7e65-512a-42d9-a74c-9ff0fb9246f8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:00.192522 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 120/258] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:31:00 2022] GET /identity/v3/users/f0ec0b529deb49969d2ea90c07f4a7ad => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:31:00.198865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a7e65-512a-42d9-a74c-9ff0fb9246f8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:00.360537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a7e65-512a-42d9-a74c-9ff0fb9246f8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:00.399207 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835f73f-d529-476e-a08c-a7001d6f8501 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:00.421574 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f0977-637a-4c97-9462-8d65c3f2a82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:00.422425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f0977-637a-4c97-9462-8d65c3f2a82c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:00.422843 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f0977-637a-4c97-9462-8d65c3f2a82c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:00.423777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f0977-637a-4c97-9462-8d65c3f2a82c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:00.437926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:00.452478 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b51d7-3a32-4331-9d9c-42d6cf930c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:00.453152 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b51d7-3a32-4331-9d9c-42d6cf930c28 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:00.453477 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b51d7-3a32-4331-9d9c-42d6cf930c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:00.453754 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b51d7-3a32-4331-9d9c-42d6cf930c28 None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:00.456242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b51d7-3a32-4331-9d9c-42d6cf930c28 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc5711794744f1c9ccc1b886cc1a21b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:00.457710 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b51d7-3a32-4331-9d9c-42d6cf930c28 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:00.459512 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 139/259] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:31:00 2022] GET /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:31:00.460152 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b51d7-3a32-4331-9d9c-42d6cf930c28 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:00.497246 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:00.582418 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f0977-637a-4c97-9462-8d65c3f2a82c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:00.584030 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f0977-637a-4c97-9462-8d65c3f2a82c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:00.598799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b51d7-3a32-4331-9d9c-42d6cf930c28 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:00.664202 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ae873-c5d5-467e-9968-e6e735b009be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:00.664748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ae873-c5d5-467e-9968-e6e735b009be None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:00.665099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ae873-c5d5-467e-9968-e6e735b009be None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:00.665445 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ae873-c5d5-467e-9968-e6e735b009be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:00.685974 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ae873-c5d5-467e-9968-e6e735b009be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:00.689639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 121/260] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:31:00.690529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f0977-637a-4c97-9462-8d65c3f2a82c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:00.699153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-971ae873-c5d5-467e-9968-e6e735b009be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:31:00.699153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:00.699153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:00.699153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:00.699153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:00.699153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:00.699153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:00.699153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:00.699153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:00.699153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:00.699153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:00.699153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:00.699153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:00.699153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:00.699153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:00.699153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:00.700038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:00.700038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:00.700038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:00.700038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:00.700038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:00.700038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:00.700038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:00.700038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:00.700038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:00.700038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:00.700038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:00.700038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:00.700038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:00.700038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:00.700038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:00.700038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:00.700826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:00.700826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:00.700826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:00.700826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:00.700826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:00.700826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:00.700826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:00.700826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:00.700826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:00.700826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:00.700826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:31:00.700826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:00.700826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 140/261] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 15 00:31:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:00.701501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ae873-c5d5-467e-9968-e6e735b009be None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:00.759534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:00.809676 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f0977-637a-4c97-9462-8d65c3f2a82c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:00.827037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:00.849482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c9603-3b07-4567-8728-8b2a7b907c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:00.850446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c9603-3b07-4567-8728-8b2a7b907c14 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:00.850864 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c9603-3b07-4567-8728-8b2a7b907c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:00.851273 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c9603-3b07-4567-8728-8b2a7b907c14 None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b/users/92f9e60150a84d9b94c4676ad79737ac/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:00.854399 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c9603-3b07-4567-8728-8b2a7b907c14 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cc5711794744f1c9ccc1b886cc1a21b, user_id=92f9e60150a84d9b94c4676ad79737ac, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:00.856082 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c9603-3b07-4567-8728-8b2a7b907c14 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:00.884885 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 122/262] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:31:00 2022] PUT /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b/users/92f9e60150a84d9b94c4676ad79737ac/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:31:00.890875 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c9603-3b07-4567-8728-8b2a7b907c14 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:00.944013 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ae873-c5d5-467e-9968-e6e735b009be None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:01.015618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7bf57-fb06-4a63-af2d-f5848e5445a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:01.016836 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7bf57-fb06-4a63-af2d-f5848e5445a2 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:01.019706 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7bf57-fb06-4a63-af2d-f5848e5445a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:01.020252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7bf57-fb06-4a63-af2d-f5848e5445a2 None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:01.026987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7bf57-fb06-4a63-af2d-f5848e5445a2 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc5711794744f1c9ccc1b886cc1a21b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:01.028861 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7bf57-fb06-4a63-af2d-f5848e5445a2 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:01.034784 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 141/263] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:31:00 2022] GET /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b => generated 302 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:01.052645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7bf57-fb06-4a63-af2d-f5848e5445a2 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:01.144076 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c9603-3b07-4567-8728-8b2a7b907c14 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:01.180178 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:01.222503 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a968c-951e-4095-93a1-beb8db59cdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:01.223410 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a968c-951e-4095-93a1-beb8db59cdb9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:01.223785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a968c-951e-4095-93a1-beb8db59cdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:01.224173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a968c-951e-4095-93a1-beb8db59cdb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:01.224938 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a968c-951e-4095-93a1-beb8db59cdb9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:01.226294 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a968c-951e-4095-93a1-beb8db59cdb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:01.230580 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a968c-951e-4095-93a1-beb8db59cdb9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:01.241992 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 123/264] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:01.248523 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a968c-951e-4095-93a1-beb8db59cdb9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:01.330405 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7bf57-fb06-4a63-af2d-f5848e5445a2 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:01.408968 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:01.441135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f4c0f-01a5-47e3-bcdf-073637f67f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:01.444209 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f4c0f-01a5-47e3-bcdf-073637f67f1f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:01.445808 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f4c0f-01a5-47e3-bcdf-073637f67f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:01.447044 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f4c0f-01a5-47e3-bcdf-073637f67f1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:01.447613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a968c-951e-4095-93a1-beb8db59cdb9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:01.449813 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f4c0f-01a5-47e3-bcdf-073637f67f1f None admin] RBAC: Adding query filter params (role.id=0ee2daa9cb3c41fb901603e3d8caf784, scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b, user.id=f0ec0b529deb49969d2ea90c07f4a7ad) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:01.450923 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f4c0f-01a5-47e3-bcdf-073637f67f1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:01.453072 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f4c0f-01a5-47e3-bcdf-073637f67f1f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:01.476992 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 142/265] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:31:01 2022] GET /identity/v3/role_assignments?user.id=f0ec0b529deb49969d2ea90c07f4a7ad&scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b&role.id=0ee2daa9cb3c41fb901603e3d8caf784 => generated 608 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:01.545939 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c94caa-accb-4ed6-80d8-f69783831642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:01.546607 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c94caa-accb-4ed6-80d8-f69783831642 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:01.546894 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c94caa-accb-4ed6-80d8-f69783831642 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:01.547175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c94caa-accb-4ed6-80d8-f69783831642 None admin] PATH_INFO: `/v3/users/f0ec0b529deb49969d2ea90c07f4a7ad` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:01.548450 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c94caa-accb-4ed6-80d8-f69783831642 None admin] RBAC: Authorizing `identity:get_user(user_id=f0ec0b529deb49969d2ea90c07f4a7ad)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:01.549948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c94caa-accb-4ed6-80d8-f69783831642 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:01.551750 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 124/266] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:31:01 2022] GET /identity/v3/users/f0ec0b529deb49969d2ea90c07f4a7ad => generated 283 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:01.558075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f4c0f-01a5-47e3-bcdf-073637f67f1f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:01.720214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f4c0f-01a5-47e3-bcdf-073637f67f1f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:01.761494 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31797658-c518-4e84-92cb-467ba18f7bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:01.762029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31797658-c518-4e84-92cb-467ba18f7bad None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:01.762317 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31797658-c518-4e84-92cb-467ba18f7bad None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:01.762589 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31797658-c518-4e84-92cb-467ba18f7bad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:01.829592 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:01.841410 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31797658-c518-4e84-92cb-467ba18f7bad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:01.842989 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31797658-c518-4e84-92cb-467ba18f7bad None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:01.948854 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 143/267] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:31:01.954310 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c94caa-accb-4ed6-80d8-f69783831642 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:02.011211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:02.083768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c94caa-accb-4ed6-80d8-f69783831642 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:02.125598 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b53052-4379-44bf-b6eb-6a607d694e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:02.126338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b53052-4379-44bf-b6eb-6a607d694e40 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:02.126628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b53052-4379-44bf-b6eb-6a607d694e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:02.126901 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b53052-4379-44bf-b6eb-6a607d694e40 None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:02.128153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b53052-4379-44bf-b6eb-6a607d694e40 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc5711794744f1c9ccc1b886cc1a21b)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:02.129734 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b53052-4379-44bf-b6eb-6a607d694e40 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:02.131667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 125/268] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:31:01 2022] GET /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:02.137940 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31797658-c518-4e84-92cb-467ba18f7bad None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:02.239736 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:02.252952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31797658-c518-4e84-92cb-467ba18f7bad None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:02.265846 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628083b-a561-469f-a656-5af8224551f1 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:02.266442 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628083b-a561-469f-a656-5af8224551f1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:02.266934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628083b-a561-469f-a656-5af8224551f1 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:02.268471 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 126/269] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:31:02.274385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f3a24-60bd-451f-be01-869d1da9bfa4 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:02.274742 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f3a24-60bd-451f-be01-869d1da9bfa4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:02.275091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f3a24-60bd-451f-be01-869d1da9bfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:02.307462 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5d3f3a24-60bd-451f-be01-869d1da9bfa4 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:02.308660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5d3f3a24-60bd-451f-be01-869d1da9bfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:02.317934 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f867c8-886a-4e77-a5b8-bc0ad2b36f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:02.318548 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f867c8-886a-4e77-a5b8-bc0ad2b36f06 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:02.318827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f867c8-886a-4e77-a5b8-bc0ad2b36f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:02.319093 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f867c8-886a-4e77-a5b8-bc0ad2b36f06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:02.319820 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f867c8-886a-4e77-a5b8-bc0ad2b36f06 None admin] RBAC: Adding query filter params (role.id=1c9b176504fd4d24b34942f724e63acf, scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b, user.id=f0ec0b529deb49969d2ea90c07f4a7ad) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:02.320128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f867c8-886a-4e77-a5b8-bc0ad2b36f06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:02.323252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f867c8-886a-4e77-a5b8-bc0ad2b36f06 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:02.337669 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 144/270] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:31:02 2022] GET /identity/v3/role_assignments?user.id=f0ec0b529deb49969d2ea90c07f4a7ad&scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b&role.id=1c9b176504fd4d24b34942f724e63acf => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:02.360240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f10420-4eca-4fe7-9bd6-d532bfaa1240 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:02.360551 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f10420-4eca-4fe7-9bd6-d532bfaa1240 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:02.360783 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f10420-4eca-4fe7-9bd6-d532bfaa1240 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:02.362297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 145/271] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:31:02.371851 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9f0d0-3411-43a8-8195-1e2f47838cd5 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:02.372183 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9f0d0-3411-43a8-8195-1e2f47838cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:02.372455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9f0d0-3411-43a8-8195-1e2f47838cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:02.409657 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-32c9f0d0-3411-43a8-8195-1e2f47838cd5 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:02.410900 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-32c9f0d0-3411-43a8-8195-1e2f47838cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:02.480288 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 127/272] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:31:02.534863 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 146/273] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 15 00:31:02.754876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1acc5-9e50-45a6-b127-03e9eec27784 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:02.755228 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1acc5-9e50-45a6-b127-03e9eec27784 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:02.755411 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1acc5-9e50-45a6-b127-03e9eec27784 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:02.756868 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 128/274] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:02.763132 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88312907-501c-4a94-8724-38efb9bbfa96 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:02.763961 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88312907-501c-4a94-8724-38efb9bbfa96 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:02.764431 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88312907-501c-4a94-8724-38efb9bbfa96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:02.784276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-88312907-501c-4a94-8724-38efb9bbfa96 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:02.785774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-88312907-501c-4a94-8724-38efb9bbfa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:02.796147 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1acc5-9e50-45a6-b127-03e9eec27784 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:02.861149 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:02.877665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 147/275] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:02.878606 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88312907-501c-4a94-8724-38efb9bbfa96 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:02.894646 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:02.943614 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1acc5-9e50-45a6-b127-03e9eec27784 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:02.988208 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6640dc-6ede-4084-84ed-2b9815c565d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:02.988815 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6640dc-6ede-4084-84ed-2b9815c565d6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:02.989096 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6640dc-6ede-4084-84ed-2b9815c565d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:02.989391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6640dc-6ede-4084-84ed-2b9815c565d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:02.996231 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88312907-501c-4a94-8724-38efb9bbfa96 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:02.999618 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6640dc-6ede-4084-84ed-2b9815c565d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:03.004427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-df6640dc-6ede-4084-84ed-2b9815c565d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 00:31:03.004427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:03.004427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:03.004427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:03.004427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:03.004427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:03.004427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:03.004427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:03.004427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:03.004427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:03.004427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:03.004427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:03.004427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:03.004427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:03.004427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:03.004427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:03.005391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:03.005391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:03.005391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:03.005391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:03.005391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:03.005391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:03.005391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:03.005391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:03.005391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:03.005391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:03.005391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:03.005391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:03.005391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:03.005391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:03.005391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:03.005391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:03.006409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:03.006409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:03.006409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:03.006409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:03.006409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:03.006409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:03.006409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:03.006409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:03.006409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:03.006409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:03.006409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 00:31:03.006409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:03.006409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 129/276] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:03.011913 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6640dc-6ede-4084-84ed-2b9815c565d6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:03.045597 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60becdb4-57c8-4d8f-8fd1-973fb84c7b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:03.046233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60becdb4-57c8-4d8f-8fd1-973fb84c7b72 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:03.046514 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60becdb4-57c8-4d8f-8fd1-973fb84c7b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:03.047048 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60becdb4-57c8-4d8f-8fd1-973fb84c7b72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:03.060959 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60becdb4-57c8-4d8f-8fd1-973fb84c7b72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:03.067899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-60becdb4-57c8-4d8f-8fd1-973fb84c7b72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:31:03.067899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:03.067899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:03.067899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:03.067899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:03.067899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:03.067899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:03.067899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:03.067899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:03.067899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:03.067899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:03.067899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:03.067899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:03.067899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:03.067899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:03.067899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:03.069939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:03.069939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:03.069939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:03.069939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:03.069939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:03.069939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:03.069939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:03.069939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:03.069939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:03.069939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:03.069939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:03.069939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:03.069939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:03.069939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:03.069939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:03.069939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:03.071490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:03.071490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:03.071490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:03.071490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:03.071490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:03.071490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:03.071490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:03.071490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:03.071490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:03.071490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:03.071490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:31:03.071490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:03.073655 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 148/277] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:03.077119 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60becdb4-57c8-4d8f-8fd1-973fb84c7b72 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:03.130680 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6640dc-6ede-4084-84ed-2b9815c565d6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:03.132180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:03.165605 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:03.168760 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06122772-eb88-4d12-b1a2-a5301b69b2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:03.169388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06122772-eb88-4d12-b1a2-a5301b69b2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:03.169666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06122772-eb88-4d12-b1a2-a5301b69b2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:03.169936 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06122772-eb88-4d12-b1a2-a5301b69b2d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:03.171029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06122772-eb88-4d12-b1a2-a5301b69b2d7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:03.171337 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06122772-eb88-4d12-b1a2-a5301b69b2d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:03.172720 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06122772-eb88-4d12-b1a2-a5301b69b2d7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:03.186815 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 130/278] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:31:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:03.187691 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06122772-eb88-4d12-b1a2-a5301b69b2d7 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:03.199460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60becdb4-57c8-4d8f-8fd1-973fb84c7b72 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:03.237336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e53d0a-1e59-45dc-aa59-1c23c3cb5de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:03.237949 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e53d0a-1e59-45dc-aa59-1c23c3cb5de7 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:03.238226 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e53d0a-1e59-45dc-aa59-1c23c3cb5de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:03.238494 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e53d0a-1e59-45dc-aa59-1c23c3cb5de7 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:03.239155 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e53d0a-1e59-45dc-aa59-1c23c3cb5de7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:03.239458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e53d0a-1e59-45dc-aa59-1c23c3cb5de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:03.240816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e53d0a-1e59-45dc-aa59-1c23c3cb5de7 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:03.254286 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 149/279] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:31:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:03.254957 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e53d0a-1e59-45dc-aa59-1c23c3cb5de7 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:03.295971 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06122772-eb88-4d12-b1a2-a5301b69b2d7 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:03.340339 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5751426-7e44-4872-9ae4-ba23b2a19e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:03.340339 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5751426-7e44-4872-9ae4-ba23b2a19e72 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:03.340339 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5751426-7e44-4872-9ae4-ba23b2a19e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:03.340339 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5751426-7e44-4872-9ae4-ba23b2a19e72 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:03.341157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5751426-7e44-4872-9ae4-ba23b2a19e72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:03.342637 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5751426-7e44-4872-9ae4-ba23b2a19e72 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:03.345395 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 131/280] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:03.346614 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5751426-7e44-4872-9ae4-ba23b2a19e72 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:03.371583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e53d0a-1e59-45dc-aa59-1c23c3cb5de7 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:03.380527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:03.409390 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222f3ba-710e-4718-9f41-1ececfd3c785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:03.410017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222f3ba-710e-4718-9f41-1ececfd3c785 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:03.410296 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222f3ba-710e-4718-9f41-1ececfd3c785 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:03.410594 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222f3ba-710e-4718-9f41-1ececfd3c785 None admin] PATH_INFO: `/v3/users/711ea36977e14195b21e7b2114dad4d1` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:03.411682 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222f3ba-710e-4718-9f41-1ececfd3c785 None admin] RBAC: Authorizing `identity:get_user(user_id=711ea36977e14195b21e7b2114dad4d1)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:03.413639 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222f3ba-710e-4718-9f41-1ececfd3c785 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:03.415471 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 150/281] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:31:03 2022] GET /identity/v3/users/711ea36977e14195b21e7b2114dad4d1 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:03.415962 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222f3ba-710e-4718-9f41-1ececfd3c785 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:03.418605 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:03.457919 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5751426-7e44-4872-9ae4-ba23b2a19e72 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:03.492245 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804e6f6-7304-44a5-9f44-630468a4a6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:03.492870 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804e6f6-7304-44a5-9f44-630468a4a6ad None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:03.493708 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804e6f6-7304-44a5-9f44-630468a4a6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:03.493977 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804e6f6-7304-44a5-9f44-630468a4a6ad None admin] PATH_INFO: `/v3/users/3b8381a853f34259ae73dadcbad577ed` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:03.506689 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804e6f6-7304-44a5-9f44-630468a4a6ad None admin] RBAC: Authorizing `identity:get_user(user_id=3b8381a853f34259ae73dadcbad577ed)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:03.508127 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804e6f6-7304-44a5-9f44-630468a4a6ad None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:03.514942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 132/282] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:31:03 2022] GET /identity/v3/users/3b8381a853f34259ae73dadcbad577ed => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:03.514942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804e6f6-7304-44a5-9f44-630468a4a6ad None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:03.535939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222f3ba-710e-4718-9f41-1ececfd3c785 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:03.572432 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16a918-07c2-4f91-93d9-3c0986ec3669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:03.573136 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16a918-07c2-4f91-93d9-3c0986ec3669 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:03.573720 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16a918-07c2-4f91-93d9-3c0986ec3669 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:03.573823 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16a918-07c2-4f91-93d9-3c0986ec3669 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:03.574431 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16a918-07c2-4f91-93d9-3c0986ec3669 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:03.575970 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16a918-07c2-4f91-93d9-3c0986ec3669 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:03.605132 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 151/283] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 15 00:31:03 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:31:03.605132 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16a918-07c2-4f91-93d9-3c0986ec3669 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:03.605422 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:03.623377 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804e6f6-7304-44a5-9f44-630468a4a6ad None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:03.674566 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:03.677310 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2416859-0265-4390-ac3f-6c23c6861ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:03.677980 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2416859-0265-4390-ac3f-6c23c6861ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:03.678259 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2416859-0265-4390-ac3f-6c23c6861ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:03.679007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2416859-0265-4390-ac3f-6c23c6861ce9 None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:03.683131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2416859-0265-4390-ac3f-6c23c6861ce9 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc5711794744f1c9ccc1b886cc1a21b)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:03.684689 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2416859-0265-4390-ac3f-6c23c6861ce9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:03.687105 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 133/284] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:31:03 2022] GET /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:03.693175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2416859-0265-4390-ac3f-6c23c6861ce9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:03.743660 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16a918-07c2-4f91-93d9-3c0986ec3669 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:03.789441 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9981b5a-c67d-433b-8bbd-de507d5b3d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:03.791009 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9981b5a-c67d-433b-8bbd-de507d5b3d13 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:03.791567 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9981b5a-c67d-433b-8bbd-de507d5b3d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:03.792058 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9981b5a-c67d-433b-8bbd-de507d5b3d13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:03.792977 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9981b5a-c67d-433b-8bbd-de507d5b3d13 None admin] RBAC: Adding query filter params (role.id=24171c44541e4c4782ec7d3f03b50467, user.id=3b8381a853f34259ae73dadcbad577ed, scope.system=all) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:03.793516 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9981b5a-c67d-433b-8bbd-de507d5b3d13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:03.795255 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9981b5a-c67d-433b-8bbd-de507d5b3d13 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:03.802479 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 152/285] 10.222.0.52 () {56 vars in 1308 bytes} [Thu Sep 15 00:31:03 2022] GET /identity/v3/role_assignments?user.id=3b8381a853f34259ae73dadcbad577ed&scope.system=all&role.id=24171c44541e4c4782ec7d3f03b50467 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:03.813521 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec1b19-ed35-4e1f-aa88-5ac0f998bed0 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:03.813835 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec1b19-ed35-4e1f-aa88-5ac0f998bed0 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:03.814086 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec1b19-ed35-4e1f-aa88-5ac0f998bed0 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:03.815630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 153/286] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:31:03.816584 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2416859-0265-4390-ac3f-6c23c6861ce9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:03.821944 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad87a21-e625-482d-a408-1e8b8647dc0f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:03.822234 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad87a21-e625-482d-a408-1e8b8647dc0f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:03.822566 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad87a21-e625-482d-a408-1e8b8647dc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:03.842964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2ad87a21-e625-482d-a408-1e8b8647dc0f None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:03.844201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2ad87a21-e625-482d-a408-1e8b8647dc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:03.863134 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bb091-bf73-4e76-a3fc-f4f0acfeb3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:03.863813 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bb091-bf73-4e76-a3fc-f4f0acfeb3c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:03.864096 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bb091-bf73-4e76-a3fc-f4f0acfeb3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:03.864367 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bb091-bf73-4e76-a3fc-f4f0acfeb3c6 None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b/users/711ea36977e14195b21e7b2114dad4d1/roles/995303a8ffbd4ff2a1e28bbd53e9391e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:03.866655 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bb091-bf73-4e76-a3fc-f4f0acfeb3c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cc5711794744f1c9ccc1b886cc1a21b, user_id=711ea36977e14195b21e7b2114dad4d1, role_id=995303a8ffbd4ff2a1e28bbd53e9391e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:03.869652 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bb091-bf73-4e76-a3fc-f4f0acfeb3c6 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:03.888659 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 134/287] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:31:03 2022] PUT /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b/users/711ea36977e14195b21e7b2114dad4d1/roles/995303a8ffbd4ff2a1e28bbd53e9391e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:31:03.938522 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 154/288] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:31:04.220718 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bb091-bf73-4e76-a3fc-f4f0acfeb3c6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:04.243005 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:04.346445 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bb091-bf73-4e76-a3fc-f4f0acfeb3c6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:04.406341 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa48a6-b484-4b10-943d-da7b519d1934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:04.406981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa48a6-b484-4b10-943d-da7b519d1934 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:04.407261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa48a6-b484-4b10-943d-da7b519d1934 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:04.407530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa48a6-b484-4b10-943d-da7b519d1934 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:04.419097 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa48a6-b484-4b10-943d-da7b519d1934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:04.423915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-7cfa48a6-b484-4b10-943d-da7b519d1934 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:31:04.423915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:04.423915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:04.423915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:04.423915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:04.423915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:04.423915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:04.423915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:04.423915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:04.423915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:04.423915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:04.423915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:04.423915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:04.423915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:04.423915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:04.423915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:04.424779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:04.424779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:04.424779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:04.424779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:04.424779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:04.424779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:04.424779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:04.424779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:04.424779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:04.424779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:04.424779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:04.424779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:04.424779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:04.424779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:04.424779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:04.424779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:04.426075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:04.426075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:04.426075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:04.426075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:04.426075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:04.426075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:04.426075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:04.426075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:04.426075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:04.426075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:04.426075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:31:04.426075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:04.426075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 135/289] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:04.433389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad87a21-e625-482d-a408-1e8b8647dc0f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:04.501592 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:04.553165 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad87a21-e625-482d-a408-1e8b8647dc0f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:04.596327 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dbaa4-7a58-468c-a4b5-dbc33527107d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:04.596938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dbaa4-7a58-468c-a4b5-dbc33527107d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:04.597242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dbaa4-7a58-468c-a4b5-dbc33527107d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:04.597512 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dbaa4-7a58-468c-a4b5-dbc33527107d None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:04.598177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dbaa4-7a58-468c-a4b5-dbc33527107d None admin] RBAC: Adding query filter params (name=member) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:04.598477 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dbaa4-7a58-468c-a4b5-dbc33527107d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:04.599822 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dbaa4-7a58-468c-a4b5-dbc33527107d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:04.610894 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 155/290] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:31:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:04.617126 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa48a6-b484-4b10-943d-da7b519d1934 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:04.737539 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:04.764051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa48a6-b484-4b10-943d-da7b519d1934 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:04.809414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc52293-2a76-4027-9887-dcbfed9a4a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:04.810091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc52293-2a76-4027-9887-dcbfed9a4a6f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:04.810372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc52293-2a76-4027-9887-dcbfed9a4a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:04.810644 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc52293-2a76-4027-9887-dcbfed9a4a6f None admin] PATH_INFO: `/v3/users/92f9e60150a84d9b94c4676ad79737ac` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:04.811772 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc52293-2a76-4027-9887-dcbfed9a4a6f None admin] RBAC: Authorizing `identity:get_user(user_id=92f9e60150a84d9b94c4676ad79737ac)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:04.813266 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc52293-2a76-4027-9887-dcbfed9a4a6f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:04.814829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 136/291] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:31:04 2022] GET /identity/v3/users/92f9e60150a84d9b94c4676ad79737ac => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:04.820930 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dbaa4-7a58-468c-a4b5-dbc33527107d None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:04.943901 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dbaa4-7a58-468c-a4b5-dbc33527107d None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:04.964616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:04.991821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0a495-f885-4396-9e4a-d3a7d78febf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:04.992434 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0a495-f885-4396-9e4a-d3a7d78febf5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:04.992712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0a495-f885-4396-9e4a-d3a7d78febf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:04.993024 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0a495-f885-4396-9e4a-d3a7d78febf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:05.088881 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0a495-f885-4396-9e4a-d3a7d78febf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:05.090392 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0a495-f885-4396-9e4a-d3a7d78febf5 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:05.221896 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 156/292] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:31:05.228581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc52293-2a76-4027-9887-dcbfed9a4a6f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:05.388020 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc52293-2a76-4027-9887-dcbfed9a4a6f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:05.436483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f0636-414b-4100-a4b1-e7b524fe8a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:05.437138 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f0636-414b-4100-a4b1-e7b524fe8a0c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:05.437422 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f0636-414b-4100-a4b1-e7b524fe8a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:05.437692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f0636-414b-4100-a4b1-e7b524fe8a0c None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:05.441759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f0636-414b-4100-a4b1-e7b524fe8a0c None admin] RBAC: Authorizing `identity:get_project(project_id=7cc5711794744f1c9ccc1b886cc1a21b)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:05.443229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f0636-414b-4100-a4b1-e7b524fe8a0c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:05.445191 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 137/293] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:31:05 2022] GET /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:05.451799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0a495-f885-4396-9e4a-d3a7d78febf5 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:05.467671 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:05.566217 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0a495-f885-4396-9e4a-d3a7d78febf5 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:05.615602 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3d432-a72b-4b78-b791-1f5ad1991bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:05.616133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3d432-a72b-4b78-b791-1f5ad1991bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:05.616410 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3d432-a72b-4b78-b791-1f5ad1991bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:05.616680 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3d432-a72b-4b78-b791-1f5ad1991bf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:05.617425 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3d432-a72b-4b78-b791-1f5ad1991bf3 None admin] RBAC: Adding query filter params (role.id=24171c44541e4c4782ec7d3f03b50467, scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b, user.id=92f9e60150a84d9b94c4676ad79737ac) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:05.617731 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3d432-a72b-4b78-b791-1f5ad1991bf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:05.619229 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3d432-a72b-4b78-b791-1f5ad1991bf3 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:05.629394 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 157/294] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:31:05 2022] GET /identity/v3/role_assignments?user.id=92f9e60150a84d9b94c4676ad79737ac&scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b&role.id=24171c44541e4c4782ec7d3f03b50467 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:06.363618 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd2883-ff80-4b39-a4e3-5296462047f1 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:06.364158 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd2883-ff80-4b39-a4e3-5296462047f1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:06.364158 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd2883-ff80-4b39-a4e3-5296462047f1 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:06.365961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 138/295] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:06.372331 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6d2d1-808d-49f3-aa34-7ed2290a8a99 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:06.373338 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6d2d1-808d-49f3-aa34-7ed2290a8a99 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:06.373814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6d2d1-808d-49f3-aa34-7ed2290a8a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:06.393987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-11f6d2d1-808d-49f3-aa34-7ed2290a8a99 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:06.395531 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-11f6d2d1-808d-49f3-aa34-7ed2290a8a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:06.453999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c759c5-8e88-4124-920d-a7a6d2d0e741 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:06.454313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c759c5-8e88-4124-920d-a7a6d2d0e741 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:06.454539 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c759c5-8e88-4124-920d-a7a6d2d0e741 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:06.455886 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 139/296] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:31:06.460824 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc27a8-dd41-46f7-8c34-af5e882638c4 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:06.461124 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc27a8-dd41-46f7-8c34-af5e882638c4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:06.461439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc27a8-dd41-46f7-8c34-af5e882638c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:06.468672 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 158/297] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:06.480737 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c6fc27a8-dd41-46f7-8c34-af5e882638c4 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:06.481956 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c6fc27a8-dd41-46f7-8c34-af5e882638c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:06.492046 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:06.503317 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f19e2-9487-43a4-bcca-558f84f7ff7d None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:06.503599 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f19e2-9487-43a4-bcca-558f84f7ff7d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:06.503871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f19e2-9487-43a4-bcca-558f84f7ff7d None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:06.505217 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 159/298] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:31:06.511029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df21ee1-eb5f-45c6-b067-c42aac3003cf None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:06.511315 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df21ee1-eb5f-45c6-b067-c42aac3003cf None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:06.511588 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df21ee1-eb5f-45c6-b067-c42aac3003cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:06.531271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-1df21ee1-eb5f-45c6-b067-c42aac3003cf None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:06.532707 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1df21ee1-eb5f-45c6-b067-c42aac3003cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:06.537310 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:06.554945 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 140/299] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:31:06.603505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 160/300] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:31:06.744842 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc27a8-dd41-46f7-8c34-af5e882638c4 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:06.782447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b97478-b927-4e0d-a6a5-f8247d113e25 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:06.782752 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b97478-b927-4e0d-a6a5-f8247d113e25 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:06.783000 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b97478-b927-4e0d-a6a5-f8247d113e25 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:06.784588 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 161/301] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:06.789442 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce78cd6-f5b9-4f84-a776-544bd8586651 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:06.789708 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce78cd6-f5b9-4f84-a776-544bd8586651 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:06.790604 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce78cd6-f5b9-4f84-a776-544bd8586651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:06.811040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-bce78cd6-f5b9-4f84-a776-544bd8586651 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:06.812213 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-bce78cd6-f5b9-4f84-a776-544bd8586651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:06.854753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc27a8-dd41-46f7-8c34-af5e882638c4 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:06.889656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 162/302] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:31:06.890461 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce78cd6-f5b9-4f84-a776-544bd8586651 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:06.890582 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38dff9-2a4f-4856-bea7-92180c345616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:06.891089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38dff9-2a4f-4856-bea7-92180c345616 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:06.891369 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38dff9-2a4f-4856-bea7-92180c345616 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:06.891636 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38dff9-2a4f-4856-bea7-92180c345616 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:06.902782 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38dff9-2a4f-4856-bea7-92180c345616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:06.907597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-dc38dff9-2a4f-4856-bea7-92180c345616 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 00:31:06.907597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:06.907597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:06.907597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:06.907597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:06.907597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:06.907597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:06.907597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:06.907597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:06.907597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:06.907597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:06.907597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:06.907597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:06.907597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:06.907597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:06.907597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:06.908489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:06.908489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:06.908489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:06.908489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:06.908489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:06.908489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:06.908489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:06.908489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:06.908489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:06.908489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:06.908489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:06.908489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:06.908489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:06.908489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:06.908489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:06.908489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:06.909301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:06.909301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:06.909301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:06.909301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:06.909301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:06.909301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:06.909301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:06.909301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:06.909301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:06.909301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:06.909301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 00:31:06.909301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:06.909301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 141/303] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:06.909943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38dff9-2a4f-4856-bea7-92180c345616 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:06.917523 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:06.963346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:06.996505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce78cd6-f5b9-4f84-a776-544bd8586651 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:07.022348 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38dff9-2a4f-4856-bea7-92180c345616 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:07.031104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49d6fe-ab44-49a5-a41a-52b7b777519e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:07.031728 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49d6fe-ab44-49a5-a41a-52b7b777519e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:07.032055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49d6fe-ab44-49a5-a41a-52b7b777519e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:07.032334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49d6fe-ab44-49a5-a41a-52b7b777519e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:07.043166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49d6fe-ab44-49a5-a41a-52b7b777519e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:07.048414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-2f49d6fe-ab44-49a5-a41a-52b7b777519e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:31:07.048414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:07.048414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:07.048414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:07.048414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:07.048414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:07.048414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:07.048414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:07.048414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:07.048414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:07.048414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:07.048414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:07.048414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:07.048414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:07.048414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:07.048414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:07.049328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:07.049328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:07.049328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:07.049328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:07.049328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:07.049328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:07.049328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:07.049328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:07.049328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:07.049328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:07.049328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:07.049328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:07.049328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:07.049328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:07.049328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:07.049328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:07.050168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:07.050168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:07.050168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:07.050168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:07.050168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:07.050168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:07.050168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:07.050168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:07.050168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:07.050168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:07.050168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:31:07.050168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:07.050168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 163/304] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:07.050905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49d6fe-ab44-49a5-a41a-52b7b777519e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:07.062459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87dbdf-9007-4450-a887-874a2fed90cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:07.063076 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87dbdf-9007-4450-a887-874a2fed90cd None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:07.063347 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87dbdf-9007-4450-a887-874a2fed90cd None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:07.063610 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87dbdf-9007-4450-a887-874a2fed90cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:07.064699 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87dbdf-9007-4450-a887-874a2fed90cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:07.066169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87dbdf-9007-4450-a887-874a2fed90cd None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:07.067698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 142/305] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:07.068441 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87dbdf-9007-4450-a887-874a2fed90cd None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:07.142739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:07.168792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49d6fe-ab44-49a5-a41a-52b7b777519e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:07.172734 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87dbdf-9007-4450-a887-874a2fed90cd None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:07.195079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:07.203876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da84d5e-0749-45a2-a98e-2a39995071b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:07.204488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da84d5e-0749-45a2-a98e-2a39995071b0 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:07.204765 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da84d5e-0749-45a2-a98e-2a39995071b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:07.205036 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da84d5e-0749-45a2-a98e-2a39995071b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:07.205463 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33983f33-8a6e-437a-8b5e-f64e10a68b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:07.205727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da84d5e-0749-45a2-a98e-2a39995071b0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:07.206030 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da84d5e-0749-45a2-a98e-2a39995071b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:07.206122 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33983f33-8a6e-437a-8b5e-f64e10a68b2b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:07.206372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33983f33-8a6e-437a-8b5e-f64e10a68b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:07.206648 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33983f33-8a6e-437a-8b5e-f64e10a68b2b None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:07.207311 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33983f33-8a6e-437a-8b5e-f64e10a68b2b None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:07.207396 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da84d5e-0749-45a2-a98e-2a39995071b0 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:07.207614 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33983f33-8a6e-437a-8b5e-f64e10a68b2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:07.208967 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33983f33-8a6e-437a-8b5e-f64e10a68b2b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:07.216003 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 164/306] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:31:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:07.216770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da84d5e-0749-45a2-a98e-2a39995071b0 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:07.227225 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 143/307] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:31:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:07.227225 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33983f33-8a6e-437a-8b5e-f64e10a68b2b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:07.315763 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da84d5e-0749-45a2-a98e-2a39995071b0 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:07.323456 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33983f33-8a6e-437a-8b5e-f64e10a68b2b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:07.353529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5d786-5097-43be-a447-4d6ede77d138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:07.354138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5d786-5097-43be-a447-4d6ede77d138 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:07.354417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5d786-5097-43be-a447-4d6ede77d138 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:07.354689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5d786-5097-43be-a447-4d6ede77d138 None admin] PATH_INFO: `/v3/groups` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:07.355364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5d786-5097-43be-a447-4d6ede77d138 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:07.356453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83162954-fd88-4251-bb0c-b7d5e399003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:07.356734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5d786-5097-43be-a447-4d6ede77d138 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:07.357077 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83162954-fd88-4251-bb0c-b7d5e399003c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:07.357381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83162954-fd88-4251-bb0c-b7d5e399003c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:07.357652 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83162954-fd88-4251-bb0c-b7d5e399003c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:07.359739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:07.369947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83162954-fd88-4251-bb0c-b7d5e399003c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:07.373047 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 165/308] 10.222.0.52 () {60 vars in 1134 bytes} [Thu Sep 15 00:31:07 2022] POST /identity/v3/groups => generated 229 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:31:07.373879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5d786-5097-43be-a447-4d6ede77d138 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:07.375458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-83162954-fd88-4251-bb0c-b7d5e399003c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 00:31:07.375458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:07.375458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:07.375458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:07.375458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:07.375458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:07.375458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:07.375458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:07.375458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:07.375458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:07.375458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:07.375458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:07.375458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:07.375458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:07.375458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:07.375458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:07.376352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:07.376352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:07.376352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:07.376352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:07.376352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:07.376352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:07.376352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:07.376352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:07.376352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:07.376352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:07.376352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:07.376352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:07.376352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:07.376352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:07.376352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:07.376352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:07.377168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:07.377168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:07.377168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:07.377168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:07.377168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:07.377168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:07.377168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:07.377168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:07.377168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:07.377168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:07.377168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 00:31:07.377168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:07.377168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 144/309] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:07.377826 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83162954-fd88-4251-bb0c-b7d5e399003c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:07.442466 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:07.499791 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5d786-5097-43be-a447-4d6ede77d138 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:07.500285 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83162954-fd88-4251-bb0c-b7d5e399003c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:07.538228 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93faff99-e3f9-4760-b58f-4c0d5babe81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:07.538870 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93faff99-e3f9-4760-b58f-4c0d5babe81e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:07.539148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93faff99-e3f9-4760-b58f-4c0d5babe81e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:07.539420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93faff99-e3f9-4760-b58f-4c0d5babe81e None admin] PATH_INFO: `/v3/users/3b8381a853f34259ae73dadcbad577ed` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:07.540617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93faff99-e3f9-4760-b58f-4c0d5babe81e None admin] RBAC: Authorizing `identity:get_user(user_id=3b8381a853f34259ae73dadcbad577ed)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:07.542113 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93faff99-e3f9-4760-b58f-4c0d5babe81e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:07.542575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae726bb-e6be-4be1-b2a3-5628a4b60567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:07.543207 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae726bb-e6be-4be1-b2a3-5628a4b60567 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:07.543483 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae726bb-e6be-4be1-b2a3-5628a4b60567 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:07.543751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae726bb-e6be-4be1-b2a3-5628a4b60567 None admin] PATH_INFO: `/v3/users/e74d465195d04a53b3c391cf7e50b272` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:07.544005 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 145/310] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:31:07 2022] GET /identity/v3/users/3b8381a853f34259ae73dadcbad577ed => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:07.544765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93faff99-e3f9-4760-b58f-4c0d5babe81e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:07.566114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae726bb-e6be-4be1-b2a3-5628a4b60567 None admin] RBAC: Authorizing `identity:get_user(user_id=e74d465195d04a53b3c391cf7e50b272)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:07.568012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae726bb-e6be-4be1-b2a3-5628a4b60567 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:07.570046 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 166/311] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:31:07 2022] GET /identity/v3/users/e74d465195d04a53b3c391cf7e50b272 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:07.570767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae726bb-e6be-4be1-b2a3-5628a4b60567 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:07.612407 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:07.653913 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93faff99-e3f9-4760-b58f-4c0d5babe81e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:07.682012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae726bb-e6be-4be1-b2a3-5628a4b60567 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:07.690616 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e80f49-6056-4fee-9240-dcdbad6eaffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:07.691210 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e80f49-6056-4fee-9240-dcdbad6eaffa None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:07.691713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e80f49-6056-4fee-9240-dcdbad6eaffa None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:07.691713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e80f49-6056-4fee-9240-dcdbad6eaffa None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:07.692381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e80f49-6056-4fee-9240-dcdbad6eaffa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:07.692731 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e80f49-6056-4fee-9240-dcdbad6eaffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:07.693477 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:07.694146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e80f49-6056-4fee-9240-dcdbad6eaffa None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:07.707678 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 146/312] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:31:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:07.707678 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e80f49-6056-4fee-9240-dcdbad6eaffa None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:07.724393 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b6c81-cfb2-444f-abd8-04de75a19120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:07.725228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b6c81-cfb2-444f-abd8-04de75a19120 None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:07.725511 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b6c81-cfb2-444f-abd8-04de75a19120 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:07.725787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b6c81-cfb2-444f-abd8-04de75a19120 None admin] PATH_INFO: `/v3/system/users/3b8381a853f34259ae73dadcbad577ed/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:07.727828 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b6c81-cfb2-444f-abd8-04de75a19120 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3b8381a853f34259ae73dadcbad577ed, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:07.729230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b6c81-cfb2-444f-abd8-04de75a19120 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:07.739444 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 167/313] 10.222.0.52 () {58 vars in 1334 bytes} [Thu Sep 15 00:31:07 2022] PUT /identity/v3/system/users/3b8381a853f34259ae73dadcbad577ed/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:31:07.740174 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b6c81-cfb2-444f-abd8-04de75a19120 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:07.821244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e80f49-6056-4fee-9240-dcdbad6eaffa None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:07.847618 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:07.860534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063b70b-4ff8-4d46-845a-fb4b29c43a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:07.860897 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063b70b-4ff8-4d46-845a-fb4b29c43a33 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:07.861201 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063b70b-4ff8-4d46-845a-fb4b29c43a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:07.861471 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063b70b-4ff8-4d46-845a-fb4b29c43a33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:07.862367 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063b70b-4ff8-4d46-845a-fb4b29c43a33 None admin] RBAC: Adding query filter params (role.id=995303a8ffbd4ff2a1e28bbd53e9391e, user.id=e74d465195d04a53b3c391cf7e50b272, scope.system=all) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:07.862664 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063b70b-4ff8-4d46-845a-fb4b29c43a33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:07.864220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063b70b-4ff8-4d46-845a-fb4b29c43a33 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:07.870703 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 147/314] 10.222.0.52 () {56 vars in 1308 bytes} [Thu Sep 15 00:31:07 2022] GET /identity/v3/role_assignments?user.id=e74d465195d04a53b3c391cf7e50b272&scope.system=all&role.id=995303a8ffbd4ff2a1e28bbd53e9391e => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:07.885831 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b6c81-cfb2-444f-abd8-04de75a19120 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:07.929622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f70d90-382a-4a3b-b9c2-88cd1bdc52d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:07.931190 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f70d90-382a-4a3b-b9c2-88cd1bdc52d9 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:07.931467 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f70d90-382a-4a3b-b9c2-88cd1bdc52d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:07.931738 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f70d90-382a-4a3b-b9c2-88cd1bdc52d9 None admin] PATH_INFO: `/v3/users/711ea36977e14195b21e7b2114dad4d1` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:07.933009 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f70d90-382a-4a3b-b9c2-88cd1bdc52d9 None admin] RBAC: Authorizing `identity:get_user(user_id=711ea36977e14195b21e7b2114dad4d1)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:07.934524 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f70d90-382a-4a3b-b9c2-88cd1bdc52d9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:07.936469 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 168/315] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:31:07 2022] GET /identity/v3/users/711ea36977e14195b21e7b2114dad4d1 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:07.942189 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063b70b-4ff8-4d46-845a-fb4b29c43a33 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:08.063124 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063b70b-4ff8-4d46-845a-fb4b29c43a33 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:08.100945 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9b1ad-d712-4bf3-956b-2f603a310cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:08.101586 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9b1ad-d712-4bf3-956b-2f603a310cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:08.101862 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9b1ad-d712-4bf3-956b-2f603a310cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:08.102135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9b1ad-d712-4bf3-956b-2f603a310cf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:08.161594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:08.176567 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9b1ad-d712-4bf3-956b-2f603a310cf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:08.178099 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9b1ad-d712-4bf3-956b-2f603a310cf3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:08.285902 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 148/316] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:31:08.294235 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f70d90-382a-4a3b-b9c2-88cd1bdc52d9 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:08.342458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:08.406649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f70d90-382a-4a3b-b9c2-88cd1bdc52d9 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:08.441376 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149c0e0-6a94-4283-baed-29bdaf06c26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:08.442096 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c0e0-6a94-4283-baed-29bdaf06c26b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:08.442371 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c0e0-6a94-4283-baed-29bdaf06c26b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:08.442631 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c0e0-6a94-4283-baed-29bdaf06c26b None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:08.443770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149c0e0-6a94-4283-baed-29bdaf06c26b None admin] RBAC: Authorizing `identity:get_project(project_id=7cc5711794744f1c9ccc1b886cc1a21b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:08.445630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149c0e0-6a94-4283-baed-29bdaf06c26b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:08.448931 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 169/317] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:31:08 2022] GET /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:08.458199 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9b1ad-d712-4bf3-956b-2f603a310cf3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:08.548883 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:08.562670 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9b1ad-d712-4bf3-956b-2f603a310cf3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:08.602931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ae688-5df4-4559-8ddf-d0b61d903906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:08.603453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ae688-5df4-4559-8ddf-d0b61d903906 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:08.603734 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ae688-5df4-4559-8ddf-d0b61d903906 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:08.604007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ae688-5df4-4559-8ddf-d0b61d903906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:08.604739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ae688-5df4-4559-8ddf-d0b61d903906 None admin] RBAC: Adding query filter params (role.id=995303a8ffbd4ff2a1e28bbd53e9391e, scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b, user.id=711ea36977e14195b21e7b2114dad4d1) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:08.605048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ae688-5df4-4559-8ddf-d0b61d903906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:08.606517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ae688-5df4-4559-8ddf-d0b61d903906 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:08.613240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 149/318] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:31:08 2022] GET /identity/v3/role_assignments?user.id=711ea36977e14195b21e7b2114dad4d1&scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b&role.id=995303a8ffbd4ff2a1e28bbd53e9391e => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:09.622465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb61f6-d6a8-416f-b15e-ad24713bc19a None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:09.622953 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb61f6-d6a8-416f-b15e-ad24713bc19a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:09.622953 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb61f6-d6a8-416f-b15e-ad24713bc19a None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:09.624387 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 170/319] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:09.629663 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ccf35-3de7-43a6-bebd-030a97d85af1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:09.630093 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ccf35-3de7-43a6-bebd-030a97d85af1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:09.630247 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ccf35-3de7-43a6-bebd-030a97d85af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:09.648986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-6b5ccf35-3de7-43a6-bebd-030a97d85af1 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:09.650190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6b5ccf35-3de7-43a6-bebd-030a97d85af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:09.718258 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 150/320] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:09.985956 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb61f6-d6a8-416f-b15e-ad24713bc19a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:09.999182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e62d7f-bf1b-4a39-ba0d-2d842faac4aa None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:09.999545 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e62d7f-bf1b-4a39-ba0d-2d842faac4aa None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:09.999731 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e62d7f-bf1b-4a39-ba0d-2d842faac4aa None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:10.005247 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 151/321] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:10.007178 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf542239-b34a-4ebd-aad3-ca8bc6b58c62 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:10.007643 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf542239-b34a-4ebd-aad3-ca8bc6b58c62 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:10.007916 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf542239-b34a-4ebd-aad3-ca8bc6b58c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:10.028145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-bf542239-b34a-4ebd-aad3-ca8bc6b58c62 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:10.029471 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bf542239-b34a-4ebd-aad3-ca8bc6b58c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:10.099758 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb61f6-d6a8-416f-b15e-ad24713bc19a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:10.105245 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 152/322] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:10.107600 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbca51-0e31-42bb-aad9-17f38cb73bf6 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:10.107894 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbca51-0e31-42bb-aad9-17f38cb73bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:10.108356 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbca51-0e31-42bb-aad9-17f38cb73bf6 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:10.110672 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 153/323] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:31:10.111768 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:10.115965 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d803a8-d497-45ad-be6c-7e5216d6ed7e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:10.116252 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d803a8-d497-45ad-be6c-7e5216d6ed7e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:10.116530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d803a8-d497-45ad-be6c-7e5216d6ed7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:10.135268 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-76d803a8-d497-45ad-be6c-7e5216d6ed7e None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:10.136447 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-76d803a8-d497-45ad-be6c-7e5216d6ed7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:10.139622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cacebe-acba-442b-872d-195d1428e93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:10.140252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cacebe-acba-442b-872d-195d1428e93a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:10.140532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cacebe-acba-442b-872d-195d1428e93a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:10.140803 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cacebe-acba-442b-872d-195d1428e93a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:10.141938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cacebe-acba-442b-872d-195d1428e93a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:10.143361 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cacebe-acba-442b-872d-195d1428e93a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:10.143934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:10.146055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 171/324] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:10.151709 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cacebe-acba-442b-872d-195d1428e93a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:10.204558 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 154/325] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:10.252714 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cacebe-acba-442b-872d-195d1428e93a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:10.285496 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e63af-3f23-4113-8b84-e8fade6f6a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:10.286144 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e63af-3f23-4113-8b84-e8fade6f6a2f None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:10.286427 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e63af-3f23-4113-8b84-e8fade6f6a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:10.286699 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e63af-3f23-4113-8b84-e8fade6f6a2f None admin] PATH_INFO: `/v3/groups` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:10.287318 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e63af-3f23-4113-8b84-e8fade6f6a2f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:10.288727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e63af-3f23-4113-8b84-e8fade6f6a2f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:10.309257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 172/326] 10.222.0.52 () {60 vars in 1134 bytes} [Thu Sep 15 00:31:10 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:31:10.375131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d803a8-d497-45ad-be6c-7e5216d6ed7e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:10.474456 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e63af-3f23-4113-8b84-e8fade6f6a2f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:10.483074 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d803a8-d497-45ad-be6c-7e5216d6ed7e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:10.518592 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:10.528469 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556976f6-7dca-49c1-97c7-bab6d427aea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:10.529136 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556976f6-7dca-49c1-97c7-bab6d427aea6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:10.529422 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556976f6-7dca-49c1-97c7-bab6d427aea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:10.530026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556976f6-7dca-49c1-97c7-bab6d427aea6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:10.542173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556976f6-7dca-49c1-97c7-bab6d427aea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:10.547139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-556976f6-7dca-49c1-97c7-bab6d427aea6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:31:10.547139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:10.547139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:10.547139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:10.547139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:10.547139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:10.547139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:10.547139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:10.547139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:10.547139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:10.547139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:10.547139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:10.547139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:10.547139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:10.547139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:10.547139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:10.547984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:10.547984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:10.547984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:10.547984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:10.547984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:10.547984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:10.547984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:10.547984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:10.547984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:10.547984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:10.547984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:10.547984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:10.547984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:10.547984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:10.547984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:10.547984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:10.548768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:10.548768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:10.548768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:10.548768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:10.548768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:10.548768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:10.548768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:10.548768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:10.548768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:10.548768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:10.548768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:31:10.548768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:10.548768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 155/327] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:10.554263 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556976f6-7dca-49c1-97c7-bab6d427aea6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:10.557542 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:10.600669 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e63af-3f23-4113-8b84-e8fade6f6a2f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:10.647877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39352611-1017-47cb-bc2a-54aea1c2a6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:10.648531 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39352611-1017-47cb-bc2a-54aea1c2a6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:10.648814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39352611-1017-47cb-bc2a-54aea1c2a6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:10.649994 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39352611-1017-47cb-bc2a-54aea1c2a6d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:10.663091 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39352611-1017-47cb-bc2a-54aea1c2a6d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:10.668550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-39352611-1017-47cb-bc2a-54aea1c2a6d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 00:31:10.668550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:10.668550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:10.668550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:10.668550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:10.668550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:10.668550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:10.668550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:10.668550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:10.668550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:10.668550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:10.668550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:10.668550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:10.668550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:10.668550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:10.668550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:10.669517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:10.669517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:10.669517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:10.669517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:10.669517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:10.669517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:10.669517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:10.669517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:10.669517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:10.669517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:10.669517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:10.669517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:10.669517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:10.669517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:10.669517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:10.669517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:10.670320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:10.670320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:10.670320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:10.670320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:10.670320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:10.670320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:10.670320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:10.670320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:10.670320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:10.670320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:10.670320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 00:31:10.670320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:10.670320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 173/328] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:31:10.674950 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556976f6-7dca-49c1-97c7-bab6d427aea6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:10.677428 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39352611-1017-47cb-bc2a-54aea1c2a6d8 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:10.715497 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130bc6e-2d1a-403c-b1d0-a61224cabf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:10.716103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130bc6e-2d1a-403c-b1d0-a61224cabf13 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:10.716457 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130bc6e-2d1a-403c-b1d0-a61224cabf13 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:10.716754 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130bc6e-2d1a-403c-b1d0-a61224cabf13 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:10.717584 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130bc6e-2d1a-403c-b1d0-a61224cabf13 None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:10.717770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130bc6e-2d1a-403c-b1d0-a61224cabf13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:10.719170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130bc6e-2d1a-403c-b1d0-a61224cabf13 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:10.728364 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 156/329] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:31:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:31:10.734278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130bc6e-2d1a-403c-b1d0-a61224cabf13 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:10.803144 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:10.810901 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39352611-1017-47cb-bc2a-54aea1c2a6d8 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:10.812453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:10.851268 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da000896-a09e-445c-80ac-6600618ae78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:10.851887 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da000896-a09e-445c-80ac-6600618ae78e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:10.852163 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da000896-a09e-445c-80ac-6600618ae78e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:10.853207 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da000896-a09e-445c-80ac-6600618ae78e None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:10.854212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da000896-a09e-445c-80ac-6600618ae78e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:10.854525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da000896-a09e-445c-80ac-6600618ae78e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:10.856183 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da000896-a09e-445c-80ac-6600618ae78e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:10.860654 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130bc6e-2d1a-403c-b1d0-a61224cabf13 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:10.869334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 174/330] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:31:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:10.874881 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da000896-a09e-445c-80ac-6600618ae78e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:10.905454 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1043a7c-83ce-466f-91a5-9f8abbaebbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:10.906362 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1043a7c-83ce-466f-91a5-9f8abbaebbdc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:10.906637 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1043a7c-83ce-466f-91a5-9f8abbaebbdc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:10.906908 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1043a7c-83ce-466f-91a5-9f8abbaebbdc None admin] PATH_INFO: `/v3/users/3b8381a853f34259ae73dadcbad577ed` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:10.908538 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1043a7c-83ce-466f-91a5-9f8abbaebbdc None admin] RBAC: Authorizing `identity:get_user(user_id=3b8381a853f34259ae73dadcbad577ed)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:10.910499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1043a7c-83ce-466f-91a5-9f8abbaebbdc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:10.912720 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 157/331] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:31:10 2022] GET /identity/v3/users/3b8381a853f34259ae73dadcbad577ed => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:31:10.918821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1043a7c-83ce-466f-91a5-9f8abbaebbdc None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:10.997774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da000896-a09e-445c-80ac-6600618ae78e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:11.026570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1043a7c-83ce-466f-91a5-9f8abbaebbdc None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:11.036917 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713d44a-6631-4b83-b96c-ea4dde76fbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:11.037688 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713d44a-6631-4b83-b96c-ea4dde76fbba None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:11.037972 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713d44a-6631-4b83-b96c-ea4dde76fbba None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:11.038299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713d44a-6631-4b83-b96c-ea4dde76fbba None admin] PATH_INFO: `/v3/users/e74d465195d04a53b3c391cf7e50b272` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:11.039500 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713d44a-6631-4b83-b96c-ea4dde76fbba None admin] RBAC: Authorizing `identity:get_user(user_id=e74d465195d04a53b3c391cf7e50b272)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:11.041811 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713d44a-6631-4b83-b96c-ea4dde76fbba None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:11.043782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 175/332] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:31:10 2022] GET /identity/v3/users/e74d465195d04a53b3c391cf7e50b272 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:11.049950 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713d44a-6631-4b83-b96c-ea4dde76fbba None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:11.058143 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:11.066134 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e49adf-2832-4182-9d97-d1eec2c8d79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:11.066856 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e49adf-2832-4182-9d97-d1eec2c8d79b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:11.067252 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e49adf-2832-4182-9d97-d1eec2c8d79b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:11.067656 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e49adf-2832-4182-9d97-d1eec2c8d79b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:11.068505 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e49adf-2832-4182-9d97-d1eec2c8d79b None admin] RBAC: Adding query filter params (role.id=24171c44541e4c4782ec7d3f03b50467, user.id=3b8381a853f34259ae73dadcbad577ed, scope.system=all) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:11.068912 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e49adf-2832-4182-9d97-d1eec2c8d79b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:11.070617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e49adf-2832-4182-9d97-d1eec2c8d79b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:11.085148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 158/333] 10.222.0.52 () {56 vars in 1308 bytes} [Thu Sep 15 00:31:10 2022] GET /identity/v3/role_assignments?user.id=3b8381a853f34259ae73dadcbad577ed&scope.system=all&role.id=24171c44541e4c4782ec7d3f03b50467 => generated 510 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:11.087869 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:11.177494 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713d44a-6631-4b83-b96c-ea4dde76fbba None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:11.217347 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fe8fd-5d76-473f-8f0f-a5ef9070c773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:11.218153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fe8fd-5d76-473f-8f0f-a5ef9070c773 None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:11.218638 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fe8fd-5d76-473f-8f0f-a5ef9070c773 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:11.219132 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fe8fd-5d76-473f-8f0f-a5ef9070c773 None admin] PATH_INFO: `/v3/system/users/e74d465195d04a53b3c391cf7e50b272/roles/995303a8ffbd4ff2a1e28bbd53e9391e` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:11.221275 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fe8fd-5d76-473f-8f0f-a5ef9070c773 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e74d465195d04a53b3c391cf7e50b272, role_id=995303a8ffbd4ff2a1e28bbd53e9391e)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:11.223131 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7fe8fd-5d76-473f-8f0f-a5ef9070c773 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:11.235306 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 176/334] 10.222.0.52 () {58 vars in 1334 bytes} [Thu Sep 15 00:31:11 2022] PUT /identity/v3/system/users/e74d465195d04a53b3c391cf7e50b272/roles/995303a8ffbd4ff2a1e28bbd53e9391e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:31:12.730529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123b2ce-5348-42ea-b417-13eb227dd1cb None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:12.731444 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123b2ce-5348-42ea-b417-13eb227dd1cb None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:12.731980 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123b2ce-5348-42ea-b417-13eb227dd1cb None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:12.733528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 159/335] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:12.739769 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8d7e4-bc5f-4d8c-afe1-858ec9f8e42e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:12.740674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8d7e4-bc5f-4d8c-afe1-858ec9f8e42e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:12.741247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8d7e4-bc5f-4d8c-afe1-858ec9f8e42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:12.765973 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-c0a8d7e4-bc5f-4d8c-afe1-858ec9f8e42e None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:12.767471 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c0a8d7e4-bc5f-4d8c-afe1-858ec9f8e42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:12.840104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 177/336] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:13.388675 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123b2ce-5348-42ea-b417-13eb227dd1cb None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:13.399949 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c2e43-4d6c-49c5-80af-5f12c657d458 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:13.402673 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c2e43-4d6c-49c5-80af-5f12c657d458 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:13.403225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c2e43-4d6c-49c5-80af-5f12c657d458 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:13.406279 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 178/337] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:13.411938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f630c5-f476-426e-9ee8-a003e3397263 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:13.412224 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f630c5-f476-426e-9ee8-a003e3397263 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:13.412501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f630c5-f476-426e-9ee8-a003e3397263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:13.436399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-02f630c5-f476-426e-9ee8-a003e3397263 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:13.438019 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-02f630c5-f476-426e-9ee8-a003e3397263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:13.457890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:13.527238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123b2ce-5348-42ea-b417-13eb227dd1cb None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:13.542419 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 179/338] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:13.576080 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25d7d4-aad3-4063-a694-0143f1a904a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:13.576958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25d7d4-aad3-4063-a694-0143f1a904a9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:13.577453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25d7d4-aad3-4063-a694-0143f1a904a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:13.577876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25d7d4-aad3-4063-a694-0143f1a904a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:13.591474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25d7d4-aad3-4063-a694-0143f1a904a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:13.597053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-5a25d7d4-aad3-4063-a694-0143f1a904a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:31:13.597053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:13.597053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:13.597053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:13.597053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:13.597053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:13.597053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:13.597053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:13.597053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:13.597053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:13.597053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:13.597053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:13.597053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:13.597053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:13.597053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:13.597053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:13.598135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:13.598135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:13.598135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:13.598135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:13.598135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:13.598135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:13.598135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:13.598135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:13.598135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:13.598135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:13.598135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:13.598135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:13.598135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:13.598135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:13.598135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:13.598135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:13.599133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:13.599133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:13.599133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:13.599133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:13.599133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:13.599133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:13.599133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:13.599133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:13.599133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:13.599133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:13.599133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:31:13.599133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:13.605418 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 160/339] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:13.607579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f630c5-f476-426e-9ee8-a003e3397263 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:13.737824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f630c5-f476-426e-9ee8-a003e3397263 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:13.787157 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ae1ef-9899-4908-b30d-ca211512a24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:13.787952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ae1ef-9899-4908-b30d-ca211512a24a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:13.788145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ae1ef-9899-4908-b30d-ca211512a24a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:13.788403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ae1ef-9899-4908-b30d-ca211512a24a None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:13.789152 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ae1ef-9899-4908-b30d-ca211512a24a None admin] RBAC: Adding query filter params (name=member) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:13.789461 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ae1ef-9899-4908-b30d-ca211512a24a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:13.790884 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ae1ef-9899-4908-b30d-ca211512a24a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:13.802360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 180/340] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:31:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:13.810096 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25d7d4-aad3-4063-a694-0143f1a904a9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:13.896627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:13.968194 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25d7d4-aad3-4063-a694-0143f1a904a9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:13.997134 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6990c4-63d5-4325-bed7-26c8a115f547 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:13.997957 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6990c4-63d5-4325-bed7-26c8a115f547 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:13.998207 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6990c4-63d5-4325-bed7-26c8a115f547 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:14.000469 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 181/341] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:14.007749 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71e8b2-ec79-4d77-8b4b-dffb7faffc77 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:14.010373 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71e8b2-ec79-4d77-8b4b-dffb7faffc77 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:14.010654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71e8b2-ec79-4d77-8b4b-dffb7faffc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:14.025537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205ce25-a990-4c85-b349-a2bdeccebdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:14.026878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205ce25-a990-4c85-b349-a2bdeccebdfa None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:14.027699 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205ce25-a990-4c85-b349-a2bdeccebdfa None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:14.028220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205ce25-a990-4c85-b349-a2bdeccebdfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:14.037101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-0b71e8b2-ec79-4d77-8b4b-dffb7faffc77 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:14.038296 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0b71e8b2-ec79-4d77-8b4b-dffb7faffc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:14.046855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:14.151896 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205ce25-a990-4c85-b349-a2bdeccebdfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:14.158917 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205ce25-a990-4c85-b349-a2bdeccebdfa None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:14.189361 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 182/342] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:31:14.190636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efaa1db-74e2-4367-afa5-b677347b2eee None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:14.190923 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efaa1db-74e2-4367-afa5-b677347b2eee None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:14.191197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efaa1db-74e2-4367-afa5-b677347b2eee None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:14.197183 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 183/343] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:14.197183 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efaa1db-74e2-4367-afa5-b677347b2eee None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:14.256129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:14.381487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 161/344] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:31:14.382748 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fbc93-d073-4067-8363-130739a6aa14 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:14.383025 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fbc93-d073-4067-8363-130739a6aa14 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:14.386962 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fbc93-d073-4067-8363-130739a6aa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:14.394520 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efaa1db-74e2-4367-afa5-b677347b2eee None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:14.424518 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-071fbc93-d073-4067-8363-130739a6aa14 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:14.425638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-071fbc93-d073-4067-8363-130739a6aa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:14.467468 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ebb1c-9057-4f6a-a9fc-7243df701344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:14.468110 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ebb1c-9057-4f6a-a9fc-7243df701344 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:14.468387 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ebb1c-9057-4f6a-a9fc-7243df701344 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:14.468656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ebb1c-9057-4f6a-a9fc-7243df701344 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:14.494153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ebb1c-9057-4f6a-a9fc-7243df701344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:14.500328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-518ebb1c-9057-4f6a-a9fc-7243df701344 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:31:14.500328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:14.500328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:14.500328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:14.500328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:14.500328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:14.500328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:14.500328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:14.500328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:14.500328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:14.500328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:14.500328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:14.500328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:14.500328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:14.500328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:14.500328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:14.501314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:14.501314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:14.501314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:14.501314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:14.501314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:14.501314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:14.501314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:14.501314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:14.501314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:14.501314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:14.501314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:14.501314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:14.501314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:14.501314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:14.501314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:14.501314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:14.502607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:14.502607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:14.502607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:14.502607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:14.502607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:14.502607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:14.502607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:14.502607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:14.502607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:14.502607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:14.502607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:31:14.502607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:14.502607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 184/345] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 15 00:31:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:14.502607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ebb1c-9057-4f6a-a9fc-7243df701344 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:14.508265 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:14.587813 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 162/346] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:14.588578 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fbc93-d073-4067-8363-130739a6aa14 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:14.628747 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ebb1c-9057-4f6a-a9fc-7243df701344 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:14.675166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7eaa6-4f62-4fe0-9623-7d55b732d40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:14.675891 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7eaa6-4f62-4fe0-9623-7d55b732d40e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:14.676170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7eaa6-4f62-4fe0-9623-7d55b732d40e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:14.676442 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7eaa6-4f62-4fe0-9623-7d55b732d40e None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:14.677741 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7eaa6-4f62-4fe0-9623-7d55b732d40e None admin] RBAC: Authorizing `identity:get_project(project_id=313898e8c5c24ba6860f81e2bba41fb6)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:14.679345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7eaa6-4f62-4fe0-9623-7d55b732d40e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:14.681933 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 185/347] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:31:14 2022] GET /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:14.682702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7eaa6-4f62-4fe0-9623-7d55b732d40e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:14.731082 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:14.768866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:14.788056 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fbc93-d073-4067-8363-130739a6aa14 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:14.804492 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7eaa6-4f62-4fe0-9623-7d55b732d40e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:14.843491 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe560d91-71bf-4e99-a503-1d940482e0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:14.844125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe560d91-71bf-4e99-a503-1d940482e0f7 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:14.844398 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe560d91-71bf-4e99-a503-1d940482e0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:14.844662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe560d91-71bf-4e99-a503-1d940482e0f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:14.857574 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2ae73-8f6b-4ab9-824e-f235719bbae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:14.858167 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2ae73-8f6b-4ab9-824e-f235719bbae0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:14.858444 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2ae73-8f6b-4ab9-824e-f235719bbae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:14.858711 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2ae73-8f6b-4ab9-824e-f235719bbae0 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:14.859643 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2ae73-8f6b-4ab9-824e-f235719bbae0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:14.859942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2ae73-8f6b-4ab9-824e-f235719bbae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:14.865649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2ae73-8f6b-4ab9-824e-f235719bbae0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:14.867616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe560d91-71bf-4e99-a503-1d940482e0f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:14.877525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-fe560d91-71bf-4e99-a503-1d940482e0f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 00:31:14.877525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:14.877525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:14.877525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:14.877525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:14.877525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:14.877525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:14.877525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:14.877525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:14.877525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:14.877525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:14.877525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:14.877525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:14.877525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:14.877525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:14.877525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:14.879583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:14.879583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:14.879583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:14.879583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:14.879583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:14.879583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:14.879583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:14.879583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:14.879583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:14.879583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:14.879583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:14.879583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:14.879583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:14.879583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:14.879583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:14.879583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:14.881630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:14.881630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:14.881630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:14.881630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:14.881630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:14.881630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:14.881630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:14.881630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:14.881630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:14.881630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:14.881630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 00:31:14.881630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:14.881630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 186/348] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:14.881630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe560d91-71bf-4e99-a503-1d940482e0f7 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:14.883325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 163/349] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:14.889274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2ae73-8f6b-4ab9-824e-f235719bbae0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:15.021891 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe560d91-71bf-4e99-a503-1d940482e0f7 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:15.042191 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2ae73-8f6b-4ab9-824e-f235719bbae0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:15.057952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:15.070062 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb9f31-bdb4-4c8b-a33a-1650522e2924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:15.071911 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb9f31-bdb4-4c8b-a33a-1650522e2924 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:15.072446 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb9f31-bdb4-4c8b-a33a-1650522e2924 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:15.073232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb9f31-bdb4-4c8b-a33a-1650522e2924 None admin] PATH_INFO: `/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:15.082809 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb9f31-bdb4-4c8b-a33a-1650522e2924 None admin] RBAC: Authorizing `identity:get_group(group_id=68c51ee5f80a4d3580f165c1b9405bb7)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:15.085702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb9f31-bdb4-4c8b-a33a-1650522e2924 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:15.089037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0dcee7-d738-48d2-bfc0-dd060528d2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:15.089300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 187/350] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 15 00:31:14 2022] GET /identity/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:15.089831 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dcee7-d738-48d2-bfc0-dd060528d2cc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:15.090179 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dcee7-d738-48d2-bfc0-dd060528d2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:15.090453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dcee7-d738-48d2-bfc0-dd060528d2cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:15.091085 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb9f31-bdb4-4c8b-a33a-1650522e2924 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:15.107545 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:15.188548 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0dcee7-d738-48d2-bfc0-dd060528d2cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:15.191132 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0dcee7-d738-48d2-bfc0-dd060528d2cc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:15.239799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb9f31-bdb4-4c8b-a33a-1650522e2924 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:15.279879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fe9ad-6fae-4b38-b782-46ce6d8a3a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:15.280409 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fe9ad-6fae-4b38-b782-46ce6d8a3a6c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:15.280686 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fe9ad-6fae-4b38-b782-46ce6d8a3a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:15.280955 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fe9ad-6fae-4b38-b782-46ce6d8a3a6c None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:15.281640 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297fe9ad-6fae-4b38-b782-46ce6d8a3a6c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:15.281939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297fe9ad-6fae-4b38-b782-46ce6d8a3a6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:15.283298 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297fe9ad-6fae-4b38-b782-46ce6d8a3a6c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:15.297441 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 188/351] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:31:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:15.298421 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fe9ad-6fae-4b38-b782-46ce6d8a3a6c None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:15.329889 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 164/352] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 00:31:15.331089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0dcee7-d738-48d2-bfc0-dd060528d2cc None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:15.383231 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:15.385681 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:15.445146 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fe9ad-6fae-4b38-b782-46ce6d8a3a6c None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:15.453674 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0dcee7-d738-48d2-bfc0-dd060528d2cc None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:15.498973 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2810f9-e4f4-4c6b-a4b0-7b0ed07f80eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:15.500667 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2810f9-e4f4-4c6b-a4b0-7b0ed07f80eb None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:15.500667 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2810f9-e4f4-4c6b-a4b0-7b0ed07f80eb None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:15.500667 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2810f9-e4f4-4c6b-a4b0-7b0ed07f80eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:15.502764 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10ec30-04f3-42a9-bacc-ee36428ede56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:15.503282 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10ec30-04f3-42a9-bacc-ee36428ede56 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:15.503556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10ec30-04f3-42a9-bacc-ee36428ede56 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:15.503824 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10ec30-04f3-42a9-bacc-ee36428ede56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:15.504565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10ec30-04f3-42a9-bacc-ee36428ede56 None admin] RBAC: Adding query filter params (group.id=68c51ee5f80a4d3580f165c1b9405bb7, role.id=24171c44541e4c4782ec7d3f03b50467, scope.project.id=313898e8c5c24ba6860f81e2bba41fb6) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:15.504869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10ec30-04f3-42a9-bacc-ee36428ede56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:15.506402 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10ec30-04f3-42a9-bacc-ee36428ede56 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:15.514597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 165/353] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Sep 15 00:31:15 2022] GET /identity/v3/role_assignments?group.id=68c51ee5f80a4d3580f165c1b9405bb7&scope.project.id=313898e8c5c24ba6860f81e2bba41fb6&role.id=24171c44541e4c4782ec7d3f03b50467 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:15.514802 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2810f9-e4f4-4c6b-a4b0-7b0ed07f80eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:15.516294 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32446f5-3b29-4e32-8953-b91db8a3dc69 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:15.516792 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32446f5-3b29-4e32-8953-b91db8a3dc69 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:15.517429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32446f5-3b29-4e32-8953-b91db8a3dc69 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:15.519037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 166/354] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:15.520021 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32446f5-3b29-4e32-8953-b91db8a3dc69 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:15.520532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-1e2810f9-e4f4-4c6b-a4b0-7b0ed07f80eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:31:15.520532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:15.520532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:15.520532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:15.520532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:15.520532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:15.520532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:15.520532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:15.520532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:15.520532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:15.520532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:15.520532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:15.520532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:15.520532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:15.520532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:15.520532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:15.521630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:15.521630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:15.521630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:15.521630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:15.521630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:15.521630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:15.521630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:15.521630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:15.521630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:15.521630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:15.521630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:15.521630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:15.521630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:15.521630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:15.521630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:15.521630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:15.522447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:15.522447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:15.522447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:15.522447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:15.522447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:15.522447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:15.522447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:15.522447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:15.522447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:15.522447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:15.522447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:31:15.522447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:15.522447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 189/355] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:15.523831 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2810f9-e4f4-4c6b-a4b0-7b0ed07f80eb None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:15.658892 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32446f5-3b29-4e32-8953-b91db8a3dc69 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:15.675193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:15.695144 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2810f9-e4f4-4c6b-a4b0-7b0ed07f80eb None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:15.703602 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f61f0-1ba3-492c-958c-409c8dc7e92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:15.704605 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f61f0-1ba3-492c-958c-409c8dc7e92c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:15.705054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f61f0-1ba3-492c-958c-409c8dc7e92c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:15.705526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f61f0-1ba3-492c-958c-409c8dc7e92c None admin] PATH_INFO: `/v3/users/e74d465195d04a53b3c391cf7e50b272` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:15.706927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f61f0-1ba3-492c-958c-409c8dc7e92c None admin] RBAC: Authorizing `identity:get_user(user_id=e74d465195d04a53b3c391cf7e50b272)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:15.708395 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f61f0-1ba3-492c-958c-409c8dc7e92c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:15.710327 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 167/356] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:31:15 2022] GET /identity/v3/users/e74d465195d04a53b3c391cf7e50b272 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:15.711523 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9686b37-4a20-4566-8f32-fb7cfcf621d4 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:15.711815 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9686b37-4a20-4566-8f32-fb7cfcf621d4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:15.712088 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9686b37-4a20-4566-8f32-fb7cfcf621d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:15.716084 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:15.731935 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a9686b37-4a20-4566-8f32-fb7cfcf621d4 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:15.733332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a9686b37-4a20-4566-8f32-fb7cfcf621d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:15.740205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f009b2-7615-4b6e-8a09-3a99d1df2001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:15.741129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f009b2-7615-4b6e-8a09-3a99d1df2001 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:15.741578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f009b2-7615-4b6e-8a09-3a99d1df2001 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:15.741847 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f009b2-7615-4b6e-8a09-3a99d1df2001 None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:15.743524 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f009b2-7615-4b6e-8a09-3a99d1df2001 None admin] RBAC: Authorizing `identity:get_project(project_id=313898e8c5c24ba6860f81e2bba41fb6)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:15.745025 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f009b2-7615-4b6e-8a09-3a99d1df2001 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:15.746743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 190/357] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:31:15 2022] GET /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:15.747781 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f009b2-7615-4b6e-8a09-3a99d1df2001 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:15.805911 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 168/358] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:15.807536 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b00e4-93ce-405f-8601-57a95c6c733e None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:15.808025 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b00e4-93ce-405f-8601-57a95c6c733e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:15.808497 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b00e4-93ce-405f-8601-57a95c6c733e None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:15.810310 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 169/359] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:15.811232 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b00e4-93ce-405f-8601-57a95c6c733e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:15.862457 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f009b2-7615-4b6e-8a09-3a99d1df2001 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:15.913914 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550e3f3-2852-4a8f-b6eb-6d476f1e0f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:15.914472 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550e3f3-2852-4a8f-b6eb-6d476f1e0f1c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:15.914849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550e3f3-2852-4a8f-b6eb-6d476f1e0f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:15.915160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550e3f3-2852-4a8f-b6eb-6d476f1e0f1c None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:15.915797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550e3f3-2852-4a8f-b6eb-6d476f1e0f1c None admin] RBAC: Adding query filter params (name=member) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:15.916102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550e3f3-2852-4a8f-b6eb-6d476f1e0f1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:15.917486 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550e3f3-2852-4a8f-b6eb-6d476f1e0f1c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:15.929548 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 191/360] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:31:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:15.930211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550e3f3-2852-4a8f-b6eb-6d476f1e0f1c None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:15.972247 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b00e4-93ce-405f-8601-57a95c6c733e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:15.974928 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:15.993565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:16.013910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03109ab1-817b-4418-b410-856d782e7045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:16.014237 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03109ab1-817b-4418-b410-856d782e7045 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:16.014562 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03109ab1-817b-4418-b410-856d782e7045 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:16.014835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03109ab1-817b-4418-b410-856d782e7045 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:16.015570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03109ab1-817b-4418-b410-856d782e7045 None admin] RBAC: Adding query filter params (role.id=995303a8ffbd4ff2a1e28bbd53e9391e, user.id=e74d465195d04a53b3c391cf7e50b272, scope.system=all) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:16.015880 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03109ab1-817b-4418-b410-856d782e7045 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:16.019669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03109ab1-817b-4418-b410-856d782e7045 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:16.034263 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 170/361] 10.222.0.52 () {56 vars in 1308 bytes} [Thu Sep 15 00:31:15 2022] GET /identity/v3/role_assignments?user.id=e74d465195d04a53b3c391cf7e50b272&scope.system=all&role.id=995303a8ffbd4ff2a1e28bbd53e9391e => generated 510 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:16.035520 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd986e5-5299-4697-be7b-8f8e7c2dea5e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:16.037286 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd986e5-5299-4697-be7b-8f8e7c2dea5e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:16.037286 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd986e5-5299-4697-be7b-8f8e7c2dea5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:16.067482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-4cd986e5-5299-4697-be7b-8f8e7c2dea5e None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:16.069260 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4cd986e5-5299-4697-be7b-8f8e7c2dea5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:16.072366 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550e3f3-2852-4a8f-b6eb-6d476f1e0f1c None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:16.117211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a15da-a30b-4106-8b29-d7a6111bfe34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:16.118602 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a15da-a30b-4106-8b29-d7a6111bfe34 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:16.118893 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a15da-a30b-4106-8b29-d7a6111bfe34 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:16.119157 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a15da-a30b-4106-8b29-d7a6111bfe34 None admin] PATH_INFO: `/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:16.120339 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a15da-a30b-4106-8b29-d7a6111bfe34 None admin] RBAC: Authorizing `identity:get_group(group_id=68c51ee5f80a4d3580f165c1b9405bb7)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:16.122313 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a15da-a30b-4106-8b29-d7a6111bfe34 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:16.125138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 192/362] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 15 00:31:15 2022] GET /identity/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:16.126537 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a15da-a30b-4106-8b29-d7a6111bfe34 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:16.165999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 171/363] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:16.167283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd986e5-5299-4697-be7b-8f8e7c2dea5e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:16.277117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a15da-a30b-4106-8b29-d7a6111bfe34 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:16.295452 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:16.328769 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793c79b-9333-4afa-a997-9b6b4da67b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:16.329414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793c79b-9333-4afa-a997-9b6b4da67b0f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:16.329689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793c79b-9333-4afa-a997-9b6b4da67b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:16.329949 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793c79b-9333-4afa-a997-9b6b4da67b0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:16.371435 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:16.387971 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd986e5-5299-4697-be7b-8f8e7c2dea5e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:16.428968 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793c79b-9333-4afa-a997-9b6b4da67b0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:16.430608 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d470f90-187b-4a94-b8cd-b4868f929350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:16.430741 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793c79b-9333-4afa-a997-9b6b4da67b0f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:16.431434 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d470f90-187b-4a94-b8cd-b4868f929350 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:16.435294 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d470f90-187b-4a94-b8cd-b4868f929350 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:16.435294 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d470f90-187b-4a94-b8cd-b4868f929350 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:16.435294 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d470f90-187b-4a94-b8cd-b4868f929350 None admin] RBAC: Adding query filter params (group.id=68c51ee5f80a4d3580f165c1b9405bb7, role.id=1c9b176504fd4d24b34942f724e63acf, scope.project.id=313898e8c5c24ba6860f81e2bba41fb6) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:16.435556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d470f90-187b-4a94-b8cd-b4868f929350 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:16.437151 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d470f90-187b-4a94-b8cd-b4868f929350 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:16.443579 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 172/364] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Sep 15 00:31:16 2022] GET /identity/v3/role_assignments?group.id=68c51ee5f80a4d3580f165c1b9405bb7&scope.project.id=313898e8c5c24ba6860f81e2bba41fb6&role.id=1c9b176504fd4d24b34942f724e63acf => generated 260 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:16.444401 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d470f90-187b-4a94-b8cd-b4868f929350 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:16.582957 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 193/365] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:31:16.593547 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793c79b-9333-4afa-a997-9b6b4da67b0f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:16.620243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:16.668564 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d470f90-187b-4a94-b8cd-b4868f929350 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:16.720078 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755fcc6-4b6f-4d14-823a-797378a65ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:16.721212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755fcc6-4b6f-4d14-823a-797378a65ade None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:16.721700 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755fcc6-4b6f-4d14-823a-797378a65ade None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:16.722171 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755fcc6-4b6f-4d14-823a-797378a65ade None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:16.729996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793c79b-9333-4afa-a997-9b6b4da67b0f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:16.734585 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755fcc6-4b6f-4d14-823a-797378a65ade None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:16.740345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-d755fcc6-4b6f-4d14-823a-797378a65ade None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:31:16.740345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:16.740345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:16.740345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:16.740345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:16.740345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:16.740345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:16.740345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:16.740345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:16.740345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:16.740345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:16.740345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:16.740345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:16.740345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:16.740345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:16.740345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:16.741275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:16.741275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:16.741275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:16.741275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:16.741275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:16.741275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:16.741275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:16.741275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:16.741275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:16.741275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:16.741275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:16.741275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:16.741275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:16.741275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:16.741275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:16.741275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:16.742458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:16.742458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:16.742458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:16.742458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:16.742458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:16.742458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:16.742458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:16.742458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:16.742458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:16.742458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:16.742458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:31:16.742458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:16.742458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 173/366] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 15 00:31:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:16.743189 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755fcc6-4b6f-4d14-823a-797378a65ade None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:16.770212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490e316-c1ca-4ba8-81e7-89c3652c3d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:16.770853 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490e316-c1ca-4ba8-81e7-89c3652c3d19 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:16.771134 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490e316-c1ca-4ba8-81e7-89c3652c3d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:16.771626 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:16.771877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490e316-c1ca-4ba8-81e7-89c3652c3d19 None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:16.773869 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490e316-c1ca-4ba8-81e7-89c3652c3d19 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc5711794744f1c9ccc1b886cc1a21b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:16.776129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490e316-c1ca-4ba8-81e7-89c3652c3d19 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:16.778134 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 194/367] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:31:16 2022] GET /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:31:16.779110 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490e316-c1ca-4ba8-81e7-89c3652c3d19 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:16.880204 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:16.888719 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755fcc6-4b6f-4d14-823a-797378a65ade None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:16.909035 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490e316-c1ca-4ba8-81e7-89c3652c3d19 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:16.939511 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a286005-736e-4f00-b01a-e96c498522b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:16.941052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a286005-736e-4f00-b01a-e96c498522b9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:16.941553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a286005-736e-4f00-b01a-e96c498522b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:16.941983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a286005-736e-4f00-b01a-e96c498522b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:16.955515 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a286005-736e-4f00-b01a-e96c498522b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:16.958455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e389b-6da9-4a1a-83c3-097673e7763a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:16.959546 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e389b-6da9-4a1a-83c3-097673e7763a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:16.960020 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e389b-6da9-4a1a-83c3-097673e7763a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:16.960464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e389b-6da9-4a1a-83c3-097673e7763a None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:16.961318 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e389b-6da9-4a1a-83c3-097673e7763a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:16.962326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e389b-6da9-4a1a-83c3-097673e7763a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:16.963855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e389b-6da9-4a1a-83c3-097673e7763a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:16.963970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-9a286005-736e-4f00-b01a-e96c498522b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:31:16.963970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:16.963970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:16.963970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:16.963970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:16.963970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:16.963970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:16.963970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:16.963970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:16.963970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:16.963970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:16.963970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:16.963970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:16.963970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:16.963970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:16.963970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:16.964765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:16.964765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:16.964765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:16.964765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:16.964765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:16.964765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:16.964765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:16.964765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:16.964765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:16.964765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:16.964765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:16.964765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:16.964765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:16.964765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:16.964765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:16.964765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:16.965602 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:16.965602 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:16.965602 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:16.965602 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:16.965602 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:16.965602 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:16.965602 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:16.965602 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:16.965602 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:16.965602 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:16.965602 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:31:16.965602 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:16.966193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 174/368] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:31:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:16.966783 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a286005-736e-4f00-b01a-e96c498522b9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:16.981197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 195/369] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:16.982302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e389b-6da9-4a1a-83c3-097673e7763a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:17.067900 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:17.104456 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a286005-736e-4f00-b01a-e96c498522b9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:17.107698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e389b-6da9-4a1a-83c3-097673e7763a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:17.147379 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7d859-1d10-421e-8f6b-2d6d4f48d72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:17.148087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7d859-1d10-421e-8f6b-2d6d4f48d72d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:17.148369 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7d859-1d10-421e-8f6b-2d6d4f48d72d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:17.148641 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7d859-1d10-421e-8f6b-2d6d4f48d72d None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:17.150095 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7d859-1d10-421e-8f6b-2d6d4f48d72d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:17.150402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7d859-1d10-421e-8f6b-2d6d4f48d72d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:17.151527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e92d5-d696-42ef-9dce-20794d332cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:17.151866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7d859-1d10-421e-8f6b-2d6d4f48d72d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:17.152573 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e92d5-d696-42ef-9dce-20794d332cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:17.153047 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e92d5-d696-42ef-9dce-20794d332cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:17.153704 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e92d5-d696-42ef-9dce-20794d332cc8 None admin] PATH_INFO: `/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:17.155757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e92d5-d696-42ef-9dce-20794d332cc8 None admin] RBAC: Authorizing `identity:get_group(group_id=68c51ee5f80a4d3580f165c1b9405bb7)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:17.157472 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e92d5-d696-42ef-9dce-20794d332cc8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:17.159338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 175/370] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 15 00:31:16 2022] GET /identity/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:17.160280 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e92d5-d696-42ef-9dce-20794d332cc8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:17.165791 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 196/371] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:17.166944 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7d859-1d10-421e-8f6b-2d6d4f48d72d None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:17.179469 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:17.278974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e92d5-d696-42ef-9dce-20794d332cc8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:17.288523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7d859-1d10-421e-8f6b-2d6d4f48d72d None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:17.317564 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea43b8b-b311-4ce9-b486-538106d1872d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:17.318546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea43b8b-b311-4ce9-b486-538106d1872d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:17.324392 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea43b8b-b311-4ce9-b486-538106d1872d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:17.324922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea43b8b-b311-4ce9-b486-538106d1872d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:17.328551 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f364610-8267-41ca-8c23-2ff7016b8a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:17.329187 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f364610-8267-41ca-8c23-2ff7016b8a3e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:17.329468 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f364610-8267-41ca-8c23-2ff7016b8a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:17.329730 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f364610-8267-41ca-8c23-2ff7016b8a3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:17.330454 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f364610-8267-41ca-8c23-2ff7016b8a3e None admin] RBAC: Adding query filter params (group.id=68c51ee5f80a4d3580f165c1b9405bb7, role.id=24171c44541e4c4782ec7d3f03b50467, scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:17.330768 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f364610-8267-41ca-8c23-2ff7016b8a3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:17.333256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f364610-8267-41ca-8c23-2ff7016b8a3e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:17.339745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 197/372] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Sep 15 00:31:17 2022] GET /identity/v3/role_assignments?group.id=68c51ee5f80a4d3580f165c1b9405bb7&scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b&role.id=24171c44541e4c4782ec7d3f03b50467 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:17.340546 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f364610-8267-41ca-8c23-2ff7016b8a3e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:17.353172 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:17.429279 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:17.454746 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea43b8b-b311-4ce9-b486-538106d1872d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:17.456831 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea43b8b-b311-4ce9-b486-538106d1872d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:17.466400 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f364610-8267-41ca-8c23-2ff7016b8a3e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:17.504225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0625a-51fe-41c6-92b0-c61c97b4f91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:17.504853 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0625a-51fe-41c6-92b0-c61c97b4f91c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:17.505156 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0625a-51fe-41c6-92b0-c61c97b4f91c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:17.505428 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0625a-51fe-41c6-92b0-c61c97b4f91c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:17.588926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0625a-51fe-41c6-92b0-c61c97b4f91c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:17.590393 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0625a-51fe-41c6-92b0-c61c97b4f91c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:17.626485 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 176/373] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:31:17.630887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea43b8b-b311-4ce9-b486-538106d1872d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:17.670961 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:17.688737 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:17.714125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 198/374] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:31:17.721559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0625a-51fe-41c6-92b0-c61c97b4f91c None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:17.748409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea43b8b-b311-4ce9-b486-538106d1872d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:17.790577 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adc319-058a-4ab8-bc0b-ff9894887e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:17.791223 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adc319-058a-4ab8-bc0b-ff9894887e22 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:17.791508 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adc319-058a-4ab8-bc0b-ff9894887e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:17.792480 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adc319-058a-4ab8-bc0b-ff9894887e22 None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:17.793316 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adc319-058a-4ab8-bc0b-ff9894887e22 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc5711794744f1c9ccc1b886cc1a21b)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:17.794783 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adc319-058a-4ab8-bc0b-ff9894887e22 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:17.796841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 177/375] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:31:17 2022] GET /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:31:17.802217 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adc319-058a-4ab8-bc0b-ff9894887e22 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:17.878810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0625a-51fe-41c6-92b0-c61c97b4f91c None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:17.941998 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56e33a-90e9-4fc4-bf5c-f0690759b262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:17.942742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56e33a-90e9-4fc4-bf5c-f0690759b262 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:17.942945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56e33a-90e9-4fc4-bf5c-f0690759b262 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:17.943169 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56e33a-90e9-4fc4-bf5c-f0690759b262 None admin] PATH_INFO: `/v3/projects/6940b89e115f47bd8dfdf0af975e2ba9` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:17.944294 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56e33a-90e9-4fc4-bf5c-f0690759b262 None admin] RBAC: Authorizing `identity:get_project(project_id=6940b89e115f47bd8dfdf0af975e2ba9)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:17.945747 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56e33a-90e9-4fc4-bf5c-f0690759b262 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:17.951913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 199/376] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:31:17 2022] GET /identity/v3/projects/6940b89e115f47bd8dfdf0af975e2ba9 => generated 344 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:17.953111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56e33a-90e9-4fc4-bf5c-f0690759b262 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:17.978590 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adc319-058a-4ab8-bc0b-ff9894887e22 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:17.997811 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:18.001390 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:18.022540 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783be4a0-0461-4ab0-9c3d-722f20155cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:18.023259 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783be4a0-0461-4ab0-9c3d-722f20155cda None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:18.023545 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783be4a0-0461-4ab0-9c3d-722f20155cda None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:18.023869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783be4a0-0461-4ab0-9c3d-722f20155cda None admin] PATH_INFO: `/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:18.025708 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783be4a0-0461-4ab0-9c3d-722f20155cda None admin] RBAC: Authorizing `identity:get_group(group_id=68c51ee5f80a4d3580f165c1b9405bb7)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:18.027164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783be4a0-0461-4ab0-9c3d-722f20155cda None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:18.029145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 178/377] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 15 00:31:17 2022] GET /identity/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:18.037868 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783be4a0-0461-4ab0-9c3d-722f20155cda None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:18.067199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56e33a-90e9-4fc4-bf5c-f0690759b262 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:18.106481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974d88c-9de9-4bc6-aec9-70af69f53f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:18.107132 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974d88c-9de9-4bc6-aec9-70af69f53f32 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:18.107410 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974d88c-9de9-4bc6-aec9-70af69f53f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:18.107682 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974d88c-9de9-4bc6-aec9-70af69f53f32 None admin] PATH_INFO: `/v3/groups/d1d91e25dcd243d09a95f761b2d8423d` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:18.114534 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974d88c-9de9-4bc6-aec9-70af69f53f32 None admin] RBAC: Authorizing `identity:get_group(group_id=d1d91e25dcd243d09a95f761b2d8423d)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:18.116873 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974d88c-9de9-4bc6-aec9-70af69f53f32 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:18.125451 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 200/378] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 15 00:31:17 2022] GET /identity/v3/groups/d1d91e25dcd243d09a95f761b2d8423d => generated 229 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:31:18.126906 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974d88c-9de9-4bc6-aec9-70af69f53f32 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:18.199594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783be4a0-0461-4ab0-9c3d-722f20155cda None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:18.237512 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974d88c-9de9-4bc6-aec9-70af69f53f32 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:18.239003 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:18.253832 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd94f9-618f-45da-8fe6-ecf2643f59e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:18.254456 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd94f9-618f-45da-8fe6-ecf2643f59e8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:18.254741 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd94f9-618f-45da-8fe6-ecf2643f59e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:18.255021 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd94f9-618f-45da-8fe6-ecf2643f59e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:18.255889 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd94f9-618f-45da-8fe6-ecf2643f59e8 None admin] RBAC: Adding query filter params (group.id=68c51ee5f80a4d3580f165c1b9405bb7, role.id=1c9b176504fd4d24b34942f724e63acf, scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:18.256152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd94f9-618f-45da-8fe6-ecf2643f59e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:18.257793 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd94f9-618f-45da-8fe6-ecf2643f59e8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:18.264506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 179/379] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Sep 15 00:31:18 2022] GET /identity/v3/role_assignments?group.id=68c51ee5f80a4d3580f165c1b9405bb7&scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b&role.id=1c9b176504fd4d24b34942f724e63acf => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:18.275657 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f192655-8c57-41c2-a001-ae60f54dc8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:18.276282 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f192655-8c57-41c2-a001-ae60f54dc8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:18.276555 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f192655-8c57-41c2-a001-ae60f54dc8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:18.276822 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f192655-8c57-41c2-a001-ae60f54dc8c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:18.277642 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f192655-8c57-41c2-a001-ae60f54dc8c5 None admin] RBAC: Adding query filter params (group.id=d1d91e25dcd243d09a95f761b2d8423d, role.id=0ee2daa9cb3c41fb901603e3d8caf784, scope.project.id=6940b89e115f47bd8dfdf0af975e2ba9) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:18.277947 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f192655-8c57-41c2-a001-ae60f54dc8c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:18.279371 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f192655-8c57-41c2-a001-ae60f54dc8c5 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:18.289840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6ac01-2380-4f2e-b731-b2406ea4effa None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:18.290241 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6ac01-2380-4f2e-b731-b2406ea4effa None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:18.290443 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6ac01-2380-4f2e-b731-b2406ea4effa None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:18.291857 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 180/381] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:31:18.292176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 201/381] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Sep 15 00:31:18 2022] GET /identity/v3/role_assignments?group.id=d1d91e25dcd243d09a95f761b2d8423d&scope.project.id=6940b89e115f47bd8dfdf0af975e2ba9&role.id=0ee2daa9cb3c41fb901603e3d8caf784 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:18.298149 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944d1f8-2fac-462c-9084-b649dc0a73b7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:18.298465 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944d1f8-2fac-462c-9084-b649dc0a73b7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:18.298699 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944d1f8-2fac-462c-9084-b649dc0a73b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:18.334250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d944d1f8-2fac-462c-9084-b649dc0a73b7 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:18.335492 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d944d1f8-2fac-462c-9084-b649dc0a73b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:18.391825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:18.435180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 181/382] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:18.729777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f192655-8c57-41c2-a001-ae60f54dc8c5 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:18.861196 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f192655-8c57-41c2-a001-ae60f54dc8c5 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:18.899797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4ba79-29f2-46db-b841-e7bb28a52d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:18.900438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4ba79-29f2-46db-b841-e7bb28a52d31 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:18.900717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4ba79-29f2-46db-b841-e7bb28a52d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:18.900986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4ba79-29f2-46db-b841-e7bb28a52d31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:18.912889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4ba79-29f2-46db-b841-e7bb28a52d31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:18.918460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-75c4ba79-29f2-46db-b841-e7bb28a52d31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:31:18.918460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:18.918460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:18.918460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:18.918460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:18.918460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:18.918460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:18.918460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:18.918460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:18.918460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:18.918460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:18.918460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:18.918460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:18.918460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:18.918460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:18.918460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:18.919348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:18.919348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:18.919348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:18.919348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:18.919348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:18.919348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:18.919348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:18.919348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:18.919348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:18.919348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:18.919348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:18.919348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:18.919348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:18.919348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:18.919348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:18.919348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:18.920135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:18.920135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:18.920135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:18.920135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:18.920135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:18.920135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:18.920135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:18.920135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:18.920135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:18.920135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:18.920135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:31:18.920135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:18.920135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 202/383] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:18.927010 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944d1f8-2fac-462c-9084-b649dc0a73b7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:19.051324 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944d1f8-2fac-462c-9084-b649dc0a73b7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:19.089865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6efe7-c45e-4b8c-9e4f-f277db88fdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:19.090819 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6efe7-c45e-4b8c-9e4f-f277db88fdf7 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:19.091305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6efe7-c45e-4b8c-9e4f-f277db88fdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:19.091773 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6efe7-c45e-4b8c-9e4f-f277db88fdf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:19.092634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6efe7-c45e-4b8c-9e4f-f277db88fdf7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:19.093218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6efe7-c45e-4b8c-9e4f-f277db88fdf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:19.094784 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6efe7-c45e-4b8c-9e4f-f277db88fdf7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:19.106433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 182/384] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:31:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:19.112405 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4ba79-29f2-46db-b841-e7bb28a52d31 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:19.146889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:19.249077 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4ba79-29f2-46db-b841-e7bb28a52d31 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:19.292589 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70250340-c3df-4e1c-9fe8-bb52c573dd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:19.293640 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70250340-c3df-4e1c-9fe8-bb52c573dd5f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:19.294159 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70250340-c3df-4e1c-9fe8-bb52c573dd5f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:19.294621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70250340-c3df-4e1c-9fe8-bb52c573dd5f None admin] PATH_INFO: `/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:19.299196 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70250340-c3df-4e1c-9fe8-bb52c573dd5f None admin] RBAC: Authorizing `identity:get_group(group_id=68c51ee5f80a4d3580f165c1b9405bb7)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:19.300821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70250340-c3df-4e1c-9fe8-bb52c573dd5f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:19.302679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 203/385] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 15 00:31:19 2022] GET /identity/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:19.308928 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6efe7-c45e-4b8c-9e4f-f277db88fdf7 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:19.362172 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:19.378502 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc512ab-57a0-4488-9d89-b8888feba088 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:19.378799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc512ab-57a0-4488-9d89-b8888feba088 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:19.379061 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc512ab-57a0-4488-9d89-b8888feba088 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:19.380401 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 204/386] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:19.398647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e66621-2cd5-48d1-9ccd-e6f8ae95f586 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:19.399444 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e66621-2cd5-48d1-9ccd-e6f8ae95f586 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:19.399716 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e66621-2cd5-48d1-9ccd-e6f8ae95f586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:19.431205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-39e66621-2cd5-48d1-9ccd-e6f8ae95f586 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:19.435014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-39e66621-2cd5-48d1-9ccd-e6f8ae95f586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:19.472368 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6efe7-c45e-4b8c-9e4f-f277db88fdf7 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:19.550442 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327e3e5-bd0d-4f2b-9772-79a1ce3d265d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:19.551459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327e3e5-bd0d-4f2b-9772-79a1ce3d265d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:19.551933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327e3e5-bd0d-4f2b-9772-79a1ce3d265d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:19.552370 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327e3e5-bd0d-4f2b-9772-79a1ce3d265d None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:19.553753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327e3e5-bd0d-4f2b-9772-79a1ce3d265d None admin] RBAC: Authorizing `identity:get_project(project_id=313898e8c5c24ba6860f81e2bba41fb6)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:19.555715 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327e3e5-bd0d-4f2b-9772-79a1ce3d265d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:19.558539 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 183/387] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:31:19 2022] GET /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:19.564988 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327e3e5-bd0d-4f2b-9772-79a1ce3d265d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:19.583857 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 205/388] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:31:19.715458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327e3e5-bd0d-4f2b-9772-79a1ce3d265d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:19.722092 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:19.756735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edaacf7-5069-4559-a42a-e58d15303831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:19.757420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edaacf7-5069-4559-a42a-e58d15303831 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:19.757698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edaacf7-5069-4559-a42a-e58d15303831 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:19.757971 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edaacf7-5069-4559-a42a-e58d15303831 None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6/groups/68c51ee5f80a4d3580f165c1b9405bb7/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:19.760412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edaacf7-5069-4559-a42a-e58d15303831 None admin] RBAC: Authorizing `identity:create_grant(project_id=313898e8c5c24ba6860f81e2bba41fb6, group_id=68c51ee5f80a4d3580f165c1b9405bb7, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:19.761964 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edaacf7-5069-4559-a42a-e58d15303831 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:19.785328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 184/389] 10.222.0.52 () {58 vars in 1442 bytes} [Thu Sep 15 00:31:19 2022] PUT /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6/groups/68c51ee5f80a4d3580f165c1b9405bb7/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:31:19.996278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e66621-2cd5-48d1-9ccd-e6f8ae95f586 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:20.030277 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:20.120535 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e66621-2cd5-48d1-9ccd-e6f8ae95f586 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:20.159776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2377cd2-b9e8-4091-8311-d3ff8c0baab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:20.160414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2377cd2-b9e8-4091-8311-d3ff8c0baab9 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:20.160694 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2377cd2-b9e8-4091-8311-d3ff8c0baab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:20.160959 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2377cd2-b9e8-4091-8311-d3ff8c0baab9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:20.174706 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2377cd2-b9e8-4091-8311-d3ff8c0baab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:20.179648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-b2377cd2-b9e8-4091-8311-d3ff8c0baab9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:31:20.179648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:20.179648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:20.179648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:20.179648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:20.179648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:20.179648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:20.179648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:20.179648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:20.179648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:20.179648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:20.179648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:20.179648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:20.179648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:20.179648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:20.179648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:20.180578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:20.180578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:20.180578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:20.180578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:20.180578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:20.180578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:20.180578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:20.180578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:20.180578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:20.180578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:20.180578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:20.180578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:20.180578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:20.180578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:20.180578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:20.180578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:20.181399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:20.181399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:20.181399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:20.181399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:20.181399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:20.181399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:20.181399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:20.181399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:20.181399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:20.181399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:20.181399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:31:20.181399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:20.183531 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 206/390] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 15 00:31:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:20.192244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edaacf7-5069-4559-a42a-e58d15303831 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:20.311076 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edaacf7-5069-4559-a42a-e58d15303831 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:20.357776 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ff09b-8436-4c6e-a6bc-10cf4a20ba21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:20.358384 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ff09b-8436-4c6e-a6bc-10cf4a20ba21 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:20.358659 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ff09b-8436-4c6e-a6bc-10cf4a20ba21 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:20.358921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ff09b-8436-4c6e-a6bc-10cf4a20ba21 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:20.359843 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ff09b-8436-4c6e-a6bc-10cf4a20ba21 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:20.360142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ff09b-8436-4c6e-a6bc-10cf4a20ba21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:20.361640 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ff09b-8436-4c6e-a6bc-10cf4a20ba21 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:20.372062 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 185/391] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:20.377523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2377cd2-b9e8-4091-8311-d3ff8c0baab9 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:20.389986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fecde4-27e4-4cc4-a551-d5c656fcf318 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:20.390260 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fecde4-27e4-4cc4-a551-d5c656fcf318 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:20.390539 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fecde4-27e4-4cc4-a551-d5c656fcf318 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:20.392112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 186/392] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:31:20.397908 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa6150-8f71-4509-b672-17e4bb116b48 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:20.398188 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa6150-8f71-4509-b672-17e4bb116b48 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:20.398456 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa6150-8f71-4509-b672-17e4bb116b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:20.420789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-46fa6150-8f71-4509-b672-17e4bb116b48 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:20.422453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-46fa6150-8f71-4509-b672-17e4bb116b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:20.451249 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:20.493740 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:20.512343 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2377cd2-b9e8-4091-8311-d3ff8c0baab9 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:20.521219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 187/393] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:20.551808 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5c4fb-00bd-4b35-a98f-8a7bd69d7aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:20.552851 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5c4fb-00bd-4b35-a98f-8a7bd69d7aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:20.553365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5c4fb-00bd-4b35-a98f-8a7bd69d7aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:20.553828 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5c4fb-00bd-4b35-a98f-8a7bd69d7aa4 None admin] PATH_INFO: `/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:20.555264 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5c4fb-00bd-4b35-a98f-8a7bd69d7aa4 None admin] RBAC: Authorizing `identity:get_group(group_id=68c51ee5f80a4d3580f165c1b9405bb7)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:20.557409 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5c4fb-00bd-4b35-a98f-8a7bd69d7aa4 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:20.559539 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 207/394] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 15 00:31:20 2022] GET /identity/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:31:20.564770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa6150-8f71-4509-b672-17e4bb116b48 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:20.696092 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa6150-8f71-4509-b672-17e4bb116b48 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:20.740083 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da2d48-bb1c-405e-9d28-bd1ac8e7697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:20.740712 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da2d48-bb1c-405e-9d28-bd1ac8e7697a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:20.740992 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da2d48-bb1c-405e-9d28-bd1ac8e7697a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:20.741299 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da2d48-bb1c-405e-9d28-bd1ac8e7697a None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:20.742512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da2d48-bb1c-405e-9d28-bd1ac8e7697a None admin] RBAC: Authorizing `identity:get_project(project_id=313898e8c5c24ba6860f81e2bba41fb6)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:20.744001 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da2d48-bb1c-405e-9d28-bd1ac8e7697a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:20.745670 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 188/395] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:31:20 2022] GET /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:20.751344 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5c4fb-00bd-4b35-a98f-8a7bd69d7aa4 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:20.841498 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da2d48-bb1c-405e-9d28-bd1ac8e7697a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:20.891677 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:20.892044 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5c4fb-00bd-4b35-a98f-8a7bd69d7aa4 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:20.935727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509b40f-4002-4110-842e-39b12f3af8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:20.936389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509b40f-4002-4110-842e-39b12f3af8a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:20.936665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509b40f-4002-4110-842e-39b12f3af8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:20.936934 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509b40f-4002-4110-842e-39b12f3af8a6 None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6/groups/68c51ee5f80a4d3580f165c1b9405bb7/roles/1c9b176504fd4d24b34942f724e63acf` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:20.939127 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6509b40f-4002-4110-842e-39b12f3af8a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=313898e8c5c24ba6860f81e2bba41fb6, group_id=68c51ee5f80a4d3580f165c1b9405bb7, role_id=1c9b176504fd4d24b34942f724e63acf)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:20.944368 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6509b40f-4002-4110-842e-39b12f3af8a6 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:20.956074 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 208/396] 10.222.0.52 () {58 vars in 1442 bytes} [Thu Sep 15 00:31:20 2022] PUT /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6/groups/68c51ee5f80a4d3580f165c1b9405bb7/roles/1c9b176504fd4d24b34942f724e63acf => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:31:21.052765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da2d48-bb1c-405e-9d28-bd1ac8e7697a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:21.104314 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562939c-7045-4a3d-bd91-c3a385d56371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:21.105239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562939c-7045-4a3d-bd91-c3a385d56371 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:21.105656 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562939c-7045-4a3d-bd91-c3a385d56371 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:21.106086 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562939c-7045-4a3d-bd91-c3a385d56371 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:21.123053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562939c-7045-4a3d-bd91-c3a385d56371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:21.129220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-2562939c-7045-4a3d-bd91-c3a385d56371 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:31:21.129220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:21.129220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:21.129220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:21.129220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:21.129220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:21.129220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:21.129220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:21.129220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:21.129220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:21.129220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:21.129220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:21.129220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:21.129220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:21.129220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:21.129220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:21.130338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:21.130338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:21.130338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:21.130338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:21.130338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:21.130338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:21.130338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:21.130338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:21.130338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:21.130338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:21.130338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:21.130338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:21.130338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:21.130338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:21.130338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:21.130338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:21.131305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:21.131305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:21.131305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:21.131305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:21.131305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:21.131305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:21.131305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:21.131305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:21.131305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:21.131305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:21.131305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:31:21.131305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:21.133745 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 189/397] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:21.140670 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509b40f-4002-4110-842e-39b12f3af8a6 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:21.177544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:21.293295 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509b40f-4002-4110-842e-39b12f3af8a6 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:21.329252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189484f-9867-4846-b2e5-cca220dd52b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:21.329860 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189484f-9867-4846-b2e5-cca220dd52b9 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:21.330135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189484f-9867-4846-b2e5-cca220dd52b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:21.330399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189484f-9867-4846-b2e5-cca220dd52b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:21.331055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189484f-9867-4846-b2e5-cca220dd52b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:21.331353 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189484f-9867-4846-b2e5-cca220dd52b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:21.333310 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189484f-9867-4846-b2e5-cca220dd52b9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:21.343558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 209/398] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:31:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:21.349562 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562939c-7045-4a3d-bd91-c3a385d56371 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:21.362355 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369b9dc-c831-4c19-8508-47f7fd61ad66 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:21.362945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369b9dc-c831-4c19-8508-47f7fd61ad66 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:21.363607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369b9dc-c831-4c19-8508-47f7fd61ad66 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:21.366707 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 210/399] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:21.376591 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90366a00-334c-428f-9626-d71ee82695e6 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:21.377441 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90366a00-334c-428f-9626-d71ee82695e6 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:21.377997 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90366a00-334c-428f-9626-d71ee82695e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:21.401657 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-90366a00-334c-428f-9626-d71ee82695e6 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:21.403587 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-90366a00-334c-428f-9626-d71ee82695e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:21.482082 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 211/400] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:31:21.505859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:21.524416 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562939c-7045-4a3d-bd91-c3a385d56371 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:21.560948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625af21-4831-4d2b-ad3a-06f58ad91d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:21.561952 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625af21-4831-4d2b-ad3a-06f58ad91d76 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:21.562399 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625af21-4831-4d2b-ad3a-06f58ad91d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:21.562818 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625af21-4831-4d2b-ad3a-06f58ad91d76 None admin] PATH_INFO: `/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:21.564069 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625af21-4831-4d2b-ad3a-06f58ad91d76 None admin] RBAC: Authorizing `identity:get_group(group_id=68c51ee5f80a4d3580f165c1b9405bb7)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:21.565679 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625af21-4831-4d2b-ad3a-06f58ad91d76 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:21.567665 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 190/401] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 15 00:31:21 2022] GET /identity/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:31:21.573661 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90366a00-334c-428f-9626-d71ee82695e6 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:21.577406 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:21.623132 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd49b7-539c-4201-84c7-d57710991982 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:21.623372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd49b7-539c-4201-84c7-d57710991982 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:21.623599 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd49b7-539c-4201-84c7-d57710991982 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:21.625213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 191/402] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:21.630502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6866668-32d4-465f-9487-568fea122232 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:21.630812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6866668-32d4-465f-9487-568fea122232 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:21.631466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6866668-32d4-465f-9487-568fea122232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:21.658453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b6866668-32d4-465f-9487-568fea122232 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:21.659932 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b6866668-32d4-465f-9487-568fea122232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:21.708564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90366a00-334c-428f-9626-d71ee82695e6 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:21.751576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c30d5-77a8-45d6-978f-9efdd2aadf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:21.752207 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c30d5-77a8-45d6-978f-9efdd2aadf4b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:21.752484 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c30d5-77a8-45d6-978f-9efdd2aadf4b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:21.752752 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c30d5-77a8-45d6-978f-9efdd2aadf4b None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:21.754007 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c30d5-77a8-45d6-978f-9efdd2aadf4b None admin] RBAC: Authorizing `identity:get_project(project_id=7cc5711794744f1c9ccc1b886cc1a21b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:21.756662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c30d5-77a8-45d6-978f-9efdd2aadf4b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:21.763369 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 212/403] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:31:21 2022] GET /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:21.765360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c30d5-77a8-45d6-978f-9efdd2aadf4b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:21.787644 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 192/404] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:31:21.816262 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6866668-32d4-465f-9487-568fea122232 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:21.900197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:21.964635 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:21.969115 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c30d5-77a8-45d6-978f-9efdd2aadf4b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:21.996019 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6866668-32d4-465f-9487-568fea122232 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:22.002761 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb30c91-cdf5-4e5c-a7b4-547729763db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:22.003545 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb30c91-cdf5-4e5c-a7b4-547729763db2 None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:22.003900 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb30c91-cdf5-4e5c-a7b4-547729763db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:22.004230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb30c91-cdf5-4e5c-a7b4-547729763db2 None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b/groups/68c51ee5f80a4d3580f165c1b9405bb7/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:22.006292 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb30c91-cdf5-4e5c-a7b4-547729763db2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cc5711794744f1c9ccc1b886cc1a21b, group_id=68c51ee5f80a4d3580f165c1b9405bb7, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:22.007943 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb30c91-cdf5-4e5c-a7b4-547729763db2 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:22.033807 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 213/405] 10.222.0.52 () {58 vars in 1442 bytes} [Thu Sep 15 00:31:21 2022] PUT /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b/groups/68c51ee5f80a4d3580f165c1b9405bb7/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:31:22.049690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a611578-0de4-4677-9d0f-0e2de264062c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:22.050337 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a611578-0de4-4677-9d0f-0e2de264062c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:22.050610 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a611578-0de4-4677-9d0f-0e2de264062c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:22.050877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a611578-0de4-4677-9d0f-0e2de264062c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:22.064309 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a611578-0de4-4677-9d0f-0e2de264062c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:22.069483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-0a611578-0de4-4677-9d0f-0e2de264062c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:31:22.069483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:22.069483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:22.069483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:22.069483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:22.069483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:22.069483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:22.069483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:22.069483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:22.069483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:22.069483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:22.069483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:22.069483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:22.069483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:22.069483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:22.069483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:22.070357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:22.070357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:22.070357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:22.070357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:22.070357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:22.070357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:22.070357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:22.070357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:22.070357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:22.070357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:22.070357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:22.070357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:22.070357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:22.070357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:22.070357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:22.070357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:22.071173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:22.071173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:22.071173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:22.071173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:22.071173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:22.071173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:22.071173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:22.071173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:22.071173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:22.071173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:22.071173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:31:22.071173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:22.071173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 193/406] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:31:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:22.076737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb30c91-cdf5-4e5c-a7b4-547729763db2 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:22.183516 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a611578-0de4-4677-9d0f-0e2de264062c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:22.203495 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb30c91-cdf5-4e5c-a7b4-547729763db2 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:22.247600 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a44fd-13c7-48e7-9cae-4a46b574e28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:22.248222 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a44fd-13c7-48e7-9cae-4a46b574e28e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:22.248496 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a44fd-13c7-48e7-9cae-4a46b574e28e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:22.248764 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a44fd-13c7-48e7-9cae-4a46b574e28e None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:22.249493 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a44fd-13c7-48e7-9cae-4a46b574e28e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:22.249797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a44fd-13c7-48e7-9cae-4a46b574e28e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:22.251331 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a44fd-13c7-48e7-9cae-4a46b574e28e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:22.257478 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:22.262702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 214/407] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:31:22.267925 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a44fd-13c7-48e7-9cae-4a46b574e28e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:22.358189 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a611578-0de4-4677-9d0f-0e2de264062c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:22.393008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a44fd-13c7-48e7-9cae-4a46b574e28e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:22.396351 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410bf10-4790-4acc-9552-526e86ec2d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:22.396975 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410bf10-4790-4acc-9552-526e86ec2d87 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:22.397286 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410bf10-4790-4acc-9552-526e86ec2d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:22.397560 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410bf10-4790-4acc-9552-526e86ec2d87 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:22.408062 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410bf10-4790-4acc-9552-526e86ec2d87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:22.412934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-b410bf10-4790-4acc-9552-526e86ec2d87 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:31:22.412934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:22.412934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:22.412934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:22.412934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:22.412934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:22.412934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:22.412934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:22.412934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:22.412934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:22.412934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:22.412934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:22.412934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:22.412934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:22.412934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:22.412934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:22.413802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:22.413802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:22.413802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:22.413802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:22.413802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:22.413802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:22.413802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:22.413802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:22.413802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:22.413802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:22.413802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:22.413802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:22.413802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:22.413802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:22.413802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:22.413802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:22.414685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:22.414685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:22.414685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:22.414685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:22.414685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:22.414685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:22.414685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:22.414685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:22.414685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:22.414685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:22.414685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:31:22.414685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:22.422662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 194/408] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 15 00:31:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:31:22.428385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410bf10-4790-4acc-9552-526e86ec2d87 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:22.429628 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bc4c3-2063-4228-b76d-21d563436aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:22.430969 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bc4c3-2063-4228-b76d-21d563436aba None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:22.431247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bc4c3-2063-4228-b76d-21d563436aba None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:22.431513 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237bc4c3-2063-4228-b76d-21d563436aba None admin] PATH_INFO: `/v3/groups/d1d91e25dcd243d09a95f761b2d8423d` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:22.432636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bc4c3-2063-4228-b76d-21d563436aba None admin] RBAC: Authorizing `identity:get_group(group_id=d1d91e25dcd243d09a95f761b2d8423d)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:22.434318 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237bc4c3-2063-4228-b76d-21d563436aba None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:22.436134 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:22.437041 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 215/409] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 15 00:31:22 2022] GET /identity/v3/groups/d1d91e25dcd243d09a95f761b2d8423d => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:31:22.441731 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bc4c3-2063-4228-b76d-21d563436aba None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:22.511619 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:22.562456 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237bc4c3-2063-4228-b76d-21d563436aba None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:22.602869 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49d485-7b1b-4afa-9186-4a0305010156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:22.603928 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49d485-7b1b-4afa-9186-4a0305010156 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:22.604332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49d485-7b1b-4afa-9186-4a0305010156 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:22.604790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49d485-7b1b-4afa-9186-4a0305010156 None admin] PATH_INFO: `/v3/projects/6940b89e115f47bd8dfdf0af975e2ba9` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:22.606390 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49d485-7b1b-4afa-9186-4a0305010156 None admin] RBAC: Authorizing `identity:get_project(project_id=6940b89e115f47bd8dfdf0af975e2ba9)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:22.607937 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49d485-7b1b-4afa-9186-4a0305010156 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:22.610328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 216/410] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:31:22 2022] GET /identity/v3/projects/6940b89e115f47bd8dfdf0af975e2ba9 => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:31:22.618785 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49d485-7b1b-4afa-9186-4a0305010156 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:22.652781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410bf10-4790-4acc-9552-526e86ec2d87 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:22.705483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a38186-c6be-4427-a7a3-64254f1ca6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:22.707144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a38186-c6be-4427-a7a3-64254f1ca6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:22.707569 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a38186-c6be-4427-a7a3-64254f1ca6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:22.707996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a38186-c6be-4427-a7a3-64254f1ca6c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:22.708795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a38186-c6be-4427-a7a3-64254f1ca6c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:22.709258 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a38186-c6be-4427-a7a3-64254f1ca6c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:22.710768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a38186-c6be-4427-a7a3-64254f1ca6c9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:22.726486 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 195/411] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:31:22.726486 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0199c7-396d-40a0-9b70-b45a3bdde1cc None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:22.728123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0199c7-396d-40a0-9b70-b45a3bdde1cc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:22.728400 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0199c7-396d-40a0-9b70-b45a3bdde1cc None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:22.729946 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 196/412] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:22.730649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0199c7-396d-40a0-9b70-b45a3bdde1cc None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:22.746003 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49d485-7b1b-4afa-9186-4a0305010156 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:22.774813 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:22.780988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b66de-64b8-438f-94c2-177c3f211b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:22.781911 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b66de-64b8-438f-94c2-177c3f211b9b None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:22.782325 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b66de-64b8-438f-94c2-177c3f211b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:22.782737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b66de-64b8-438f-94c2-177c3f211b9b None admin] PATH_INFO: `/v3/projects/6940b89e115f47bd8dfdf0af975e2ba9/groups/d1d91e25dcd243d09a95f761b2d8423d/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:22.784813 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b66de-64b8-438f-94c2-177c3f211b9b None admin] RBAC: Authorizing `identity:create_grant(project_id=6940b89e115f47bd8dfdf0af975e2ba9, group_id=d1d91e25dcd243d09a95f761b2d8423d, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:22.786415 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b66de-64b8-438f-94c2-177c3f211b9b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:22.817122 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 217/413] 10.222.0.52 () {58 vars in 1442 bytes} [Thu Sep 15 00:31:22 2022] PUT /identity/v3/projects/6940b89e115f47bd8dfdf0af975e2ba9/groups/d1d91e25dcd243d09a95f761b2d8423d/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:31:22.817122 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bafd56-6059-46bc-a168-0866fa57c674 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:22.817122 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bafd56-6059-46bc-a168-0866fa57c674 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:22.817122 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bafd56-6059-46bc-a168-0866fa57c674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:22.835777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:22.838203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-33bafd56-6059-46bc-a168-0866fa57c674 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:22.839702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-33bafd56-6059-46bc-a168-0866fa57c674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:22.925599 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0199c7-396d-40a0-9b70-b45a3bdde1cc None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:22.968564 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c3039-ff12-4afe-a010-7ad5b0e78c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:22.969191 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c3039-ff12-4afe-a010-7ad5b0e78c49 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:22.969515 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c3039-ff12-4afe-a010-7ad5b0e78c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:22.969847 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c3039-ff12-4afe-a010-7ad5b0e78c49 None admin] PATH_INFO: `/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:22.971067 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c3039-ff12-4afe-a010-7ad5b0e78c49 None admin] RBAC: Authorizing `identity:get_group(group_id=68c51ee5f80a4d3580f165c1b9405bb7)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:22.972517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c3039-ff12-4afe-a010-7ad5b0e78c49 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:22.974513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 197/414] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 15 00:31:22 2022] GET /identity/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7 => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:22.981898 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c3039-ff12-4afe-a010-7ad5b0e78c49 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:22.988896 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 218/415] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:23.105381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c3039-ff12-4afe-a010-7ad5b0e78c49 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:23.144596 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:23.148356 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50c5a8-0c86-4858-98b4-f4b2cba726be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:23.150001 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50c5a8-0c86-4858-98b4-f4b2cba726be None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:23.153433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50c5a8-0c86-4858-98b4-f4b2cba726be None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:23.153862 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50c5a8-0c86-4858-98b4-f4b2cba726be None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:23.155205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50c5a8-0c86-4858-98b4-f4b2cba726be None admin] RBAC: Authorizing `identity:get_project(project_id=7cc5711794744f1c9ccc1b886cc1a21b)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:23.156788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50c5a8-0c86-4858-98b4-f4b2cba726be None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:23.158599 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 198/416] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:31:22 2022] GET /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:23.164391 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bafd56-6059-46bc-a168-0866fa57c674 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:23.295443 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bafd56-6059-46bc-a168-0866fa57c674 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:23.337426 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:23.364005 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7defab-4e53-48cd-aee9-82daecd2bbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:23.364683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7defab-4e53-48cd-aee9-82daecd2bbec None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:23.364962 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7defab-4e53-48cd-aee9-82daecd2bbec None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:23.365262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7defab-4e53-48cd-aee9-82daecd2bbec None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b/groups/68c51ee5f80a4d3580f165c1b9405bb7/roles/1c9b176504fd4d24b34942f724e63acf` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:23.370865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7defab-4e53-48cd-aee9-82daecd2bbec None admin] RBAC: Authorizing `identity:create_grant(project_id=7cc5711794744f1c9ccc1b886cc1a21b, group_id=68c51ee5f80a4d3580f165c1b9405bb7, role_id=1c9b176504fd4d24b34942f724e63acf)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:23.372306 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7defab-4e53-48cd-aee9-82daecd2bbec None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:23.376001 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50c5a8-0c86-4858-98b4-f4b2cba726be None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:23.394017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 219/417] 10.222.0.52 () {58 vars in 1442 bytes} [Thu Sep 15 00:31:23 2022] PUT /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b/groups/68c51ee5f80a4d3580f165c1b9405bb7/roles/1c9b176504fd4d24b34942f724e63acf => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:31:23.506581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50c5a8-0c86-4858-98b4-f4b2cba726be None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:23.559228 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc20dd6-4c28-49a9-ad94-fbda9b9045ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:23.560284 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc20dd6-4c28-49a9-ad94-fbda9b9045ee None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:23.560772 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc20dd6-4c28-49a9-ad94-fbda9b9045ee None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:23.561310 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc20dd6-4c28-49a9-ad94-fbda9b9045ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:23.579598 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc20dd6-4c28-49a9-ad94-fbda9b9045ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:23.585673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-0bc20dd6-4c28-49a9-ad94-fbda9b9045ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:31:23.585673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:23.585673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:23.585673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:23.585673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:23.585673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:23.585673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:23.585673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:23.585673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:23.585673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:23.585673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:23.585673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:23.585673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:23.585673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:23.585673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:23.585673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:23.587239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:23.587239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:23.587239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:23.587239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:23.587239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:23.587239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:23.587239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:23.587239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:23.587239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:23.587239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:23.587239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:23.587239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:23.587239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:23.587239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:23.587239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:23.587239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:23.588044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:23.588044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:23.588044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:23.588044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:23.588044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:23.588044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:23.588044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:23.588044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:23.588044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:23.588044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:23.588044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:31:23.588044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:23.590561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 199/418] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:31:23.602308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7defab-4e53-48cd-aee9-82daecd2bbec None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:23.679949 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b70cb-8ae2-4f1b-992b-9a45e6550673 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:23.680614 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b70cb-8ae2-4f1b-992b-9a45e6550673 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:23.681078 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b70cb-8ae2-4f1b-992b-9a45e6550673 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:23.683065 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 200/419] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:31:23.690204 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c3dfd-b32b-4ce2-8e6c-9676e5f15f01 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:23.690754 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c3dfd-b32b-4ce2-8e6c-9676e5f15f01 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:23.691239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c3dfd-b32b-4ce2-8e6c-9676e5f15f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:23.717187 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-217c3dfd-b32b-4ce2-8e6c-9676e5f15f01 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:23.718153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-217c3dfd-b32b-4ce2-8e6c-9676e5f15f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:23.720571 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7defab-4e53-48cd-aee9-82daecd2bbec None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:23.769905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c892e3-6e1e-487c-92d9-4e6f109a065d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:23.770979 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c892e3-6e1e-487c-92d9-4e6f109a065d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:23.771452 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c892e3-6e1e-487c-92d9-4e6f109a065d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:23.771914 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c892e3-6e1e-487c-92d9-4e6f109a065d None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:23.772781 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c892e3-6e1e-487c-92d9-4e6f109a065d None admin] RBAC: Adding query filter params (name=member) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:23.773992 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c892e3-6e1e-487c-92d9-4e6f109a065d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:23.775582 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c892e3-6e1e-487c-92d9-4e6f109a065d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:23.785863 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 220/420] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:31:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:23.794178 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c892e3-6e1e-487c-92d9-4e6f109a065d None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:23.810122 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:23.827830 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 201/421] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:31:23.864109 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:23.941513 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c892e3-6e1e-487c-92d9-4e6f109a065d None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:23.988268 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3f749-e312-45ae-b7ef-042035c0642e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:23.988879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3f749-e312-45ae-b7ef-042035c0642e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:23.989180 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3f749-e312-45ae-b7ef-042035c0642e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:23.989451 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3f749-e312-45ae-b7ef-042035c0642e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:24.076419 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3f749-e312-45ae-b7ef-042035c0642e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:24.077927 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3f749-e312-45ae-b7ef-042035c0642e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:24.135103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:24.136434 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c3dfd-b32b-4ce2-8e6c-9676e5f15f01 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:24.249499 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 221/422] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:31:24.254520 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3f749-e312-45ae-b7ef-042035c0642e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:24.269360 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c3dfd-b32b-4ce2-8e6c-9676e5f15f01 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:24.349585 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d7652-3a79-449f-b0b3-44f2b222e299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:24.350230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d7652-3a79-449f-b0b3-44f2b222e299 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:24.350500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d7652-3a79-449f-b0b3-44f2b222e299 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:24.350765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d7652-3a79-449f-b0b3-44f2b222e299 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:24.376420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d7652-3a79-449f-b0b3-44f2b222e299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:24.386120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-552d7652-3a79-449f-b0b3-44f2b222e299 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:31:24.386120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:24.386120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:24.386120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:24.386120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:24.386120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:24.386120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:24.386120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:24.386120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:24.386120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:24.386120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:24.386120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:24.386120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:24.386120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:24.386120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:24.386120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:24.387024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:24.387024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:24.387024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:24.387024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:24.387024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:24.387024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:24.387024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:24.387024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:24.387024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:24.387024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:24.387024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:24.387024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:24.387024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:24.387024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:24.387024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:24.387024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:24.387798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:24.387798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:24.387798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:24.387798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:24.387798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:24.387798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:24.387798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:24.387798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:24.387798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:24.387798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:24.387798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:31:24.387798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:24.387798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 202/423] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 15 00:31:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:24.393007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d7652-3a79-449f-b0b3-44f2b222e299 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:24.437406 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3f749-e312-45ae-b7ef-042035c0642e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:24.509458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:24.510396 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e256c-c007-459f-82cf-989d86f4290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:24.510799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e256c-c007-459f-82cf-989d86f4290a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:24.512142 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e256c-c007-459f-82cf-989d86f4290a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:24.512421 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e256c-c007-459f-82cf-989d86f4290a None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:24.513738 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e256c-c007-459f-82cf-989d86f4290a None admin] RBAC: Authorizing `identity:get_project(project_id=313898e8c5c24ba6860f81e2bba41fb6)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:24.518239 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e256c-c007-459f-82cf-989d86f4290a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:24.522325 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 222/424] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:31:24 2022] GET /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:24.526149 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e256c-c007-459f-82cf-989d86f4290a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:24.556943 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:24.605802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d7652-3a79-449f-b0b3-44f2b222e299 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:24.647745 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd635b-10da-418e-830f-7bbbaeff02ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:24.648346 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd635b-10da-418e-830f-7bbbaeff02ae None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:24.648625 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd635b-10da-418e-830f-7bbbaeff02ae None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:24.648955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd635b-10da-418e-830f-7bbbaeff02ae None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:24.649637 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd635b-10da-418e-830f-7bbbaeff02ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:24.649940 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd635b-10da-418e-830f-7bbbaeff02ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:24.651316 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd635b-10da-418e-830f-7bbbaeff02ae None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:24.659620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 203/425] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:24.666442 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd635b-10da-418e-830f-7bbbaeff02ae None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:24.738690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e256c-c007-459f-82cf-989d86f4290a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:24.827981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203bc7f-a932-422d-bb2b-da93190a9bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:24.828620 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203bc7f-a932-422d-bb2b-da93190a9bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:24.829872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203bc7f-a932-422d-bb2b-da93190a9bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:24.830149 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203bc7f-a932-422d-bb2b-da93190a9bb7 None admin] PATH_INFO: `/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:24.832668 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203bc7f-a932-422d-bb2b-da93190a9bb7 None admin] RBAC: Authorizing `identity:get_group(group_id=68c51ee5f80a4d3580f165c1b9405bb7)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:24.834113 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203bc7f-a932-422d-bb2b-da93190a9bb7 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:24.835679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 223/426] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 15 00:31:24 2022] GET /identity/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7 => generated 226 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:24.842812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203bc7f-a932-422d-bb2b-da93190a9bb7 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:24.875966 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd635b-10da-418e-830f-7bbbaeff02ae None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:24.896632 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:24.922642 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926a315-1871-4dce-b6a5-c18c9319fe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:24.924436 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926a315-1871-4dce-b6a5-c18c9319fe77 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:24.924938 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926a315-1871-4dce-b6a5-c18c9319fe77 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:24.925428 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926a315-1871-4dce-b6a5-c18c9319fe77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:24.932373 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:24.957125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203bc7f-a932-422d-bb2b-da93190a9bb7 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:25.000508 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b495b-6ace-4471-b05f-3cad9b537c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:25.001760 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b495b-6ace-4471-b05f-3cad9b537c0f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:25.002659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b495b-6ace-4471-b05f-3cad9b537c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:25.003392 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b495b-6ace-4471-b05f-3cad9b537c0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:25.004433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b495b-6ace-4471-b05f-3cad9b537c0f None admin] RBAC: Adding query filter params (group.id=68c51ee5f80a4d3580f165c1b9405bb7, role.id=24171c44541e4c4782ec7d3f03b50467, scope.project.id=313898e8c5c24ba6860f81e2bba41fb6) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:25.005050 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b495b-6ace-4471-b05f-3cad9b537c0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:25.006721 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b495b-6ace-4471-b05f-3cad9b537c0f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:25.014379 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926a315-1871-4dce-b6a5-c18c9319fe77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:25.017136 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926a315-1871-4dce-b6a5-c18c9319fe77 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:25.021306 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 224/427] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Sep 15 00:31:24 2022] GET /identity/v3/role_assignments?group.id=68c51ee5f80a4d3580f165c1b9405bb7&scope.project.id=313898e8c5c24ba6860f81e2bba41fb6&role.id=24171c44541e4c4782ec7d3f03b50467 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:25.023943 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd4cc-8560-45dc-836d-f865f663a71c None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:25.024225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd4cc-8560-45dc-836d-f865f663a71c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:25.024496 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd4cc-8560-45dc-836d-f865f663a71c None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:25.030153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 225/428] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:25.037939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27536703-9abb-4ced-8643-3c26563be2a7 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:25.038212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27536703-9abb-4ced-8643-3c26563be2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:25.038481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27536703-9abb-4ced-8643-3c26563be2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:25.070052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-27536703-9abb-4ced-8643-3c26563be2a7 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:25.072999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-27536703-9abb-4ced-8643-3c26563be2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:25.200400 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 226/429] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:31:25.209880 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 204/430] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:31:25.220148 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27536703-9abb-4ced-8643-3c26563be2a7 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:25.306529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:25.340103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27536703-9abb-4ced-8643-3c26563be2a7 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:25.379529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2119f-b4d7-43fc-beb2-e22af57aa429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:25.380232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2119f-b4d7-43fc-beb2-e22af57aa429 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:25.380515 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2119f-b4d7-43fc-beb2-e22af57aa429 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:25.380787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2119f-b4d7-43fc-beb2-e22af57aa429 None admin] PATH_INFO: `/v3/projects/313898e8c5c24ba6860f81e2bba41fb6` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:25.382071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2119f-b4d7-43fc-beb2-e22af57aa429 None admin] RBAC: Authorizing `identity:get_project(project_id=313898e8c5c24ba6860f81e2bba41fb6)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:25.384090 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2119f-b4d7-43fc-beb2-e22af57aa429 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:25.386153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 227/431] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:31:25 2022] GET /identity/v3/projects/313898e8c5c24ba6860f81e2bba41fb6 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:25.391430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926a315-1871-4dce-b6a5-c18c9319fe77 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:25.412746 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:25.500766 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc659568-3162-4fc2-a3dd-8c898209f035 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:25.501268 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc659568-3162-4fc2-a3dd-8c898209f035 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:25.501268 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc659568-3162-4fc2-a3dd-8c898209f035 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:25.502839 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 228/432] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:25.508828 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d0bff-b2bc-4262-89df-2d68124d5eec None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:25.509136 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d0bff-b2bc-4262-89df-2d68124d5eec None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:25.509416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d0bff-b2bc-4262-89df-2d68124d5eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:25.532596 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926a315-1871-4dce-b6a5-c18c9319fe77 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:25.534956 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-e35d0bff-b2bc-4262-89df-2d68124d5eec None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:25.536155 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e35d0bff-b2bc-4262-89df-2d68124d5eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:25.576344 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da917f5-ff0e-4626-af72-deb4952e8a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:25.576936 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da917f5-ff0e-4626-af72-deb4952e8a92 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:25.577251 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da917f5-ff0e-4626-af72-deb4952e8a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:25.577522 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da917f5-ff0e-4626-af72-deb4952e8a92 None admin] PATH_INFO: `/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:25.578868 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da917f5-ff0e-4626-af72-deb4952e8a92 None admin] RBAC: Authorizing `identity:get_group(group_id=68c51ee5f80a4d3580f165c1b9405bb7)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:25.580306 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da917f5-ff0e-4626-af72-deb4952e8a92 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:25.582099 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 205/433] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 15 00:31:25 2022] GET /identity/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:25.582641 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da917f5-ff0e-4626-af72-deb4952e8a92 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:25.626381 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 229/434] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:31:25.627223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d0bff-b2bc-4262-89df-2d68124d5eec None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:25.708124 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da917f5-ff0e-4626-af72-deb4952e8a92 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:25.711008 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:25.721339 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:25.751412 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d0bff-b2bc-4262-89df-2d68124d5eec None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:25.753857 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0c53d-e5bf-4ed9-aaea-ba05616ee3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:25.754717 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0c53d-e5bf-4ed9-aaea-ba05616ee3dd None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:25.755003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0c53d-e5bf-4ed9-aaea-ba05616ee3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:25.755278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0c53d-e5bf-4ed9-aaea-ba05616ee3dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:25.770332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0c53d-e5bf-4ed9-aaea-ba05616ee3dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:25.780328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-e1e0c53d-e5bf-4ed9-aaea-ba05616ee3dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:31:25.780328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:25.780328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:25.780328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:25.780328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:25.780328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:25.780328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:25.780328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:25.780328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:25.780328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:25.780328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:25.780328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:25.780328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:25.780328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:25.780328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:25.780328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:25.781446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:25.781446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:25.781446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:25.781446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:25.781446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:25.781446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:25.781446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:25.781446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:25.781446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:25.781446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:25.781446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:25.781446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:25.781446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:25.781446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:25.781446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:25.781446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:25.782512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:25.782512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:25.782512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:25.782512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:25.782512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:25.782512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:25.782512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:25.782512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:25.782512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:25.782512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:25.782512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 00:31:25.782512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:25.783248 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 206/435] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:25.789911 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0c53d-e5bf-4ed9-aaea-ba05616ee3dd None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:25.796411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3956cc0-d056-4e03-92f4-1c8b80ab25f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:25.797028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3956cc0-d056-4e03-92f4-1c8b80ab25f8 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:25.797372 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3956cc0-d056-4e03-92f4-1c8b80ab25f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:25.797650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3956cc0-d056-4e03-92f4-1c8b80ab25f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:25.798435 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3956cc0-d056-4e03-92f4-1c8b80ab25f8 None admin] RBAC: Adding query filter params (group.id=68c51ee5f80a4d3580f165c1b9405bb7, role.id=1c9b176504fd4d24b34942f724e63acf, scope.project.id=313898e8c5c24ba6860f81e2bba41fb6) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:25.798742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3956cc0-d056-4e03-92f4-1c8b80ab25f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:25.800708 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3956cc0-d056-4e03-92f4-1c8b80ab25f8 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:25.808619 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 230/436] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Sep 15 00:31:25 2022] GET /identity/v3/role_assignments?group.id=68c51ee5f80a4d3580f165c1b9405bb7&scope.project.id=313898e8c5c24ba6860f81e2bba41fb6&role.id=1c9b176504fd4d24b34942f724e63acf => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:25.910240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0c53d-e5bf-4ed9-aaea-ba05616ee3dd None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:25.948219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37687b71-8144-4352-8a2e-25a53242624d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:25.948838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37687b71-8144-4352-8a2e-25a53242624d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:25.949143 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37687b71-8144-4352-8a2e-25a53242624d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:25.949413 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37687b71-8144-4352-8a2e-25a53242624d None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:25.950091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37687b71-8144-4352-8a2e-25a53242624d None admin] RBAC: Adding query filter params (name=member) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:25.950388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37687b71-8144-4352-8a2e-25a53242624d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:25.951880 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37687b71-8144-4352-8a2e-25a53242624d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:25.967040 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 207/437] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:31:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:31:25.968773 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3956cc0-d056-4e03-92f4-1c8b80ab25f8 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:25.970177 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37687b71-8144-4352-8a2e-25a53242624d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:25.973266 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:26.083996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37687b71-8144-4352-8a2e-25a53242624d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:26.093368 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3956cc0-d056-4e03-92f4-1c8b80ab25f8 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:26.121307 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09dee72-475e-4c61-b882-bc299609b6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:26.121998 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dee72-475e-4c61-b882-bc299609b6cb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:26.122275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dee72-475e-4c61-b882-bc299609b6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:26.122550 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dee72-475e-4c61-b882-bc299609b6cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:26.134863 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09dee72-475e-4c61-b882-bc299609b6cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:26.139313 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31d58e-7ff8-4d5c-81ef-0dbce222e01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:26.139998 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31d58e-7ff8-4d5c-81ef-0dbce222e01f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:26.140271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31d58e-7ff8-4d5c-81ef-0dbce222e01f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:26.140537 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31d58e-7ff8-4d5c-81ef-0dbce222e01f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:26.141321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-b09dee72-475e-4c61-b882-bc299609b6cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:31:26.141321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:26.141321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:26.141321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:26.141321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:26.141321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:26.141321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:26.141321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:26.141321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:26.141321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:26.141321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:26.141321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:26.141321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:26.141321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:26.141321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:26.141321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:26.142141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:26.142141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:26.142141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:26.142141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:26.142141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:26.142141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:26.142141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:26.142141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:26.142141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:26.142141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:26.142141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:26.142141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:26.142141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:26.142141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:26.142141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:26.142141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:26.142931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:26.142931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:26.142931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:26.142931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:26.142931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:26.142931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:26.142931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:26.142931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:26.142931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:26.142931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:26.142931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:31:26.142931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:26.142931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 208/438] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:31:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:26.143573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:26.143638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db99a8-ae13-4de0-934a-39bf067d832c None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:26.144039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db99a8-ae13-4de0-934a-39bf067d832c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:26.144153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db99a8-ae13-4de0-934a-39bf067d832c None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:26.149284 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 209/439] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:26.149418 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db99a8-ae13-4de0-934a-39bf067d832c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:26.227369 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:26.236663 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31d58e-7ff8-4d5c-81ef-0dbce222e01f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:26.238132 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31d58e-7ff8-4d5c-81ef-0dbce222e01f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:26.267609 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db99a8-ae13-4de0-934a-39bf067d832c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:26.300019 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548fb7d-8e15-40f7-b677-10c2db745518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:26.300607 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548fb7d-8e15-40f7-b677-10c2db745518 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:26.300880 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548fb7d-8e15-40f7-b677-10c2db745518 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:26.301184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548fb7d-8e15-40f7-b677-10c2db745518 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:26.301839 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548fb7d-8e15-40f7-b677-10c2db745518 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:26.302140 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548fb7d-8e15-40f7-b677-10c2db745518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:26.303508 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548fb7d-8e15-40f7-b677-10c2db745518 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:26.311960 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 210/440] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:31:26.313061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35cd9b-45bb-4b4d-b4a5-3e305db23607 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:26.313372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35cd9b-45bb-4b4d-b4a5-3e305db23607 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:26.313640 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35cd9b-45bb-4b4d-b4a5-3e305db23607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:26.331132 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-6a35cd9b-45bb-4b4d-b4a5-3e305db23607 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:26.332304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6a35cd9b-45bb-4b4d-b4a5-3e305db23607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:26.345968 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 231/441] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 00:31:26.345968 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31d58e-7ff8-4d5c-81ef-0dbce222e01f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:26.378430 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:26.402279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 211/442] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:26.403114 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35cd9b-45bb-4b4d-b4a5-3e305db23607 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:26.444773 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31d58e-7ff8-4d5c-81ef-0dbce222e01f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:26.467957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:26.481420 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26c734-f4f0-4696-a751-acae67c9401f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:26.482013 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26c734-f4f0-4696-a751-acae67c9401f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:26.482292 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26c734-f4f0-4696-a751-acae67c9401f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:26.482564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26c734-f4f0-4696-a751-acae67c9401f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:26.515643 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35cd9b-45bb-4b4d-b4a5-3e305db23607 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:26.553269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a6b0c-3e2f-49e4-a48d-abdc81128f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:26.553998 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a6b0c-3e2f-49e4-a48d-abdc81128f05 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:26.554348 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a6b0c-3e2f-49e4-a48d-abdc81128f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:26.554695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a6b0c-3e2f-49e4-a48d-abdc81128f05 None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:26.555917 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a6b0c-3e2f-49e4-a48d-abdc81128f05 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc5711794744f1c9ccc1b886cc1a21b)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:26.556434 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26c734-f4f0-4696-a751-acae67c9401f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:26.557386 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a6b0c-3e2f-49e4-a48d-abdc81128f05 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:26.559097 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26c734-f4f0-4696-a751-acae67c9401f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:26.563694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 212/443] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:31:26 2022] GET /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:26.564374 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a6b0c-3e2f-49e4-a48d-abdc81128f05 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:26.596410 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:26.667522 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a6b0c-3e2f-49e4-a48d-abdc81128f05 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:26.672113 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 232/444] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:31:26.672938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26c734-f4f0-4696-a751-acae67c9401f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:26.691485 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:26.703472 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0fc79-5847-45e6-8d70-b60e5b882d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:26.704086 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0fc79-5847-45e6-8d70-b60e5b882d97 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:26.704362 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0fc79-5847-45e6-8d70-b60e5b882d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:26.704632 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0fc79-5847-45e6-8d70-b60e5b882d97 None admin] PATH_INFO: `/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:26.705726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0fc79-5847-45e6-8d70-b60e5b882d97 None admin] RBAC: Authorizing `identity:get_group(group_id=68c51ee5f80a4d3580f165c1b9405bb7)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:26.707156 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0fc79-5847-45e6-8d70-b60e5b882d97 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:26.708700 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 213/445] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 15 00:31:26 2022] GET /identity/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:26.709556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0fc79-5847-45e6-8d70-b60e5b882d97 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:26.773456 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26c734-f4f0-4696-a751-acae67c9401f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:26.806597 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380e8ab-53a5-499a-a826-32636b85d83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:26.807218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380e8ab-53a5-499a-a826-32636b85d83d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:26.807499 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380e8ab-53a5-499a-a826-32636b85d83d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:26.807767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380e8ab-53a5-499a-a826-32636b85d83d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:26.808834 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0fc79-5847-45e6-8d70-b60e5b882d97 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:26.809556 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:26.819846 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380e8ab-53a5-499a-a826-32636b85d83d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:26.825645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-6380e8ab-53a5-499a-a826-32636b85d83d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:31:26.825645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:26.825645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:26.825645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:26.825645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:26.825645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:26.825645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:26.825645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:26.825645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:26.825645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:26.825645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:26.825645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:26.825645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:26.825645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:26.825645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:26.825645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:26.826623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:26.826623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:26.826623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:26.826623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:26.826623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:26.826623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:26.826623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:26.826623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:26.826623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:26.826623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:26.826623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:26.826623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:26.826623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:26.826623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:26.826623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:26.826623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:26.827458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:26.827458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:26.827458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:26.827458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:26.827458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:26.827458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:26.827458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:26.827458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:26.827458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:26.827458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:26.827458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:31:26.827458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:26.827458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 233/446] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 15 00:31:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:26.828938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380e8ab-53a5-499a-a826-32636b85d83d None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:26.846093 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032e658-e7bb-44fd-bbc7-b441422514cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:26.846796 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032e658-e7bb-44fd-bbc7-b441422514cd None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:26.847025 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032e658-e7bb-44fd-bbc7-b441422514cd None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:26.847296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032e658-e7bb-44fd-bbc7-b441422514cd None admin] PATH_INFO: `/v3/projects/6940b89e115f47bd8dfdf0af975e2ba9` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:26.848438 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032e658-e7bb-44fd-bbc7-b441422514cd None admin] RBAC: Authorizing `identity:get_project(project_id=6940b89e115f47bd8dfdf0af975e2ba9)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:26.849915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032e658-e7bb-44fd-bbc7-b441422514cd None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:26.851660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 214/447] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:31:26 2022] GET /identity/v3/projects/6940b89e115f47bd8dfdf0af975e2ba9 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:26.852358 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032e658-e7bb-44fd-bbc7-b441422514cd None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:26.909799 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:26.928483 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380e8ab-53a5-499a-a826-32636b85d83d None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:26.950668 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032e658-e7bb-44fd-bbc7-b441422514cd None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:26.962660 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c12958-1b8b-451d-b0ad-e05eae2bced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:26.963257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c12958-1b8b-451d-b0ad-e05eae2bced2 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:26.963528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c12958-1b8b-451d-b0ad-e05eae2bced2 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:26.963799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c12958-1b8b-451d-b0ad-e05eae2bced2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:26.964507 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c12958-1b8b-451d-b0ad-e05eae2bced2 None admin] RBAC: Adding query filter params (group.id=68c51ee5f80a4d3580f165c1b9405bb7, role.id=24171c44541e4c4782ec7d3f03b50467, scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:26.964810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c12958-1b8b-451d-b0ad-e05eae2bced2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:26.966273 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c12958-1b8b-451d-b0ad-e05eae2bced2 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:26.971823 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 234/448] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Sep 15 00:31:26 2022] GET /identity/v3/role_assignments?group.id=68c51ee5f80a4d3580f165c1b9405bb7&scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b&role.id=24171c44541e4c4782ec7d3f03b50467 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:26.972582 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c12958-1b8b-451d-b0ad-e05eae2bced2 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:26.985288 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63ee95-71e3-4f3e-a606-e807df8c736c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:26.986174 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63ee95-71e3-4f3e-a606-e807df8c736c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:26.986460 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63ee95-71e3-4f3e-a606-e807df8c736c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:26.986739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63ee95-71e3-4f3e-a606-e807df8c736c None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:26.987427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63ee95-71e3-4f3e-a606-e807df8c736c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:26.987734 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63ee95-71e3-4f3e-a606-e807df8c736c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:26.989225 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63ee95-71e3-4f3e-a606-e807df8c736c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:26.998634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 215/449] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:27.004394 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63ee95-71e3-4f3e-a606-e807df8c736c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:27.038514 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:27.090088 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c12958-1b8b-451d-b0ad-e05eae2bced2 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:27.114900 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63ee95-71e3-4f3e-a606-e807df8c736c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:27.129518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260c032-4609-4f26-8ed3-1829060f3962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:27.130522 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260c032-4609-4f26-8ed3-1829060f3962 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:27.130942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260c032-4609-4f26-8ed3-1829060f3962 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:27.131379 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260c032-4609-4f26-8ed3-1829060f3962 None admin] PATH_INFO: `/v3/groups/d1d91e25dcd243d09a95f761b2d8423d` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:27.132843 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260c032-4609-4f26-8ed3-1829060f3962 None admin] RBAC: Authorizing `identity:get_group(group_id=d1d91e25dcd243d09a95f761b2d8423d)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:27.134654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260c032-4609-4f26-8ed3-1829060f3962 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:27.136533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:27.137323 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 235/450] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 15 00:31:26 2022] GET /identity/v3/groups/d1d91e25dcd243d09a95f761b2d8423d => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:27.143772 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260c032-4609-4f26-8ed3-1829060f3962 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:27.152902 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7884f84-c55a-4d41-a3b3-9f37826ff765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:27.153536 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7884f84-c55a-4d41-a3b3-9f37826ff765 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:27.153816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7884f84-c55a-4d41-a3b3-9f37826ff765 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:27.154093 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7884f84-c55a-4d41-a3b3-9f37826ff765 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:27.234530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7884f84-c55a-4d41-a3b3-9f37826ff765 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:27.236166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7884f84-c55a-4d41-a3b3-9f37826ff765 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:27.278544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260c032-4609-4f26-8ed3-1829060f3962 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:27.313110 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:27.327006 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe46d3-6121-4410-9d4a-53d1ee6c95a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:27.327334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe46d3-6121-4410-9d4a-53d1ee6c95a1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:27.329453 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe46d3-6121-4410-9d4a-53d1ee6c95a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:27.329453 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe46d3-6121-4410-9d4a-53d1ee6c95a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:27.329453 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe46d3-6121-4410-9d4a-53d1ee6c95a1 None admin] RBAC: Adding query filter params (group.id=d1d91e25dcd243d09a95f761b2d8423d, role.id=0ee2daa9cb3c41fb901603e3d8caf784, scope.project.id=6940b89e115f47bd8dfdf0af975e2ba9) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:27.329453 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe46d3-6121-4410-9d4a-53d1ee6c95a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:27.331301 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe46d3-6121-4410-9d4a-53d1ee6c95a1 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:27.340047 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 236/451] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Sep 15 00:31:27 2022] GET /identity/v3/role_assignments?group.id=d1d91e25dcd243d09a95f761b2d8423d&scope.project.id=6940b89e115f47bd8dfdf0af975e2ba9&role.id=0ee2daa9cb3c41fb901603e3d8caf784 => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:31:27.345838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 216/452] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 00:31:27.351568 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe46d3-6121-4410-9d4a-53d1ee6c95a1 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:27.459082 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe46d3-6121-4410-9d4a-53d1ee6c95a1 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:27.494987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1876a-acc5-4919-b091-2c81acc06daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:27.495627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1876a-acc5-4919-b091-2c81acc06daa None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:27.495909 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1876a-acc5-4919-b091-2c81acc06daa None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:27.496181 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1876a-acc5-4919-b091-2c81acc06daa None admin] PATH_INFO: `/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:27.497342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1876a-acc5-4919-b091-2c81acc06daa None admin] RBAC: Authorizing `identity:get_project(project_id=7cc5711794744f1c9ccc1b886cc1a21b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:27.498775 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1876a-acc5-4919-b091-2c81acc06daa None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:27.500397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 237/453] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:31:27 2022] GET /identity/v3/projects/7cc5711794744f1c9ccc1b886cc1a21b => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:27.506002 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7884f84-c55a-4d41-a3b3-9f37826ff765 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:27.527870 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:27.605459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7884f84-c55a-4d41-a3b3-9f37826ff765 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:27.638519 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a450c2d-84ba-40b4-9606-b3721e8a560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:27.639125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a450c2d-84ba-40b4-9606-b3721e8a560c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:27.639405 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a450c2d-84ba-40b4-9606-b3721e8a560c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:27.639676 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a450c2d-84ba-40b4-9606-b3721e8a560c None admin] PATH_INFO: `/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:27.640745 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a450c2d-84ba-40b4-9606-b3721e8a560c None admin] RBAC: Authorizing `identity:get_group(group_id=68c51ee5f80a4d3580f165c1b9405bb7)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:27.642276 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a450c2d-84ba-40b4-9606-b3721e8a560c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:27.643810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 217/454] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Sep 15 00:31:27 2022] GET /identity/v3/groups/68c51ee5f80a4d3580f165c1b9405bb7 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:27.649866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1876a-acc5-4919-b091-2c81acc06daa None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:27.706930 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:27.747020 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1876a-acc5-4919-b091-2c81acc06daa None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:27.779160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d89e50-b5eb-414f-82c1-1fe2dcda8275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:27.779739 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d89e50-b5eb-414f-82c1-1fe2dcda8275 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:27.780014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d89e50-b5eb-414f-82c1-1fe2dcda8275 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:27.780279 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d89e50-b5eb-414f-82c1-1fe2dcda8275 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:27.780989 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d89e50-b5eb-414f-82c1-1fe2dcda8275 None admin] RBAC: Adding query filter params (group.id=68c51ee5f80a4d3580f165c1b9405bb7, role.id=1c9b176504fd4d24b34942f724e63acf, scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:27.781320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d89e50-b5eb-414f-82c1-1fe2dcda8275 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:27.782731 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d89e50-b5eb-414f-82c1-1fe2dcda8275 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:27.788176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 238/455] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Sep 15 00:31:27 2022] GET /identity/v3/role_assignments?group.id=68c51ee5f80a4d3580f165c1b9405bb7&scope.project.id=7cc5711794744f1c9ccc1b886cc1a21b&role.id=1c9b176504fd4d24b34942f724e63acf => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:30.479132 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaa8de-cb8d-4f4f-ae3e-26cf17e2b662 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:30.480127 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaa8de-cb8d-4f4f-ae3e-26cf17e2b662 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:30.480599 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaa8de-cb8d-4f4f-ae3e-26cf17e2b662 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:30.482431 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 218/456] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:30.487947 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ad0c0-cbf1-4973-b783-7e744551be7b None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:30.488853 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ad0c0-cbf1-4973-b783-7e744551be7b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:30.489399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ad0c0-cbf1-4973-b783-7e744551be7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:30.513208 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-238ad0c0-cbf1-4973-b783-7e744551be7b None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:30.514763 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-238ad0c0-cbf1-4973-b783-7e744551be7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:30.599652 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 239/457] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:30.635701 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163405f0-e055-4577-a74b-eeff1c268f86 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:30.636039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163405f0-e055-4577-a74b-eeff1c268f86 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:30.636255 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163405f0-e055-4577-a74b-eeff1c268f86 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:30.638006 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 219/458] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:30.643375 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583dd13-63fa-468d-81a2-4e096dd65ef5 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:30.643672 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583dd13-63fa-468d-81a2-4e096dd65ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:30.643951 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583dd13-63fa-468d-81a2-4e096dd65ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:30.674039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-1583dd13-63fa-468d-81a2-4e096dd65ef5 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:30.675246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1583dd13-63fa-468d-81a2-4e096dd65ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:30.741039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:30.775541 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 240/459] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:31.008407 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163405f0-e055-4577-a74b-eeff1c268f86 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:31.095351 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf67da-a181-43bc-bb7e-118096cbcdf3 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:31.095989 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf67da-a181-43bc-bb7e-118096cbcdf3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:31.096494 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf67da-a181-43bc-bb7e-118096cbcdf3 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:31.098193 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 241/460] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:31.103909 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2c4e4-379a-486d-a522-d3d447b4ebcf None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:31.104193 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2c4e4-379a-486d-a522-d3d447b4ebcf None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:31.104467 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2c4e4-379a-486d-a522-d3d447b4ebcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:31.136138 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:31.137441 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-3cb2c4e4-379a-486d-a522-d3d447b4ebcf None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:31.138648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3cb2c4e4-379a-486d-a522-d3d447b4ebcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:31.156716 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163405f0-e055-4577-a74b-eeff1c268f86 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:31.200148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230adab9-99a3-4296-93f1-c46adf9e9278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:31.201021 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230adab9-99a3-4296-93f1-c46adf9e9278 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:31.201473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230adab9-99a3-4296-93f1-c46adf9e9278 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:31.201890 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230adab9-99a3-4296-93f1-c46adf9e9278 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:31.212985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230adab9-99a3-4296-93f1-c46adf9e9278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:31.214650 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230adab9-99a3-4296-93f1-c46adf9e9278 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:31.226182 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 242/461] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:31:31.227911 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2c4e4-379a-486d-a522-d3d447b4ebcf None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:31.232527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-230adab9-99a3-4296-93f1-c46adf9e9278 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:31.232527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:31.232527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:31.232527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:31.232527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:31.232527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:31.232527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:31.232527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:31.232527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:31.232527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:31.232527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:31.232527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:31.232527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:31.232527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:31.232527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:31.232527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:31.233692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:31.233692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:31.233692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:31.233692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:31.233692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:31.233692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:31.233692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:31.233692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:31.233692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:31.233692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:31.233692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:31.233692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:31.233692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:31.233692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:31.233692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:31.233692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:31.233692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:31.234831 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:31.234831 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:31.234831 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:31.236636 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 220/462] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:31.243985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230adab9-99a3-4296-93f1-c46adf9e9278 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:31.380815 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2c4e4-379a-486d-a522-d3d447b4ebcf None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:31.392528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230adab9-99a3-4296-93f1-c46adf9e9278 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:31.396517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:31.421428 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97029f9-cd60-4685-9c24-184617ba432f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:31.422352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97029f9-cd60-4685-9c24-184617ba432f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:31.422831 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97029f9-cd60-4685-9c24-184617ba432f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:31.423325 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97029f9-cd60-4685-9c24-184617ba432f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:31.434639 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97029f9-cd60-4685-9c24-184617ba432f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:31.436299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97029f9-cd60-4685-9c24-184617ba432f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:31.438759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4283b-03fe-4ec3-97bf-11cbd1e4efbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:31.439736 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4283b-03fe-4ec3-97bf-11cbd1e4efbb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:31.440063 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4283b-03fe-4ec3-97bf-11cbd1e4efbb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:31.440336 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4283b-03fe-4ec3-97bf-11cbd1e4efbb None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:31.441028 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4283b-03fe-4ec3-97bf-11cbd1e4efbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:31.441360 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4283b-03fe-4ec3-97bf-11cbd1e4efbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:31.442717 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4283b-03fe-4ec3-97bf-11cbd1e4efbb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:31.453727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-b97029f9-cd60-4685-9c24-184617ba432f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:31.453727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:31.453727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:31.453727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:31.453727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:31.453727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:31.453727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:31.453727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:31.453727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:31.453727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:31.453727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:31.453727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:31.453727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:31.453727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:31.453727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:31.453727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:31.454595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:31.454595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:31.454595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:31.454595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:31.454595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:31.454595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:31.454595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:31.454595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:31.454595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:31.454595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:31.454595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:31.454595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:31.454595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:31.454595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:31.454595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:31.454595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:31.454595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:31.455449 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:31.455449 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:31.455449 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:31.457488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 243/463] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:31.458835 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade6f65-02b4-4270-9677-cb185a3fb0b1 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:31.459398 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade6f65-02b4-4270-9677-cb185a3fb0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:31.459871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade6f65-02b4-4270-9677-cb185a3fb0b1 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:31.461627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 244/464] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:31.463683 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:31.464307 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade6f65-02b4-4270-9677-cb185a3fb0b1 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:31.469771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 221/465] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:31.478213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfad765-37ac-46f5-af18-349dafc8e1cf None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:31.481453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfad765-37ac-46f5-af18-349dafc8e1cf None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:31.482003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfad765-37ac-46f5-af18-349dafc8e1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:31.509915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-7bfad765-37ac-46f5-af18-349dafc8e1cf None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:31.511603 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7bfad765-37ac-46f5-af18-349dafc8e1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:31.578447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade6f65-02b4-4270-9677-cb185a3fb0b1 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:31.583412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 222/466] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:31.587031 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfad765-37ac-46f5-af18-349dafc8e1cf None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:31.614635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3ff4b-eb12-4d11-b06b-8d1dc27b1e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:31.615153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ff4b-eb12-4d11-b06b-8d1dc27b1e53 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:31.615517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ff4b-eb12-4d11-b06b-8d1dc27b1e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:31.615833 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3ff4b-eb12-4d11-b06b-8d1dc27b1e53 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:31.616541 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3ff4b-eb12-4d11-b06b-8d1dc27b1e53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:31.616801 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3ff4b-eb12-4d11-b06b-8d1dc27b1e53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:31.618291 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3ff4b-eb12-4d11-b06b-8d1dc27b1e53 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:31.630964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 245/467] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:31.631865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3ff4b-eb12-4d11-b06b-8d1dc27b1e53 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:31.658942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:31.714262 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfad765-37ac-46f5-af18-349dafc8e1cf None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:31.735978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3ff4b-eb12-4d11-b06b-8d1dc27b1e53 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:31.746418 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:31.752991 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad218fa-bca1-464f-8c05-bf399cd1009d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:31.754001 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad218fa-bca1-464f-8c05-bf399cd1009d None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:31.754493 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad218fa-bca1-464f-8c05-bf399cd1009d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:31.754964 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad218fa-bca1-464f-8c05-bf399cd1009d None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:31.755804 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad218fa-bca1-464f-8c05-bf399cd1009d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:31.758926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad218fa-bca1-464f-8c05-bf399cd1009d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:31.772357 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4effb1-7127-442b-b4ff-85ce953060a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:31.773407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4effb1-7127-442b-b4ff-85ce953060a4 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:31.773407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4effb1-7127-442b-b4ff-85ce953060a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:31.773407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4effb1-7127-442b-b4ff-85ce953060a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:31.785304 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4effb1-7127-442b-b4ff-85ce953060a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:31.786725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4effb1-7127-442b-b4ff-85ce953060a4 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:31.788985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 223/468] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 15 00:31:31 2022] POST /identity/v3/users => generated 246 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:31:31.790158 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad218fa-bca1-464f-8c05-bf399cd1009d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:31.802407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-6e4effb1-7127-442b-b4ff-85ce953060a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:31.802407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:31.802407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:31.802407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:31.802407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:31.802407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:31.802407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:31.802407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:31.802407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:31.802407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:31.802407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:31.802407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:31.802407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:31.802407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:31.802407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:31.802407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:31.803356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:31.803356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:31.803356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:31.803356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:31.803356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:31.803356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:31.803356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:31.803356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:31.803356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:31.803356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:31.803356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:31.803356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:31.803356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:31.803356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:31.803356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:31.803356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:31.803356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:31.804225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:31.804225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:31.804225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:31.804225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 246/469] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:31.814184 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4effb1-7127-442b-b4ff-85ce953060a4 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:31.918289 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad218fa-bca1-464f-8c05-bf399cd1009d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:31.926866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:31.954098 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4effb1-7127-442b-b4ff-85ce953060a4 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:31.965220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27249e-a85f-433b-b59a-0cf1cd4dc45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:31.966142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27249e-a85f-433b-b59a-0cf1cd4dc45c None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:31.966431 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27249e-a85f-433b-b59a-0cf1cd4dc45c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:31.966704 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27249e-a85f-433b-b59a-0cf1cd4dc45c None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:31.967362 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27249e-a85f-433b-b59a-0cf1cd4dc45c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:31.969039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27249e-a85f-433b-b59a-0cf1cd4dc45c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:31.992274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 224/470] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 15 00:31:31 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:31:31.994217 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27249e-a85f-433b-b59a-0cf1cd4dc45c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:31.997211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b5d2a-b466-4fa1-9d02-68fe8be72558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:31.997832 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b5d2a-b466-4fa1-9d02-68fe8be72558 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:31.998113 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b5d2a-b466-4fa1-9d02-68fe8be72558 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:31.998416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b5d2a-b466-4fa1-9d02-68fe8be72558 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:31.999066 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b5d2a-b466-4fa1-9d02-68fe8be72558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:31.999412 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b5d2a-b466-4fa1-9d02-68fe8be72558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:32.000809 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b5d2a-b466-4fa1-9d02-68fe8be72558 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:32.016623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 247/471] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:32.022762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b5d2a-b466-4fa1-9d02-68fe8be72558 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:32.053661 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:32.130679 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27249e-a85f-433b-b59a-0cf1cd4dc45c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:32.178253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b5d2a-b466-4fa1-9d02-68fe8be72558 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:32.179398 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5f55d-787b-44e7-b583-a9981568f8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:32.180597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5f55d-787b-44e7-b583-a9981568f8f0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:32.180882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5f55d-787b-44e7-b583-a9981568f8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:32.181180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5f55d-787b-44e7-b583-a9981568f8f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:32.194730 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5f55d-787b-44e7-b583-a9981568f8f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:32.196806 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5f55d-787b-44e7-b583-a9981568f8f0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:32.212924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-59d5f55d-787b-44e7-b583-a9981568f8f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:32.212924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:32.212924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:32.212924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:32.212924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:32.212924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:32.212924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:32.212924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:32.212924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:32.212924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:32.212924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:32.212924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:32.212924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:32.212924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:32.212924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:32.212924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:32.213882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:32.213882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:32.213882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:32.213882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:32.213882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:32.213882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:32.213882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:32.213882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:32.213882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:32.213882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:32.213882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:32.213882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:32.213882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:32.213882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:32.213882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:32.213882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:32.213882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:32.214704 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:32.214704 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:32.214704 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:32.214704 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 225/472] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:32.219966 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5f55d-787b-44e7-b583-a9981568f8f0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:32.237169 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d21061-386d-447c-96d9-b7a69b6f094e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:32.237946 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d21061-386d-447c-96d9-b7a69b6f094e None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:32.238230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d21061-386d-447c-96d9-b7a69b6f094e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:32.238503 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d21061-386d-447c-96d9-b7a69b6f094e None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:32.239741 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d21061-386d-447c-96d9-b7a69b6f094e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:32.241180 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d21061-386d-447c-96d9-b7a69b6f094e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:32.257323 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:32.281273 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 248/473] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 15 00:31:32 2022] POST /identity/v3/users => generated 248 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:31:32.282701 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ef802-1542-44bb-8864-b71267319901 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:32.282987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ef802-1542-44bb-8864-b71267319901 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:32.283259 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ef802-1542-44bb-8864-b71267319901 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:32.284583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 249/474] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:32.292723 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0169c-c246-4437-823c-28bd7873cacd None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:32.293006 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0169c-c246-4437-823c-28bd7873cacd None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:32.293319 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0169c-c246-4437-823c-28bd7873cacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:32.329762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-54b0169c-c246-4437-823c-28bd7873cacd None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:32.331162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-54b0169c-c246-4437-823c-28bd7873cacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:32.366632 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:32.382846 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5f55d-787b-44e7-b583-a9981568f8f0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:32.433212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54164ed-af13-476b-81b5-e0ad7644936c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:32.433534 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 250/475] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:32.434489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54164ed-af13-476b-81b5-e0ad7644936c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:32.434968 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54164ed-af13-476b-81b5-e0ad7644936c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:32.435424 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54164ed-af13-476b-81b5-e0ad7644936c None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:32.436268 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54164ed-af13-476b-81b5-e0ad7644936c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:32.436752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54164ed-af13-476b-81b5-e0ad7644936c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:32.438513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54164ed-af13-476b-81b5-e0ad7644936c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:32.453956 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 226/476] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:31:32.461112 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0169c-c246-4437-823c-28bd7873cacd None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:32.562876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0169c-c246-4437-823c-28bd7873cacd None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:32.587813 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:32.599926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2a056-4afe-47dc-b545-61df542d4c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:32.600538 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2a056-4afe-47dc-b545-61df542d4c9d None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:32.600812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2a056-4afe-47dc-b545-61df542d4c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:32.601125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2a056-4afe-47dc-b545-61df542d4c9d None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:32.601801 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2a056-4afe-47dc-b545-61df542d4c9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:32.603237 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2a056-4afe-47dc-b545-61df542d4c9d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:32.630967 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 251/477] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 15 00:31:32 2022] POST /identity/v3/users => generated 249 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:31:32.751944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54164ed-af13-476b-81b5-e0ad7644936c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:32.870601 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54164ed-af13-476b-81b5-e0ad7644936c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:32.907240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d3b8f-363c-427c-a236-5346b1723d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:32.907843 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d3b8f-363c-427c-a236-5346b1723d8c None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:32.908117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d3b8f-363c-427c-a236-5346b1723d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:32.908442 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d3b8f-363c-427c-a236-5346b1723d8c None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:32.909130 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d3b8f-363c-427c-a236-5346b1723d8c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:32.910498 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d3b8f-363c-427c-a236-5346b1723d8c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:32.919633 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.sql.core [None req-d51d3b8f-363c-427c-a236-5346b1723d8c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 15 00:31:32.919633 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 15 00:31:32.919633 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [parameters: {'id': '1eebdda0b44a4e088de50e1dc11f26e0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 15 00:31:32.919633 dv-cinder-857528-2-smb devstack@keystone.service[81615]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81615) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 00:31:32.936096 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-d51d3b8f-363c-427c-a236-5346b1723d8c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 15 00:31:32.936096 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:32.936096 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 00:31:32.936096 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 00:31:32.936096 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 00:31:32.936096 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 00:31:32.936096 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 00:31:32.936096 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 00:31:32.936096 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 00:31:32.936096 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application conn.query(q) Sep 15 00:31:32.936096 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 00:31:32.936096 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 00:31:32.936096 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 00:31:32.936096 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result.read() Sep 15 00:31:32.936096 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 00:31:32.936999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 00:31:32.936999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 00:31:32.936999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 00:31:32.936999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 00:31:32.936999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 00:31:32.936999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 00:31:32.936999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 00:31:32.936999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 15 00:31:32.936999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:32.936999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 15 00:31:32.936999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:32.936999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:32.936999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 15 00:31:32.936999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 15 00:31:32.936999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 15 00:31:32.936999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return ref.to_dict() Sep 15 00:31:32.936999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 00:31:32.936999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application next(self.gen) Sep 15 00:31:32.937955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 15 00:31:32.937955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application yield resource Sep 15 00:31:32.937955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 00:31:32.937955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application next(self.gen) Sep 15 00:31:32.937955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 15 00:31:32.937955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.session.rollback() Sep 15 00:31:32.937955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 15 00:31:32.937955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.force_reraise() Sep 15 00:31:32.937955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 15 00:31:32.937955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise self.value Sep 15 00:31:32.937955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 15 00:31:32.937955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 15 00:31:32.937955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 15 00:31:32.937955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application session.commit() Sep 15 00:31:32.937955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 15 00:31:32.937955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 15 00:31:32.937955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 15 00:31:32.939532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._prepare_impl() Sep 15 00:31:32.939532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 15 00:31:32.939532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.session.flush() Sep 15 00:31:32.939532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 15 00:31:32.939532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._flush(objects) Sep 15 00:31:32.939532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 15 00:31:32.939532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 15 00:31:32.939532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 15 00:31:32.939532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application compat.raise_( Sep 15 00:31:32.939532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 00:31:32.939532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception Sep 15 00:31:32.939532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 15 00:31:32.939532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application flush_context.execute() Sep 15 00:31:32.939532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 15 00:31:32.939532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rec.execute(self) Sep 15 00:31:32.939532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 15 00:31:32.939532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 15 00:31:32.940420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 15 00:31:32.940420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 15 00:31:32.940420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 15 00:31:32.940420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 15 00:31:32.940420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 15 00:31:32.940420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 15 00:31:32.940420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 15 00:31:32.940420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 15 00:31:32.940420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 15 00:31:32.940420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 15 00:31:32.940420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 15 00:31:32.940420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 15 00:31:32.940420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 15 00:31:32.940420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 15 00:31:32.940420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 00:31:32.940420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception Sep 15 00:31:32.941244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 00:31:32.941244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 00:31:32.941244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 00:31:32.941244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 00:31:32.941244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 00:31:32.941244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 00:31:32.941244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 00:31:32.941244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application conn.query(q) Sep 15 00:31:32.941244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 00:31:32.941244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 00:31:32.941244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 00:31:32.941244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result.read() Sep 15 00:31:32.941244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 00:31:32.941244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 00:31:32.941244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 00:31:32.941244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 00:31:32.942061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 00:31:32.942061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 00:31:32.942061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 00:31:32.942061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 00:31:32.942061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 15 00:31:32.942061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 15 00:31:32.942061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [parameters: {'id': '1eebdda0b44a4e088de50e1dc11f26e0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 15 00:31:32.942061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 15 00:31:32.942061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:32.942061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:31:32.942061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:32.942061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:32.942061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:32.942061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:32.942061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:32.942061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:32.945794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:32.945794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:32.945794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:32.945794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:32.945794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:32.945794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:32.945794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 15 00:31:32.945794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 15 00:31:32.945794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:32.945794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:32.945794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 15 00:31:32.945794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 15 00:31:32.945794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 15 00:31:32.945794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 15 00:31:32.945794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 15 00:31:32.945794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:32.947740 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 227/478] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Sep 15 00:31:32 2022] POST /identity/v3/roles => generated 144 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:32.947891 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2a056-4afe-47dc-b545-61df542d4c9d None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:33.053911 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2a056-4afe-47dc-b545-61df542d4c9d None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:33.093330 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3058734-4e66-4e46-968b-ca47bdaa21d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:33.093966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3058734-4e66-4e46-968b-ca47bdaa21d0 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:33.094309 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3058734-4e66-4e46-968b-ca47bdaa21d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:33.094581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3058734-4e66-4e46-968b-ca47bdaa21d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:33.106559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3058734-4e66-4e46-968b-ca47bdaa21d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:33.112114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-e3058734-4e66-4e46-968b-ca47bdaa21d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:31:33.112114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:33.112114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:33.112114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:33.112114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:33.112114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:33.112114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:33.112114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:33.112114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:33.112114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:33.112114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:33.112114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:33.112114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:33.112114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:33.112114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:33.112114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:33.114365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:33.114365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:33.114365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:33.114365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:33.114365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:33.114365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:33.114365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:33.114365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:33.114365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:33.114365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:33.114365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:33.114365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:33.114365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:33.114365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:33.114365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:33.114365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:33.116357 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:33.116357 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:33.116357 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:33.116357 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:33.116357 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:33.116357 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:33.116357 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:33.116357 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:33.116357 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:33.116357 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:33.116357 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 00:31:33.116357 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:33.116357 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 252/479] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 15 00:31:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:33.121304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d3b8f-363c-427c-a236-5346b1723d8c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:33.142706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:33.228709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d3b8f-363c-427c-a236-5346b1723d8c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:33.271672 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d520586-62bd-4d17-b3e1-45e804a39e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:33.272279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d520586-62bd-4d17-b3e1-45e804a39e08 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:33.272554 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d520586-62bd-4d17-b3e1-45e804a39e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:33.272823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d520586-62bd-4d17-b3e1-45e804a39e08 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:33.273540 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d520586-62bd-4d17-b3e1-45e804a39e08 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:33.274374 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d520586-62bd-4d17-b3e1-45e804a39e08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:33.275775 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d520586-62bd-4d17-b3e1-45e804a39e08 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:33.289735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 228/480] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:34.655701 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f52b55-a14d-4f8b-9e52-731f134782b0 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:34.656183 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f52b55-a14d-4f8b-9e52-731f134782b0 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:34.656183 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f52b55-a14d-4f8b-9e52-731f134782b0 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:34.657669 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 253/481] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:34.662628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a25cfa-3096-49b8-b634-9cd531e34f88 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:34.663018 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a25cfa-3096-49b8-b634-9cd531e34f88 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:34.663196 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a25cfa-3096-49b8-b634-9cd531e34f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:34.690070 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a7a25cfa-3096-49b8-b634-9cd531e34f88 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:34.691269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a7a25cfa-3096-49b8-b634-9cd531e34f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:34.782954 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 229/482] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:35.022293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36e65a-3725-4f1c-8a17-e47eff34ddb9 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:35.022625 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36e65a-3725-4f1c-8a17-e47eff34ddb9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:35.022798 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36e65a-3725-4f1c-8a17-e47eff34ddb9 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:35.024844 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 254/483] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:35.030367 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da874ca-c8ee-4c67-99ae-3df0c4dba5c2 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:35.030647 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da874ca-c8ee-4c67-99ae-3df0c4dba5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:35.030922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da874ca-c8ee-4c67-99ae-3df0c4dba5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:35.057379 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9da874ca-c8ee-4c67-99ae-3df0c4dba5c2 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:35.058556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9da874ca-c8ee-4c67-99ae-3df0c4dba5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:35.066457 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:35.066789 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7439d2-bae0-4416-8722-1013c053fe69 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:35.067079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7439d2-bae0-4416-8722-1013c053fe69 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:35.067355 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7439d2-bae0-4416-8722-1013c053fe69 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:35.068876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 255/484] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:31:35.078878 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bf81a-21e6-47eb-b6d8-03f5bc6c2359 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:35.079163 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bf81a-21e6-47eb-b6d8-03f5bc6c2359 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:35.079440 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bf81a-21e6-47eb-b6d8-03f5bc6c2359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:35.111142 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-e48bf81a-21e6-47eb-b6d8-03f5bc6c2359 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:35.112320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e48bf81a-21e6-47eb-b6d8-03f5bc6c2359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:35.170291 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:35.173991 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 230/485] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:35.206354 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da874ca-c8ee-4c67-99ae-3df0c4dba5c2 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:35.222574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 256/486] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:35.315254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da874ca-c8ee-4c67-99ae-3df0c4dba5c2 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:35.360124 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c1714-68b2-4c38-bb79-397d76eb0dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:35.360767 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c1714-68b2-4c38-bb79-397d76eb0dbd None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:35.361041 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c1714-68b2-4c38-bb79-397d76eb0dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:35.361334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c1714-68b2-4c38-bb79-397d76eb0dbd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:35.375021 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:35.381252 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c1714-68b2-4c38-bb79-397d76eb0dbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:35.390121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-c91c1714-68b2-4c38-bb79-397d76eb0dbd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:35.390121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:35.390121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:35.390121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:35.390121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:35.390121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:35.390121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:35.390121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:35.390121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:35.390121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:35.390121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:35.390121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:35.390121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:35.390121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:35.390121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:35.390121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:35.392817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:35.392817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:35.392817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:35.392817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:35.392817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:35.392817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:35.392817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:35.392817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:35.392817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:35.392817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:35.392817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:35.392817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:35.392817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:35.392817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:35.392817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:35.392817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:35.394816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:35.394816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:35.394816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:35.394816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:35.394816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:35.394816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:35.394816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:35.394816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:35.394816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:35.394816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:35.394816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:35.394816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:35.394816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 231/487] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:31:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:35.403065 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bf81a-21e6-47eb-b6d8-03f5bc6c2359 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:35.489816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dd009-9648-4b62-a692-17c928acbc05 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:35.490130 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dd009-9648-4b62-a692-17c928acbc05 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:35.490407 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dd009-9648-4b62-a692-17c928acbc05 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:35.492480 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 232/488] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:31:35.500407 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebdf70-5b89-4df8-89d9-73f2ac7ef771 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:35.500407 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebdf70-5b89-4df8-89d9-73f2ac7ef771 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:35.500407 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebdf70-5b89-4df8-89d9-73f2ac7ef771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:35.524564 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-10ebdf70-5b89-4df8-89d9-73f2ac7ef771 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:35.525784 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-10ebdf70-5b89-4df8-89d9-73f2ac7ef771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:35.545598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bf81a-21e6-47eb-b6d8-03f5bc6c2359 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:35.581993 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2c352-7b36-4cda-a1a5-111b87f139fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:35.582653 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2c352-7b36-4cda-a1a5-111b87f139fb None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:35.583031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2c352-7b36-4cda-a1a5-111b87f139fb None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:35.583350 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2c352-7b36-4cda-a1a5-111b87f139fb None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:35.584125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2c352-7b36-4cda-a1a5-111b87f139fb None admin] RBAC: Adding query filter params (name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:35.584424 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2c352-7b36-4cda-a1a5-111b87f139fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:35.585811 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2c352-7b36-4cda-a1a5-111b87f139fb None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:35.595224 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 257/489] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 15 00:31:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:35.596012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2c352-7b36-4cda-a1a5-111b87f139fb None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:35.607289 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 233/490] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:35.608142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebdf70-5b89-4df8-89d9-73f2ac7ef771 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:35.642831 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:35.724548 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2c352-7b36-4cda-a1a5-111b87f139fb None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:35.739337 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebdf70-5b89-4df8-89d9-73f2ac7ef771 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:35.763115 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0634841-9adf-43c1-9dce-71e6a752af2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:35.764028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0634841-9adf-43c1-9dce-71e6a752af2a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:35.764580 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0634841-9adf-43c1-9dce-71e6a752af2a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:35.764992 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0634841-9adf-43c1-9dce-71e6a752af2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:35.775044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:35.778116 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0634841-9adf-43c1-9dce-71e6a752af2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:35.782249 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b20439-2454-4d9e-966f-8833c83e717b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:35.782875 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b20439-2454-4d9e-966f-8833c83e717b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:35.783154 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b20439-2454-4d9e-966f-8833c83e717b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:35.783425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b20439-2454-4d9e-966f-8833c83e717b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:35.786199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-b0634841-9adf-43c1-9dce-71e6a752af2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:35.786199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:35.786199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:35.786199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:35.786199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:35.786199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:35.786199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:35.786199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:35.786199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:35.786199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:35.786199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:35.786199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:35.786199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:35.786199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:35.786199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:35.786199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:35.787232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:35.787232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:35.787232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:35.787232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:35.787232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:35.787232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:35.787232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:35.787232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:35.787232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:35.787232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:35.787232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:35.787232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:35.787232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:35.787232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:35.787232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:35.787232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:35.788042 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:35.788042 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:35.788042 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:35.788042 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:35.788042 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:35.788042 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:35.788042 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:35.788042 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:35.788042 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:35.788042 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:35.788042 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:35.788042 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:35.795333 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b20439-2454-4d9e-966f-8833c83e717b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:35.795795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b20439-2454-4d9e-966f-8833c83e717b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:35.796023 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 258/491] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:31:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:35.797291 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0634841-9adf-43c1-9dce-71e6a752af2a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:35.814869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-a5b20439-2454-4d9e-966f-8833c83e717b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:35.814869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:35.814869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:35.814869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:35.814869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:35.814869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:35.814869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:35.814869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:35.814869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:35.814869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:35.814869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:35.814869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:35.814869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:35.814869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:35.814869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:35.814869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:35.815821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:35.815821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:35.815821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:35.815821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:35.815821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:35.815821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:35.815821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:35.815821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:35.815821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:35.815821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:35.815821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:35.815821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:35.815821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:35.815821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:35.815821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:35.815821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:35.815821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:35.816982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:35.816982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:35.816982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:35.816982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 234/492] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:35.822016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b20439-2454-4d9e-966f-8833c83e717b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:35.913622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:35.925073 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0634841-9adf-43c1-9dce-71e6a752af2a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:35.939611 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b20439-2454-4d9e-966f-8833c83e717b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:35.961662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6402853-235a-4bf0-8610-2b9be48e9325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:35.962527 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6402853-235a-4bf0-8610-2b9be48e9325 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:35.962952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6402853-235a-4bf0-8610-2b9be48e9325 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:35.963219 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6402853-235a-4bf0-8610-2b9be48e9325 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:35.973331 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6402853-235a-4bf0-8610-2b9be48e9325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:35.975364 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2ec7d-7a67-414d-ad4a-98f9b455d3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:35.975955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2ec7d-7a67-414d-ad4a-98f9b455d3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:35.976231 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2ec7d-7a67-414d-ad4a-98f9b455d3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:35.976500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2ec7d-7a67-414d-ad4a-98f9b455d3e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:35.977769 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2ec7d-7a67-414d-ad4a-98f9b455d3e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:35.978071 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2ec7d-7a67-414d-ad4a-98f9b455d3e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:35.979128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-d6402853-235a-4bf0-8610-2b9be48e9325 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:35.979128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:35.979128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:35.979128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:35.979128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:35.979128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:35.979128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:35.979128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:35.979128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:35.979128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:35.979128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:35.979128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:35.979128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:35.979128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:35.979128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:35.979128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:35.980012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:35.980012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:35.980012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:35.980012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:35.980012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:35.980012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:35.980012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:35.980012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:35.980012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:35.980012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:35.980012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:35.980012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:35.980012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:35.980012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:35.980012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:35.980012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:35.981889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:35.981889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:35.981889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:35.981889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:35.981889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:35.981889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:35.981889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:35.981889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:35.981889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:35.981889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:35.981889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:35.981889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:35.982539 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2ec7d-7a67-414d-ad4a-98f9b455d3e8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:35.982613 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 259/493] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:31:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:35.982613 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6402853-235a-4bf0-8610-2b9be48e9325 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:35.992782 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 235/494] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 15 00:31:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:35.993633 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2ec7d-7a67-414d-ad4a-98f9b455d3e8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:36.043588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:36.094702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6402853-235a-4bf0-8610-2b9be48e9325 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:36.101064 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2ec7d-7a67-414d-ad4a-98f9b455d3e8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:36.136885 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badcc1d-e9ff-45d9-b878-fecdccab5a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:36.137113 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f490dd8-817a-40f1-87f2-3e9d98dcf6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:36.137547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badcc1d-e9ff-45d9-b878-fecdccab5a63 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:36.137765 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f490dd8-817a-40f1-87f2-3e9d98dcf6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:36.137873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badcc1d-e9ff-45d9-b878-fecdccab5a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:36.138044 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f490dd8-817a-40f1-87f2-3e9d98dcf6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:36.138137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badcc1d-e9ff-45d9-b878-fecdccab5a63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:36.138310 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f490dd8-817a-40f1-87f2-3e9d98dcf6a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:36.138951 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f490dd8-817a-40f1-87f2-3e9d98dcf6a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:36.139258 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f490dd8-817a-40f1-87f2-3e9d98dcf6a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:36.141130 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f490dd8-817a-40f1-87f2-3e9d98dcf6a1 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:36.148132 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badcc1d-e9ff-45d9-b878-fecdccab5a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:36.153951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-1badcc1d-e9ff-45d9-b878-fecdccab5a63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:36.153951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:36.153951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:36.153951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:36.153951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:36.153951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:36.153951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:36.153951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:36.153951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:36.153951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:36.153951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:36.153951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:36.153951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:36.153951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:36.153951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:36.153951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:36.154825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:36.154825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:36.154825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:36.154825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:36.154825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:36.154825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:36.154825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:36.154825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:36.154825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:36.154825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:36.154825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:36.154825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:36.154825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:36.154825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:36.154825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:36.154825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:36.160787 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:36.160787 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:36.160787 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:36.160787 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:36.160787 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:36.160787 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:36.160787 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:36.160787 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:36.160787 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:36.160787 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:36.160787 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:36.160787 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:36.161704 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 260/495] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:36.161704 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f490dd8-817a-40f1-87f2-3e9d98dcf6a1 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:36.161827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 236/496] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:31:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:36.161827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badcc1d-e9ff-45d9-b878-fecdccab5a63 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:36.173356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:36.272261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badcc1d-e9ff-45d9-b878-fecdccab5a63 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:36.274671 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f490dd8-817a-40f1-87f2-3e9d98dcf6a1 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:36.275274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:36.310777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7df5e-5f7a-4c95-a93f-2fd1cf907da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:36.311388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7df5e-5f7a-4c95-a93f-2fd1cf907da3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:36.311663 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7df5e-5f7a-4c95-a93f-2fd1cf907da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:36.311926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7df5e-5f7a-4c95-a93f-2fd1cf907da3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:36.315320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f638e9-438e-4f7e-a473-2c88d6f09956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:36.315911 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f638e9-438e-4f7e-a473-2c88d6f09956 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:36.316194 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f638e9-438e-4f7e-a473-2c88d6f09956 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:36.316464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f638e9-438e-4f7e-a473-2c88d6f09956 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:36.317141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f638e9-438e-4f7e-a473-2c88d6f09956 None admin] RBAC: Adding query filter params (name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:36.317445 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f638e9-438e-4f7e-a473-2c88d6f09956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:36.319277 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f638e9-438e-4f7e-a473-2c88d6f09956 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:36.322797 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7df5e-5f7a-4c95-a93f-2fd1cf907da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:36.324230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7df5e-5f7a-4c95-a93f-2fd1cf907da3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:36.327909 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 261/497] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 15 00:31:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:36.328700 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f638e9-438e-4f7e-a473-2c88d6f09956 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:36.341357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-07e7df5e-5f7a-4c95-a93f-2fd1cf907da3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:36.341357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:36.341357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:36.341357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:36.341357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:36.341357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:36.341357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:36.341357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:36.341357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:36.341357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:36.341357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:36.341357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:36.341357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:36.341357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:36.341357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:36.341357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:36.342287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:36.342287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:36.342287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:36.342287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:36.342287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:36.342287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:36.342287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:36.342287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:36.342287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:36.342287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:36.342287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:36.342287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:36.342287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:36.342287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:36.342287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:36.342287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:36.342287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:36.343686 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:36.343686 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:36.343686 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:36.343686 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 237/498] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:36.343686 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7df5e-5f7a-4c95-a93f-2fd1cf907da3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:36.404113 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:36.435084 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f638e9-438e-4f7e-a473-2c88d6f09956 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:36.442762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7df5e-5f7a-4c95-a93f-2fd1cf907da3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:36.468152 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe260a-a513-415e-ad3e-358f346e1f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:36.468748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe260a-a513-415e-ad3e-358f346e1f04 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:36.469029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe260a-a513-415e-ad3e-358f346e1f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:36.469331 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe260a-a513-415e-ad3e-358f346e1f04 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:36.469985 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe260a-a513-415e-ad3e-358f346e1f04 None admin] RBAC: Adding query filter params (name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:36.470287 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe260a-a513-415e-ad3e-358f346e1f04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:36.471640 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe260a-a513-415e-ad3e-358f346e1f04 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:36.475974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbc977-6b94-49c2-979f-56258ef3761b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:36.476629 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbc977-6b94-49c2-979f-56258ef3761b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:36.476907 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbc977-6b94-49c2-979f-56258ef3761b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:36.477202 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbc977-6b94-49c2-979f-56258ef3761b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:36.479264 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 262/499] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 15 00:31:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:36.480377 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bd713-bf5d-4060-8e0a-2e09af67c1f1 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:36.480658 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bd713-bf5d-4060-8e0a-2e09af67c1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:36.480927 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bd713-bf5d-4060-8e0a-2e09af67c1f1 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:36.482165 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 263/500] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:36.482848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bd713-bf5d-4060-8e0a-2e09af67c1f1 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:36.489714 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbc977-6b94-49c2-979f-56258ef3761b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:36.491158 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbc977-6b94-49c2-979f-56258ef3761b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:36.504142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-b0fbc977-6b94-49c2-979f-56258ef3761b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 00:31:36.504142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:36.504142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:36.504142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:36.504142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:36.504142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:36.504142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:36.504142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:36.504142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:36.504142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:36.504142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:36.504142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:36.504142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:31:36.504142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:31:36.504142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:31:36.504142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:31:36.505211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:36.505211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:36.505211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:31:36.505211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:36.505211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:31:36.505211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:36.505211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:36.505211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:36.505211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:36.505211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:36.505211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:36.505211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:36.505211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:36.505211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:36.505211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:36.505211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:36.505211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:36.505211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:36.506112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:36.506112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:36.506112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:31:36.506112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:31:36.506112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:31:36.506112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:31:36.506112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:31:36.506112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:31:36.506112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 00:31:36.506112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:36.506112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 238/501] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Sep 15 00:31:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:36.506112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbc977-6b94-49c2-979f-56258ef3761b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:36.526276 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:36.590729 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bd713-bf5d-4060-8e0a-2e09af67c1f1 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:36.604767 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbc977-6b94-49c2-979f-56258ef3761b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:36.624963 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0940aa-86ad-471b-926b-0d804c73ed68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:36.625617 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0940aa-86ad-471b-926b-0d804c73ed68 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:36.625896 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0940aa-86ad-471b-926b-0d804c73ed68 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:36.626169 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0940aa-86ad-471b-926b-0d804c73ed68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:36.628310 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:36.639342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0940aa-86ad-471b-926b-0d804c73ed68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:36.639921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d767177-5ea9-42a4-8aa5-ca1bd5c98d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:36.640517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d767177-5ea9-42a4-8aa5-ca1bd5c98d34 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:36.640777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0940aa-86ad-471b-926b-0d804c73ed68 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:36.640887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d767177-5ea9-42a4-8aa5-ca1bd5c98d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:36.641057 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d767177-5ea9-42a4-8aa5-ca1bd5c98d34 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:36.641726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d767177-5ea9-42a4-8aa5-ca1bd5c98d34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:36.642029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d767177-5ea9-42a4-8aa5-ca1bd5c98d34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:36.643396 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d767177-5ea9-42a4-8aa5-ca1bd5c98d34 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:36.654530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-ad0940aa-86ad-471b-926b-0d804c73ed68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:36.654530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:36.654530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:36.654530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:36.654530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:36.654530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:36.654530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:36.654530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:36.654530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:36.654530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:36.654530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:36.654530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:36.654530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:36.654530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:36.654530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:36.654530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:36.655386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:36.655386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:36.655386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:36.655386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:36.655386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:36.655386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:36.655386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:36.655386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:36.655386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:36.655386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:36.655386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:36.655386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:36.655386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:36.655386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:36.655386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:36.655386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:36.655386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:36.656247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:36.656247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:36.656247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:36.656247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 264/502] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:36.656743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0940aa-86ad-471b-926b-0d804c73ed68 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:36.657079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 239/503] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:36.658471 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5654e-8f63-4916-980b-2ec3ed388e54 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:36.658928 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5654e-8f63-4916-980b-2ec3ed388e54 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:36.659415 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5654e-8f63-4916-980b-2ec3ed388e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:36.676705 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-39a5654e-8f63-4916-980b-2ec3ed388e54 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:36.677908 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-39a5654e-8f63-4916-980b-2ec3ed388e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:36.743574 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 240/504] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:36.744441 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5654e-8f63-4916-980b-2ec3ed388e54 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:36.754403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0940aa-86ad-471b-926b-0d804c73ed68 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:36.764512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:36.788768 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23125026-87bc-45d6-8aa8-a651b016e0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:36.789426 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23125026-87bc-45d6-8aa8-a651b016e0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:36.789702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23125026-87bc-45d6-8aa8-a651b016e0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:36.789977 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23125026-87bc-45d6-8aa8-a651b016e0f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:36.803149 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23125026-87bc-45d6-8aa8-a651b016e0f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:36.805229 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23125026-87bc-45d6-8aa8-a651b016e0f6 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:36.819460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-23125026-87bc-45d6-8aa8-a651b016e0f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:36.819460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:36.819460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:36.819460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:36.819460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:36.819460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:36.819460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:36.819460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:36.819460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:36.819460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:36.819460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:36.819460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:36.819460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:36.819460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:36.819460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:36.819460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:36.821080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:36.821080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:36.821080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:36.821080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:36.821080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:36.821080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:36.821080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:36.821080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:36.821080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:36.821080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:36.821080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:36.821080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:36.821080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:36.821080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:36.821080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:36.821080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:36.821080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:36.822028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:36.822028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:36.822028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:36.822947 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 265/505] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:36.823559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23125026-87bc-45d6-8aa8-a651b016e0f6 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:36.866220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5654e-8f63-4916-980b-2ec3ed388e54 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:36.870211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:36.903571 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49804a37-54cf-4920-8b08-b2c2fd3561c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:36.904182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49804a37-54cf-4920-8b08-b2c2fd3561c2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:36.904466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49804a37-54cf-4920-8b08-b2c2fd3561c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:36.904749 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49804a37-54cf-4920-8b08-b2c2fd3561c2 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:36.905508 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49804a37-54cf-4920-8b08-b2c2fd3561c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:36.905979 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49804a37-54cf-4920-8b08-b2c2fd3561c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:36.907265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49804a37-54cf-4920-8b08-b2c2fd3561c2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:36.937313 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23125026-87bc-45d6-8aa8-a651b016e0f6 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:36.949451 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 241/506] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Sep 15 00:31:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:36.950343 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49804a37-54cf-4920-8b08-b2c2fd3561c2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:36.971658 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5229e-990f-409c-a6ec-07262ad82611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:36.972661 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5229e-990f-409c-a6ec-07262ad82611 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:36.972942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5229e-990f-409c-a6ec-07262ad82611 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:36.973266 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5229e-990f-409c-a6ec-07262ad82611 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:36.973882 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5229e-990f-409c-a6ec-07262ad82611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:36.974181 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5229e-990f-409c-a6ec-07262ad82611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:36.975707 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5229e-990f-409c-a6ec-07262ad82611 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:36.988612 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 266/507] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:36.988612 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5229e-990f-409c-a6ec-07262ad82611 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:37.018354 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:37.056380 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49804a37-54cf-4920-8b08-b2c2fd3561c2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:37.088889 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39ec5f-5469-42e4-bba5-400da0424ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:37.089619 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39ec5f-5469-42e4-bba5-400da0424ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:37.089771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:37.089900 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39ec5f-5469-42e4-bba5-400da0424ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:37.090176 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39ec5f-5469-42e4-bba5-400da0424ec6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:37.093532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5229e-990f-409c-a6ec-07262ad82611 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:37.097467 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39ec5f-5469-42e4-bba5-400da0424ec6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:37.098924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39ec5f-5469-42e4-bba5-400da0424ec6 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:37.110910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-bb39ec5f-5469-42e4-bba5-400da0424ec6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 00:31:37.110910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:37.110910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:37.110910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:37.110910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:37.110910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:37.110910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:37.110910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:37.110910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:37.110910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:37.110910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:37.110910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:37.110910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:31:37.110910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:31:37.110910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:31:37.110910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:31:37.111933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:37.111933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:37.111933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:31:37.111933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:37.111933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:31:37.111933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:37.111933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:37.111933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:37.111933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:37.111933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:37.111933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:37.111933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:37.111933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:37.111933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:37.111933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:37.111933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:37.111933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:37.111933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:37.118335 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:37.118335 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:37.118335 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:31:37.118335 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:31:37.118335 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:31:37.118335 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:31:37.118335 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:31:37.118335 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:31:37.118335 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 15 00:31:37.118335 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:37.118335 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 242/508] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:37.118335 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39ec5f-5469-42e4-bba5-400da0424ec6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:37.128784 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f62b9-8c23-4e63-96fa-2fe486e925ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:37.129420 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f62b9-8c23-4e63-96fa-2fe486e925ea None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:37.129700 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f62b9-8c23-4e63-96fa-2fe486e925ea None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:37.129970 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f62b9-8c23-4e63-96fa-2fe486e925ea None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:37.130605 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f62b9-8c23-4e63-96fa-2fe486e925ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:37.130910 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f62b9-8c23-4e63-96fa-2fe486e925ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:37.132256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f62b9-8c23-4e63-96fa-2fe486e925ea None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:37.144485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 267/509] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:37.145384 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f62b9-8c23-4e63-96fa-2fe486e925ea None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:37.214281 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39ec5f-5469-42e4-bba5-400da0424ec6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:37.237296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:37.246116 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f62b9-8c23-4e63-96fa-2fe486e925ea None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:37.248623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89355bc2-61e6-4112-a268-e533211e5e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:37.249253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89355bc2-61e6-4112-a268-e533211e5e73 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:37.249531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89355bc2-61e6-4112-a268-e533211e5e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:37.249800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89355bc2-61e6-4112-a268-e533211e5e73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:37.279163 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70615efa-4e54-46b0-98e0-c49d88465c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:37.279713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70615efa-4e54-46b0-98e0-c49d88465c62 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:37.279990 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70615efa-4e54-46b0-98e0-c49d88465c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:37.280265 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70615efa-4e54-46b0-98e0-c49d88465c62 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:37.287702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70615efa-4e54-46b0-98e0-c49d88465c62 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:37.289721 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70615efa-4e54-46b0-98e0-c49d88465c62 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:37.301966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-70615efa-4e54-46b0-98e0-c49d88465c62 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 00:31:37.301966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:37.301966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:37.301966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:37.301966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:37.301966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:37.301966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:37.301966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:37.301966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:37.301966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:37.301966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:37.301966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:37.301966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:31:37.301966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:31:37.301966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:31:37.301966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:31:37.302879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:37.302879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:37.302879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:31:37.302879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:37.302879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:31:37.302879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:37.302879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:37.302879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:37.302879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:37.302879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:37.302879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:37.302879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:37.302879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:37.302879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:37.302879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:37.302879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:37.302879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:37.302879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:37.303804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:37.303804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:37.303804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:31:37.303804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:31:37.303804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:31:37.303804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:31:37.303804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:31:37.303804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:31:37.303804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 00:31:37.303804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:37.303804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 268/510] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:37.303804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70615efa-4e54-46b0-98e0-c49d88465c62 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:37.321535 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89355bc2-61e6-4112-a268-e533211e5e73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:37.323019 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89355bc2-61e6-4112-a268-e533211e5e73 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:37.323143 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:37.408019 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70615efa-4e54-46b0-98e0-c49d88465c62 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:37.424216 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 243/511] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:31:37.425282 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89355bc2-61e6-4112-a268-e533211e5e73 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:37.445785 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea259f-2f8e-4a77-8ec0-78bb556ecd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:37.446399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea259f-2f8e-4a77-8ec0-78bb556ecd6d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:37.446673 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea259f-2f8e-4a77-8ec0-78bb556ecd6d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:37.446940 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea259f-2f8e-4a77-8ec0-78bb556ecd6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:37.448530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:37.457582 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea259f-2f8e-4a77-8ec0-78bb556ecd6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:37.459012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea259f-2f8e-4a77-8ec0-78bb556ecd6d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:37.473341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-4eea259f-2f8e-4a77-8ec0-78bb556ecd6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:37.473341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:37.473341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:37.473341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:37.473341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:37.473341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:37.473341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:37.473341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:37.473341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:37.473341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:37.473341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:37.473341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:37.473341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:37.473341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:37.473341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:37.473341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:37.474402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:37.474402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:37.474402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:37.474402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:37.474402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:37.474402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:37.474402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:37.474402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:37.474402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:37.474402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:37.474402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:37.474402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:37.474402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:37.474402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:37.474402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:37.474402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:37.474402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:37.475254 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:37.475254 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:37.475254 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:37.475254 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 269/512] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:37.475465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea259f-2f8e-4a77-8ec0-78bb556ecd6d None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:37.522112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89355bc2-61e6-4112-a268-e533211e5e73 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:37.546155 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:37.557737 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b723227-36a1-4949-882b-24edbadfdc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:37.558438 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b723227-36a1-4949-882b-24edbadfdc28 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:37.558743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b723227-36a1-4949-882b-24edbadfdc28 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:37.558987 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b723227-36a1-4949-882b-24edbadfdc28 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:37.559715 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b723227-36a1-4949-882b-24edbadfdc28 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:37.560019 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b723227-36a1-4949-882b-24edbadfdc28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:37.561473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b723227-36a1-4949-882b-24edbadfdc28 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:37.576792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea259f-2f8e-4a77-8ec0-78bb556ecd6d None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:37.579331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 244/513] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Sep 15 00:31:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:37.580124 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b723227-36a1-4949-882b-24edbadfdc28 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:37.610787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfaddc-71a5-4536-a519-f9bedffa4918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:37.611406 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfaddc-71a5-4536-a519-f9bedffa4918 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:37.611686 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfaddc-71a5-4536-a519-f9bedffa4918 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:37.611958 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfaddc-71a5-4536-a519-f9bedffa4918 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:37.619254 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dfaddc-71a5-4536-a519-f9bedffa4918 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:37.620668 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dfaddc-71a5-4536-a519-f9bedffa4918 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:37.631560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-05dfaddc-71a5-4536-a519-f9bedffa4918 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 00:31:37.631560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:37.631560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:37.631560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:37.631560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:37.631560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:37.631560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:37.631560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:37.631560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:37.631560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:37.631560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:37.631560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:37.631560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:31:37.631560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:31:37.631560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:31:37.631560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:31:37.632621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:37.632621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:37.632621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:31:37.632621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:37.632621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:31:37.632621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:37.632621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:37.632621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:37.632621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:37.632621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:37.632621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:37.632621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:37.632621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:37.632621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:37.632621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:37.632621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:37.632621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:37.632621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:37.634233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:37.634233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:37.634233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:31:37.634233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:31:37.634233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:31:37.634233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:31:37.634233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:31:37.634233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:31:37.634233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 00:31:37.634233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:37.634233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 270/514] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:31:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:37.634233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfaddc-71a5-4536-a519-f9bedffa4918 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:37.665421 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:37.687246 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b723227-36a1-4949-882b-24edbadfdc28 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:37.721732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52602564-6de1-4775-b57d-4c09ce1554f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:37.722440 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52602564-6de1-4775-b57d-4c09ce1554f3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:37.722813 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52602564-6de1-4775-b57d-4c09ce1554f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:37.723152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52602564-6de1-4775-b57d-4c09ce1554f3 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:37.723931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52602564-6de1-4775-b57d-4c09ce1554f3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:37.724241 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52602564-6de1-4775-b57d-4c09ce1554f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:37.725716 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52602564-6de1-4775-b57d-4c09ce1554f3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:37.733117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfaddc-71a5-4536-a519-f9bedffa4918 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:37.742582 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 245/515] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Sep 15 00:31:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:37.743351 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52602564-6de1-4775-b57d-4c09ce1554f3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:37.765662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:37.772128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b0096-7f94-414b-8120-37156ff88121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:37.772751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b0096-7f94-414b-8120-37156ff88121 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:37.773028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b0096-7f94-414b-8120-37156ff88121 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:37.773327 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b0096-7f94-414b-8120-37156ff88121 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:37.784394 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b0096-7f94-414b-8120-37156ff88121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:37.785841 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b0096-7f94-414b-8120-37156ff88121 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:37.799621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-3d1b0096-7f94-414b-8120-37156ff88121 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:37.799621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:37.799621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:37.799621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:37.799621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:37.799621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:37.799621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:37.799621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:37.799621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:37.799621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:37.799621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:37.799621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:37.799621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:37.799621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:37.799621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:37.799621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:37.800616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:37.800616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:37.800616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:37.800616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:37.800616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:37.800616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:37.800616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:37.800616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:37.800616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:37.800616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:37.800616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:37.800616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:37.800616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:37.800616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:37.800616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:37.800616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:37.800616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:37.801542 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:37.801542 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:37.801542 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:37.801542 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 271/516] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:37.801542 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b0096-7f94-414b-8120-37156ff88121 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:37.846268 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52602564-6de1-4775-b57d-4c09ce1554f3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:37.878593 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e47b8-64d3-4d3c-9f61-65a1c9dd17aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:37.879186 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e47b8-64d3-4d3c-9f61-65a1c9dd17aa None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:37.879470 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e47b8-64d3-4d3c-9f61-65a1c9dd17aa None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:37.879739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e47b8-64d3-4d3c-9f61-65a1c9dd17aa None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:37.880371 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e47b8-64d3-4d3c-9f61-65a1c9dd17aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:37.880671 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e47b8-64d3-4d3c-9f61-65a1c9dd17aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:37.882106 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e47b8-64d3-4d3c-9f61-65a1c9dd17aa None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:37.890902 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:37.894205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 246/517] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:37.895319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e47b8-64d3-4d3c-9f61-65a1c9dd17aa None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:37.904121 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b0096-7f94-414b-8120-37156ff88121 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:37.937264 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ddd6d-318a-49a0-9d83-1945b4286950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:37.937944 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ddd6d-318a-49a0-9d83-1945b4286950 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:37.938221 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ddd6d-318a-49a0-9d83-1945b4286950 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:37.938495 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ddd6d-318a-49a0-9d83-1945b4286950 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:37.986340 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:37.992580 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e47b8-64d3-4d3c-9f61-65a1c9dd17aa None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:38.004253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ddd6d-318a-49a0-9d83-1945b4286950 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:38.005859 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ddd6d-318a-49a0-9d83-1945b4286950 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:38.026128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86178ff9-61f2-48c8-afd9-0714adab143c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:38.026720 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86178ff9-61f2-48c8-afd9-0714adab143c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:38.027005 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86178ff9-61f2-48c8-afd9-0714adab143c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:38.027277 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86178ff9-61f2-48c8-afd9-0714adab143c None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:38.028000 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86178ff9-61f2-48c8-afd9-0714adab143c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:38.028309 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86178ff9-61f2-48c8-afd9-0714adab143c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:38.029758 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86178ff9-61f2-48c8-afd9-0714adab143c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:38.049016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 247/518] 10.222.0.52 () {56 vars in 1139 bytes} [Thu Sep 15 00:31:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:38.049792 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86178ff9-61f2-48c8-afd9-0714adab143c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:38.107055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:38.112424 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 272/519] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:31:38.112424 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ddd6d-318a-49a0-9d83-1945b4286950 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:38.151660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86178ff9-61f2-48c8-afd9-0714adab143c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:38.184603 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca389862-d513-43b8-ab8c-7095fb21d851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:38.185217 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca389862-d513-43b8-ab8c-7095fb21d851 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:38.185498 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca389862-d513-43b8-ab8c-7095fb21d851 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:38.185766 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca389862-d513-43b8-ab8c-7095fb21d851 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:38.186435 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:38.204325 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ddd6d-318a-49a0-9d83-1945b4286950 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:38.240833 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf8dcb-f428-49d7-bdfa-52c4bc60efc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:38.241455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf8dcb-f428-49d7-bdfa-52c4bc60efc6 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:38.241739 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf8dcb-f428-49d7-bdfa-52c4bc60efc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:38.242120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf8dcb-f428-49d7-bdfa-52c4bc60efc6 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:38.242741 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf8dcb-f428-49d7-bdfa-52c4bc60efc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:38.243045 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf8dcb-f428-49d7-bdfa-52c4bc60efc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:38.244406 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf8dcb-f428-49d7-bdfa-52c4bc60efc6 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:38.254871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca389862-d513-43b8-ab8c-7095fb21d851 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:38.255367 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 273/520] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:38.256119 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf8dcb-f428-49d7-bdfa-52c4bc60efc6 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:38.256375 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca389862-d513-43b8-ab8c-7095fb21d851 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:38.314299 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:38.358580 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 248/521] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:31:38.359671 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca389862-d513-43b8-ab8c-7095fb21d851 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:38.362416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf8dcb-f428-49d7-bdfa-52c4bc60efc6 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:38.395267 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eca45c-6c23-45df-b2c8-b125be1d9cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:38.395857 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eca45c-6c23-45df-b2c8-b125be1d9cf5 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:38.396135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eca45c-6c23-45df-b2c8-b125be1d9cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:38.396405 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eca45c-6c23-45df-b2c8-b125be1d9cf5 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:38.397039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eca45c-6c23-45df-b2c8-b125be1d9cf5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:38.399076 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eca45c-6c23-45df-b2c8-b125be1d9cf5 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:38.414809 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:38.421007 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 274/522] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 15 00:31:38 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:31:38.421904 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eca45c-6c23-45df-b2c8-b125be1d9cf5 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:38.478375 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca389862-d513-43b8-ab8c-7095fb21d851 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:38.516638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0498b-c7fa-40a1-a3e3-b04ed798f17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:38.517453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0498b-c7fa-40a1-a3e3-b04ed798f17f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:38.517941 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0498b-c7fa-40a1-a3e3-b04ed798f17f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:38.518305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0498b-c7fa-40a1-a3e3-b04ed798f17f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:38.542643 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eca45c-6c23-45df-b2c8-b125be1d9cf5 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:38.550890 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:38.582006 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a8abf-001a-4cf9-8115-077c832c30c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:38.582648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a8abf-001a-4cf9-8115-077c832c30c6 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:38.582935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a8abf-001a-4cf9-8115-077c832c30c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:38.583374 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a8abf-001a-4cf9-8115-077c832c30c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:38.598537 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a8abf-001a-4cf9-8115-077c832c30c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:38.600154 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a8abf-001a-4cf9-8115-077c832c30c6 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:38.603079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0498b-c7fa-40a1-a3e3-b04ed798f17f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:38.604694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0498b-c7fa-40a1-a3e3-b04ed798f17f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:38.617525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-c16a8abf-001a-4cf9-8115-077c832c30c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:38.617525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:38.617525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:38.617525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:38.617525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:38.617525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:38.617525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:38.617525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:38.617525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:38.617525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:38.617525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:38.617525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:38.617525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:38.617525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:38.617525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:38.617525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:38.618711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:38.618711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:38.618711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:38.618711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:38.618711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:38.618711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:38.618711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:38.618711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:38.618711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:38.618711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:38.618711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:38.618711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:38.618711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:38.618711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:38.618711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:38.618711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:38.618711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:38.619573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:38.619573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:38.619573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:38.619573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 275/523] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:38.619808 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a8abf-001a-4cf9-8115-077c832c30c6 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:38.676871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:38.719034 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 249/524] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:31:38.720126 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0498b-c7fa-40a1-a3e3-b04ed798f17f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:38.733892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a8abf-001a-4cf9-8115-077c832c30c6 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:38.769297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d858d4-013b-42f8-bcbf-5554f97f0c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:38.769945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d858d4-013b-42f8-bcbf-5554f97f0c01 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:38.770181 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d858d4-013b-42f8-bcbf-5554f97f0c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:38.770454 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d858d4-013b-42f8-bcbf-5554f97f0c01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:38.778488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d858d4-013b-42f8-bcbf-5554f97f0c01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:38.779521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:38.779949 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d858d4-013b-42f8-bcbf-5554f97f0c01 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:38.793644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-55d858d4-013b-42f8-bcbf-5554f97f0c01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:38.793644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:38.793644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:38.793644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:38.793644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:38.793644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:38.793644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:38.793644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:38.793644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:38.793644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:38.793644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:38.793644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:38.793644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:31:38.793644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:31:38.793644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:31:38.794712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:31:38.794712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:38.794712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:38.794712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:38.794712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:38.794712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:38.794712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:38.794712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:38.794712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:38.794712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:38.794712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:38.794712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:38.794712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:38.794712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:38.794712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:38.794712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:38.794712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:38.795872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:31:38.795872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:31:38.795872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:31:38.795872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:31:38.795872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:31:38.795872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:31:38.795872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:38.795872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:38.799763 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 276/525] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:38.800476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d858d4-013b-42f8-bcbf-5554f97f0c01 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:38.824258 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0498b-c7fa-40a1-a3e3-b04ed798f17f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:38.858738 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b22f2f-4d13-4e41-adb6-f76b7136abd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:38.859665 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b22f2f-4d13-4e41-adb6-f76b7136abd1 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:38.859932 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b22f2f-4d13-4e41-adb6-f76b7136abd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:38.860195 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b22f2f-4d13-4e41-adb6-f76b7136abd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:38.870260 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b22f2f-4d13-4e41-adb6-f76b7136abd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:38.871694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b22f2f-4d13-4e41-adb6-f76b7136abd1 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:38.886061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-80b22f2f-4d13-4e41-adb6-f76b7136abd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:38.886061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:38.886061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:38.886061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:38.886061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:38.886061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:38.886061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:38.886061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:38.886061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:38.886061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:38.886061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:38.886061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:38.886061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:38.886061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:38.886061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:38.886061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:38.887213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:38.887213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:38.887213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:38.887213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:38.887213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:38.887213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:38.887213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:38.887213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:38.887213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:38.887213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:38.887213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:38.887213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:38.887213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:38.887213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:38.887213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:38.887213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:38.887213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:38.888268 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:38.888268 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:38.888268 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:38.891640 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 250/526] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:38.892345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b22f2f-4d13-4e41-adb6-f76b7136abd1 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:38.909217 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d858d4-013b-42f8-bcbf-5554f97f0c01 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:38.920844 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:38.948466 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9447b-7cc5-4aba-9a93-5b5f25e54fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:38.949104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9447b-7cc5-4aba-9a93-5b5f25e54fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:38.949391 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9447b-7cc5-4aba-9a93-5b5f25e54fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:38.949767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9447b-7cc5-4aba-9a93-5b5f25e54fa2 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:38.950408 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9447b-7cc5-4aba-9a93-5b5f25e54fa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:38.950825 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9447b-7cc5-4aba-9a93-5b5f25e54fa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:38.952191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9447b-7cc5-4aba-9a93-5b5f25e54fa2 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:38.966215 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 277/527] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:38.967125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9447b-7cc5-4aba-9a93-5b5f25e54fa2 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:38.998603 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b22f2f-4d13-4e41-adb6-f76b7136abd1 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:39.009358 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:39.036097 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451d792-cbb3-4031-9dbd-a54725507fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:39.036727 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451d792-cbb3-4031-9dbd-a54725507fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:39.037007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451d792-cbb3-4031-9dbd-a54725507fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:39.037301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451d792-cbb3-4031-9dbd-a54725507fa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:39.050359 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451d792-cbb3-4031-9dbd-a54725507fa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:39.052222 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451d792-cbb3-4031-9dbd-a54725507fa5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:39.066417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-8451d792-cbb3-4031-9dbd-a54725507fa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:39.066417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:39.066417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:39.066417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:39.066417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:39.066417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:39.066417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:39.066417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:39.066417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:39.066417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:39.066417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:39.066417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:39.066417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:39.066417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:39.066417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:39.066417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:39.067477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:39.067477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:39.067477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:39.067477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:39.067477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:39.067477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:39.067477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:39.067477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:39.067477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:39.067477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:39.067477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:39.067477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:39.067477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:39.067477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:39.067477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:39.067477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:39.067477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:39.068499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:39.068499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:39.068499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:39.068499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 251/528] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:39.068499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451d792-cbb3-4031-9dbd-a54725507fa5 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:39.080417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9447b-7cc5-4aba-9a93-5b5f25e54fa2 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:39.118306 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7d42f-10d4-46c8-bc57-26d4d92f80b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:39.118933 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7d42f-10d4-46c8-bc57-26d4d92f80b9 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:39.119215 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7d42f-10d4-46c8-bc57-26d4d92f80b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:39.119488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7d42f-10d4-46c8-bc57-26d4d92f80b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:39.120177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7d42f-10d4-46c8-bc57-26d4d92f80b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:39.120481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7d42f-10d4-46c8-bc57-26d4d92f80b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:39.121967 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7d42f-10d4-46c8-bc57-26d4d92f80b9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:39.140593 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 278/529] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:31:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:39.141471 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7d42f-10d4-46c8-bc57-26d4d92f80b9 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:39.172548 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:39.188627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451d792-cbb3-4031-9dbd-a54725507fa5 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:39.224498 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f812bb-feac-4807-b2ce-2ca121f42901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:39.225378 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f812bb-feac-4807-b2ce-2ca121f42901 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:39.225573 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f812bb-feac-4807-b2ce-2ca121f42901 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:39.225823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f812bb-feac-4807-b2ce-2ca121f42901 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:39.227061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f812bb-feac-4807-b2ce-2ca121f42901 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:39.227167 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f812bb-feac-4807-b2ce-2ca121f42901 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:39.228555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f812bb-feac-4807-b2ce-2ca121f42901 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:39.244711 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 252/530] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:39.244711 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f812bb-feac-4807-b2ce-2ca121f42901 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:39.252559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7d42f-10d4-46c8-bc57-26d4d92f80b9 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:39.267235 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:39.288696 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2473ae-c137-44a4-9b11-d7e37dcddbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:39.289491 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2473ae-c137-44a4-9b11-d7e37dcddbd0 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:39.289852 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2473ae-c137-44a4-9b11-d7e37dcddbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:39.290130 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2473ae-c137-44a4-9b11-d7e37dcddbd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:39.299913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2473ae-c137-44a4-9b11-d7e37dcddbd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:39.301445 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2473ae-c137-44a4-9b11-d7e37dcddbd0 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:39.313263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-bd2473ae-c137-44a4-9b11-d7e37dcddbd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:39.313263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:39.313263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:39.313263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:39.313263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:39.313263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:39.313263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:39.313263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:39.313263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:39.313263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:39.313263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:39.313263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:39.313263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:31:39.313263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:31:39.313263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:31:39.314129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:31:39.314129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:39.314129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:39.314129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:39.314129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:39.314129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:39.314129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:39.314129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:39.314129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:39.314129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:39.314129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:39.314129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:39.314129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:39.314129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:39.314129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:39.314129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:39.314129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:39.319787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:31:39.319787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:31:39.319787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:31:39.319787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:31:39.319787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:31:39.319787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:31:39.319787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:39.319787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:39.319787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 279/531] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:39.319787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2473ae-c137-44a4-9b11-d7e37dcddbd0 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:39.365131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f812bb-feac-4807-b2ce-2ca121f42901 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:39.402395 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a987a-1b7a-4a78-876b-08193886e902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:39.403188 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a987a-1b7a-4a78-876b-08193886e902 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:39.403613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a987a-1b7a-4a78-876b-08193886e902 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:39.404052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a987a-1b7a-4a78-876b-08193886e902 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:39.404693 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a987a-1b7a-4a78-876b-08193886e902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:39.404996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a987a-1b7a-4a78-876b-08193886e902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:39.406391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a987a-1b7a-4a78-876b-08193886e902 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:39.417933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 253/532] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:39.422981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a987a-1b7a-4a78-876b-08193886e902 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:39.426751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:39.437694 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2473ae-c137-44a4-9b11-d7e37dcddbd0 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:39.474701 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2a1c2-f568-4a2d-854b-874ce18e3d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:39.475298 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2a1c2-f568-4a2d-854b-874ce18e3d01 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:39.475579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2a1c2-f568-4a2d-854b-874ce18e3d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:39.475855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2a1c2-f568-4a2d-854b-874ce18e3d01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:39.476587 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2a1c2-f568-4a2d-854b-874ce18e3d01 None admin] RBAC: Adding query filter params (role.id=e5b76a8345d542c2a899f8dbdd95290d, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=bfcfcf8061f24231858b9b0205a8abaa) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:39.476903 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2a1c2-f568-4a2d-854b-874ce18e3d01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:39.478367 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2a1c2-f568-4a2d-854b-874ce18e3d01 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:39.489240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 280/533] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:31:39 2022] GET /identity/v3/role_assignments?user.id=bfcfcf8061f24231858b9b0205a8abaa&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=e5b76a8345d542c2a899f8dbdd95290d => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:39.489240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2a1c2-f568-4a2d-854b-874ce18e3d01 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:39.520901 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:39.547866 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a987a-1b7a-4a78-876b-08193886e902 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:39.587535 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107076c-67c7-47a8-b9fc-95aa1fd38261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:39.588168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107076c-67c7-47a8-b9fc-95aa1fd38261 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:39.588449 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107076c-67c7-47a8-b9fc-95aa1fd38261 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:39.588778 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107076c-67c7-47a8-b9fc-95aa1fd38261 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:39.596669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107076c-67c7-47a8-b9fc-95aa1fd38261 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:39.598260 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107076c-67c7-47a8-b9fc-95aa1fd38261 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:39.611895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-d107076c-67c7-47a8-b9fc-95aa1fd38261 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:39.611895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:39.611895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:39.611895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:39.611895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:39.611895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:39.611895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:39.611895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:39.611895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:39.611895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:39.611895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:39.611895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:39.611895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:31:39.611895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:31:39.611895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:31:39.612999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:31:39.612999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:39.612999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:39.612999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:39.612999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:39.612999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:39.612999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:39.612999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:39.612999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:39.612999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:39.612999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:39.612999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:39.612999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:39.612999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:39.612999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:39.612999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:39.612999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:39.613989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:31:39.613989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:31:39.613989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:31:39.613989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:31:39.613989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:31:39.613989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:31:39.613989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:39.613989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:39.618011 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 254/534] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:39.619062 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107076c-67c7-47a8-b9fc-95aa1fd38261 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:39.658897 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2a1c2-f568-4a2d-854b-874ce18e3d01 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:39.706476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c9ea6-f5db-4740-8f8d-5fd47289d787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:39.707223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c9ea6-f5db-4740-8f8d-5fd47289d787 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:39.707603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c9ea6-f5db-4740-8f8d-5fd47289d787 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:39.707971 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c9ea6-f5db-4740-8f8d-5fd47289d787 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:39.709235 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c9ea6-f5db-4740-8f8d-5fd47289d787 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:39.709646 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c9ea6-f5db-4740-8f8d-5fd47289d787 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:39.711927 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c9ea6-f5db-4740-8f8d-5fd47289d787 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:39.729224 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 281/535] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:31:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:39.730096 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c9ea6-f5db-4740-8f8d-5fd47289d787 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:39.744547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107076c-67c7-47a8-b9fc-95aa1fd38261 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:39.749912 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:39.783682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324cba3-8c03-491b-baab-6492d4c8a770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:39.784647 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324cba3-8c03-491b-baab-6492d4c8a770 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:39.785160 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324cba3-8c03-491b-baab-6492d4c8a770 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:39.785724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324cba3-8c03-491b-baab-6492d4c8a770 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:39.793383 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324cba3-8c03-491b-baab-6492d4c8a770 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:39.795229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324cba3-8c03-491b-baab-6492d4c8a770 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:39.808075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-8324cba3-8c03-491b-baab-6492d4c8a770 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:39.808075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:39.808075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:39.808075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:39.808075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:39.808075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:39.808075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:39.808075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:39.808075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:39.808075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:39.808075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:39.808075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:39.808075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:31:39.808075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:31:39.808075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:31:39.809003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:31:39.809003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:39.809003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:39.809003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:39.809003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:39.809003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:39.809003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:39.809003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:39.809003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:39.809003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:39.809003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:39.809003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:39.809003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:39.809003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:39.809003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:39.809003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:39.809003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:39.810131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:31:39.810131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:31:39.810131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:31:39.810131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:31:39.810131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:31:39.810131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:31:39.810131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:39.810131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:39.812061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 255/536] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:39.817656 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324cba3-8c03-491b-baab-6492d4c8a770 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:39.828512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:39.838853 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c9ea6-f5db-4740-8f8d-5fd47289d787 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:39.875066 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf4804-25b1-4183-ba2c-4f80d54ecded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:39.875694 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf4804-25b1-4183-ba2c-4f80d54ecded None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:39.875974 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf4804-25b1-4183-ba2c-4f80d54ecded None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:39.876233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf4804-25b1-4183-ba2c-4f80d54ecded None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:39.876970 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf4804-25b1-4183-ba2c-4f80d54ecded None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:39.877331 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf4804-25b1-4183-ba2c-4f80d54ecded None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:39.878758 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf4804-25b1-4183-ba2c-4f80d54ecded None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:39.897130 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 282/537] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:31:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:39.897130 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf4804-25b1-4183-ba2c-4f80d54ecded None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:39.941428 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324cba3-8c03-491b-baab-6492d4c8a770 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:39.970773 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:39.982500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d4a0c-dac3-450a-8b6f-7a6dad33c08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:39.983446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d4a0c-dac3-450a-8b6f-7a6dad33c08e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:39.983924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d4a0c-dac3-450a-8b6f-7a6dad33c08e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:39.984649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d4a0c-dac3-450a-8b6f-7a6dad33c08e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:39.985763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d4a0c-dac3-450a-8b6f-7a6dad33c08e None admin] RBAC: Adding query filter params (role.id=e5b76a8345d542c2a899f8dbdd95290d, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=f12ce70a7c4f4396ab3fbb635dfc548b) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:39.986326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d4a0c-dac3-450a-8b6f-7a6dad33c08e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:39.988105 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d4a0c-dac3-450a-8b6f-7a6dad33c08e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:40.001146 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf4804-25b1-4183-ba2c-4f80d54ecded None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:40.002000 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 256/538] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:31:39 2022] GET /identity/v3/role_assignments?user.id=f12ce70a7c4f4396ab3fbb635dfc548b&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=e5b76a8345d542c2a899f8dbdd95290d => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:40.003165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d4a0c-dac3-450a-8b6f-7a6dad33c08e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:40.037172 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d271c15-5e3c-4071-a4b8-66c42fc4e577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:40.037172 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d271c15-5e3c-4071-a4b8-66c42fc4e577 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:40.037172 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d271c15-5e3c-4071-a4b8-66c42fc4e577 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:40.037172 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d271c15-5e3c-4071-a4b8-66c42fc4e577 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:40.037588 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d271c15-5e3c-4071-a4b8-66c42fc4e577 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:40.037588 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d271c15-5e3c-4071-a4b8-66c42fc4e577 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:40.039551 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d271c15-5e3c-4071-a4b8-66c42fc4e577 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:40.053214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 283/539] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:31:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:40.059436 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d271c15-5e3c-4071-a4b8-66c42fc4e577 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:40.131716 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:40.167014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d271c15-5e3c-4071-a4b8-66c42fc4e577 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:40.194939 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d4a0c-dac3-450a-8b6f-7a6dad33c08e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:40.207390 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c87cc-72db-44a7-bd9b-79a0da988b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:40.208011 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c87cc-72db-44a7-bd9b-79a0da988b7f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:40.208294 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c87cc-72db-44a7-bd9b-79a0da988b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:40.208570 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c87cc-72db-44a7-bd9b-79a0da988b7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:40.209336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c87cc-72db-44a7-bd9b-79a0da988b7f None admin] RBAC: Adding query filter params (role.id=e5b76a8345d542c2a899f8dbdd95290d, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=50ec251be76543b4ad97442664db6858) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:40.209648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c87cc-72db-44a7-bd9b-79a0da988b7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:40.211638 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c87cc-72db-44a7-bd9b-79a0da988b7f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:40.213638 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:40.220104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 284/540] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:31:40 2022] GET /identity/v3/role_assignments?user.id=50ec251be76543b4ad97442664db6858&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=e5b76a8345d542c2a899f8dbdd95290d => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:31:40.265673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d46c27-e436-4ddc-bf20-7e85cbd14de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:40.266715 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d46c27-e436-4ddc-bf20-7e85cbd14de3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:40.267244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d46c27-e436-4ddc-bf20-7e85cbd14de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:40.267728 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d46c27-e436-4ddc-bf20-7e85cbd14de3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:40.268678 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d46c27-e436-4ddc-bf20-7e85cbd14de3 None admin] RBAC: Adding query filter params (role.id=e5b76a8345d542c2a899f8dbdd95290d, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=a8e11feaab0c4d29b78b2e9273e5d2ce) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:40.269256 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d46c27-e436-4ddc-bf20-7e85cbd14de3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:40.270992 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d46c27-e436-4ddc-bf20-7e85cbd14de3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:40.278148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 257/541] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:31:40 2022] GET /identity/v3/role_assignments?user.id=a8e11feaab0c4d29b78b2e9273e5d2ce&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=e5b76a8345d542c2a899f8dbdd95290d => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:40.729805 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e76c2b-2b7a-4c63-b4b8-4278b1ab36d2 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:40.730180 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e76c2b-2b7a-4c63-b4b8-4278b1ab36d2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:40.730374 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e76c2b-2b7a-4c63-b4b8-4278b1ab36d2 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:40.731948 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 285/542] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:40.737670 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30394927-16f9-40c7-9c36-8b9a65020ba9 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:40.737957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30394927-16f9-40c7-9c36-8b9a65020ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:40.738227 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30394927-16f9-40c7-9c36-8b9a65020ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:40.757537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-30394927-16f9-40c7-9c36-8b9a65020ba9 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:40.758769 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-30394927-16f9-40c7-9c36-8b9a65020ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:40.844058 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 258/543] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:31:41.186442 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e76c2b-2b7a-4c63-b4b8-4278b1ab36d2 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:41.310441 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e76c2b-2b7a-4c63-b4b8-4278b1ab36d2 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:41.348770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00830354-0327-43c4-b5d1-fab412870376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:41.349454 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00830354-0327-43c4-b5d1-fab412870376 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:41.349736 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00830354-0327-43c4-b5d1-fab412870376 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:41.350011 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00830354-0327-43c4-b5d1-fab412870376 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:41.363852 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00830354-0327-43c4-b5d1-fab412870376 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:41.369302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-00830354-0327-43c4-b5d1-fab412870376 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:41.369302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:41.369302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:41.369302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:41.369302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:41.369302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:41.369302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:41.369302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:41.369302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:41.369302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:41.369302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:41.369302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:41.369302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:41.369302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:41.369302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:41.369302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:41.370227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:41.370227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:41.370227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:41.370227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:41.370227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:41.370227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:41.370227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:41.370227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:41.370227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:41.370227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:41.370227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:41.370227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:41.370227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:41.370227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:41.370227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:41.370227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:41.371012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:41.371012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:41.371012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:41.371012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:41.371012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:41.371012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:41.371012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:41.371012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:41.371012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:41.371012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:41.371012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:41.371012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:41.371012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 286/544] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:31:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:41.377599 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30394927-16f9-40c7-9c36-8b9a65020ba9 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:41.459459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:41.518024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30394927-16f9-40c7-9c36-8b9a65020ba9 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:41.575023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c5d02-2c37-4ceb-8f62-6019932bec65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:41.576424 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c5d02-2c37-4ceb-8f62-6019932bec65 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:41.577197 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c5d02-2c37-4ceb-8f62-6019932bec65 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:41.577656 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c5d02-2c37-4ceb-8f62-6019932bec65 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:41.578472 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c5d02-2c37-4ceb-8f62-6019932bec65 None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:41.578921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c5d02-2c37-4ceb-8f62-6019932bec65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:41.580455 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c5d02-2c37-4ceb-8f62-6019932bec65 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:41.592679 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 259/545] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 15 00:31:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:41.598542 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00830354-0327-43c4-b5d1-fab412870376 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:41.674053 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:41.722791 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00830354-0327-43c4-b5d1-fab412870376 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:41.775692 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2efe8b-5544-404e-84d5-09035ec9bfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:41.776319 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2efe8b-5544-404e-84d5-09035ec9bfab None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:41.776594 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2efe8b-5544-404e-84d5-09035ec9bfab None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:41.776862 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2efe8b-5544-404e-84d5-09035ec9bfab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:41.793407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2efe8b-5544-404e-84d5-09035ec9bfab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:41.794856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2efe8b-5544-404e-84d5-09035ec9bfab None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:41.813311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-dd2efe8b-5544-404e-84d5-09035ec9bfab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:41.813311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:41.813311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:41.813311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:41.813311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:41.813311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:41.813311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:41.813311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:41.813311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:41.813311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:41.813311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:41.813311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:41.813311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:41.813311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:41.813311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:41.813311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:41.814218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:41.814218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:41.814218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:41.814218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:41.814218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:41.814218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:41.814218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:41.814218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:41.814218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:41.814218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:41.814218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:41.814218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:41.814218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:41.814218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:41.814218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:41.814218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:41.814218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:41.815075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:41.815075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:41.815075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:41.815075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 287/546] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:41.822006 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c5d02-2c37-4ceb-8f62-6019932bec65 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:42.036036 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c5d02-2c37-4ceb-8f62-6019932bec65 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:42.087180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167bb3d-8ddb-42be-a163-5d98cb29d7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:42.087789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167bb3d-8ddb-42be-a163-5d98cb29d7cd None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:42.088075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167bb3d-8ddb-42be-a163-5d98cb29d7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:42.088354 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167bb3d-8ddb-42be-a163-5d98cb29d7cd None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:42.089001 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167bb3d-8ddb-42be-a163-5d98cb29d7cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:42.089350 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167bb3d-8ddb-42be-a163-5d98cb29d7cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:42.090796 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167bb3d-8ddb-42be-a163-5d98cb29d7cd None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:42.097401 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:42.111381 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248dc50-4f93-48a3-bf50-dd4b6526a7d0 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:42.111658 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248dc50-4f93-48a3-bf50-dd4b6526a7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:42.111925 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248dc50-4f93-48a3-bf50-dd4b6526a7d0 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:42.114520 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 260/548] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:42.114642 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 288/548] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:42.120641 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167bb3d-8ddb-42be-a163-5d98cb29d7cd None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:42.127069 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cd34a-bc89-45ea-bbca-ff894d0a34a1 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:42.127354 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cd34a-bc89-45ea-bbca-ff894d0a34a1 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:42.127629 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cd34a-bc89-45ea-bbca-ff894d0a34a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:42.169369 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-917cd34a-bc89-45ea-bbca-ff894d0a34a1 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:42.170553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-917cd34a-bc89-45ea-bbca-ff894d0a34a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:42.271056 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167bb3d-8ddb-42be-a163-5d98cb29d7cd None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:42.291011 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 289/549] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:31:42.323009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c32d2b-0ba1-4548-8f24-b16cb030045d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:42.323009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c32d2b-0ba1-4548-8f24-b16cb030045d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:42.323289 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c32d2b-0ba1-4548-8f24-b16cb030045d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:42.325014 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c32d2b-0ba1-4548-8f24-b16cb030045d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:42.338181 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c32d2b-0ba1-4548-8f24-b16cb030045d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:42.340055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c32d2b-0ba1-4548-8f24-b16cb030045d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:42.362812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-47c32d2b-0ba1-4548-8f24-b16cb030045d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 00:31:42.362812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:42.362812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:42.362812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:42.362812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:42.362812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:42.362812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:42.362812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:42.362812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:42.362812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:42.362812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:42.362812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:42.362812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:31:42.362812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:31:42.362812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:31:42.362812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:31:42.364357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:42.364357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:42.364357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:31:42.364357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:42.364357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:31:42.364357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:42.364357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:42.364357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:42.364357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:42.364357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:42.364357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:42.364357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:42.364357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:42.364357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:42.364357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:42.364357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:42.364357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:42.364357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:42.365356 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:42.365356 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:42.365356 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:31:42.365356 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:31:42.365356 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:31:42.365356 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:31:42.365356 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:31:42.365356 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:31:42.365356 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 00:31:42.365356 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:42.367760 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 261/550] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:31:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:31:42.373305 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cd34a-bc89-45ea-bbca-ff894d0a34a1 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:42.443059 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:42.522766 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cd34a-bc89-45ea-bbca-ff894d0a34a1 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:42.571428 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a95b3a-e7ec-4379-9b67-8dacf0a0aef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:42.572042 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a95b3a-e7ec-4379-9b67-8dacf0a0aef4 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:42.572318 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a95b3a-e7ec-4379-9b67-8dacf0a0aef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:42.572592 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a95b3a-e7ec-4379-9b67-8dacf0a0aef4 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:42.573340 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a95b3a-e7ec-4379-9b67-8dacf0a0aef4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:42.573642 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a95b3a-e7ec-4379-9b67-8dacf0a0aef4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:42.575063 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a95b3a-e7ec-4379-9b67-8dacf0a0aef4 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:42.624805 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 290/551] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Sep 15 00:31:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:42.630326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c32d2b-0ba1-4548-8f24-b16cb030045d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:42.687243 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:42.766427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c32d2b-0ba1-4548-8f24-b16cb030045d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:42.813977 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d632060-867c-4a28-a2b6-9b12b62930b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:42.814590 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d632060-867c-4a28-a2b6-9b12b62930b5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:42.814866 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d632060-867c-4a28-a2b6-9b12b62930b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:42.815134 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d632060-867c-4a28-a2b6-9b12b62930b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:42.825492 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4616f1-3148-46ca-9843-99a8946fec4c None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:42.825681 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4616f1-3148-46ca-9843-99a8946fec4c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:42.825982 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4616f1-3148-46ca-9843-99a8946fec4c None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:42.827301 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 291/552] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:31:42.833794 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44bd6a-4fc1-4a8d-bad7-6f39ef4a9fc1 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:42.833794 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44bd6a-4fc1-4a8d-bad7-6f39ef4a9fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:42.833794 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44bd6a-4fc1-4a8d-bad7-6f39ef4a9fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:42.860076 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-9d44bd6a-4fc1-4a8d-bad7-6f39ef4a9fc1 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:42.861938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9d44bd6a-4fc1-4a8d-bad7-6f39ef4a9fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:42.911216 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d632060-867c-4a28-a2b6-9b12b62930b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:42.912768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d632060-867c-4a28-a2b6-9b12b62930b5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:42.949777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 292/553] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:31:42.951110 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44bd6a-4fc1-4a8d-bad7-6f39ef4a9fc1 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:42.968014 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:42.986768 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:43.044167 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 262/554] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:31:43.045948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faa235-990c-474b-a6a6-69ee6f8f240f None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:43.046431 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faa235-990c-474b-a6a6-69ee6f8f240f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:43.046707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faa235-990c-474b-a6a6-69ee6f8f240f None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:43.048282 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 263/555] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:43.048820 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0faa235-990c-474b-a6a6-69ee6f8f240f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:43.074325 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44bd6a-4fc1-4a8d-bad7-6f39ef4a9fc1 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:43.110685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22195876-f763-43b9-a0c6-d844dd5ad6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:43.111504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22195876-f763-43b9-a0c6-d844dd5ad6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:43.111935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22195876-f763-43b9-a0c6-d844dd5ad6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:43.112203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22195876-f763-43b9-a0c6-d844dd5ad6f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:43.122236 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22195876-f763-43b9-a0c6-d844dd5ad6f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:43.126964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-22195876-f763-43b9-a0c6-d844dd5ad6f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:43.126964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:43.126964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:43.126964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:43.126964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:43.126964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:43.126964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:43.126964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:43.126964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:43.126964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:43.126964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:43.126964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:43.126964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:43.126964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:43.126964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:43.126964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:43.127848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:43.127848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:43.127848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:43.127848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:43.127848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:43.127848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:43.127848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:43.127848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:43.127848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:43.127848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:43.127848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:43.127848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:43.127848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:43.127848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:43.127848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:43.127848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:43.128676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:43.128676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:43.128676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:43.128676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:43.128676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:43.128676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:43.128676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:43.128676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:43.128676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:43.128676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:43.128676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:43.128676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:43.128676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 293/556] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:31:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:43.129843 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf2d5c-8d4e-4425-8599-841c1f109675 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:43.129843 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf2d5c-8d4e-4425-8599-841c1f109675 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:43.130165 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf2d5c-8d4e-4425-8599-841c1f109675 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:43.131481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 294/557] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:43.132371 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877846a5-3198-4870-ab23-22def7a4b4e6 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:43.133568 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877846a5-3198-4870-ab23-22def7a4b4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:43.133837 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877846a5-3198-4870-ab23-22def7a4b4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:43.152301 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-877846a5-3198-4870-ab23-22def7a4b4e6 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:43.153504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-877846a5-3198-4870-ab23-22def7a4b4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:43.165202 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0faa235-990c-474b-a6a6-69ee6f8f240f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:43.200616 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c734ad-bf53-4137-9106-9b726a231894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:43.201270 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c734ad-bf53-4137-9106-9b726a231894 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:43.201550 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c734ad-bf53-4137-9106-9b726a231894 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:43.201813 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c734ad-bf53-4137-9106-9b726a231894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:43.212261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c734ad-bf53-4137-9106-9b726a231894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:43.213733 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c734ad-bf53-4137-9106-9b726a231894 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:43.215565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:43.229878 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 295/558] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:43.229878 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877846a5-3198-4870-ab23-22def7a4b4e6 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:43.230125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-46c734ad-bf53-4137-9106-9b726a231894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:43.230125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:43.230125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:43.230125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:43.230125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:43.230125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:43.230125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:43.230125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:43.230125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:43.230125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:43.230125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:43.230125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:43.230125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:43.230125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:43.230125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:43.230125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:43.231193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:43.231193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:43.231193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:43.231193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:43.231193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:43.231193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:43.231193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:43.231193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:43.231193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:43.231193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:43.231193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:43.231193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:43.231193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:43.231193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:43.231193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:43.231193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:43.231193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:43.232255 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:43.232255 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:43.232255 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:43.237135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 264/559] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:43.237135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d469417-b847-4e9e-903d-ddc234db0c82 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:43.237135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d469417-b847-4e9e-903d-ddc234db0c82 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:43.237135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d469417-b847-4e9e-903d-ddc234db0c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:43.253773 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:43.256886 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2d469417-b847-4e9e-903d-ddc234db0c82 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:43.258696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2d469417-b847-4e9e-903d-ddc234db0c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:43.328842 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 265/560] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:43.329957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d469417-b847-4e9e-903d-ddc234db0c82 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:43.354339 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877846a5-3198-4870-ab23-22def7a4b4e6 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:43.396576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe238d-557a-41ba-972e-a8fd1cef0158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:43.397653 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe238d-557a-41ba-972e-a8fd1cef0158 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:43.398113 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe238d-557a-41ba-972e-a8fd1cef0158 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:43.399201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe238d-557a-41ba-972e-a8fd1cef0158 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:43.400027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe238d-557a-41ba-972e-a8fd1cef0158 None admin] RBAC: Adding query filter params (name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:43.400502 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe238d-557a-41ba-972e-a8fd1cef0158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:43.402054 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe238d-557a-41ba-972e-a8fd1cef0158 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:43.413229 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 296/561] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 15 00:31:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:43.414984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe238d-557a-41ba-972e-a8fd1cef0158 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:43.436521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d469417-b847-4e9e-903d-ddc234db0c82 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:43.462690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:43.474746 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2732d-be8e-4ebe-8fd9-bd5428fa2eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:43.475479 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2732d-be8e-4ebe-8fd9-bd5428fa2eac None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:43.475827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2732d-be8e-4ebe-8fd9-bd5428fa2eac None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:43.476215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2732d-be8e-4ebe-8fd9-bd5428fa2eac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:43.487572 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2732d-be8e-4ebe-8fd9-bd5428fa2eac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:43.493123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-31c2732d-be8e-4ebe-8fd9-bd5428fa2eac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:43.493123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:43.493123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:43.493123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:43.493123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:43.493123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:43.493123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:43.493123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:43.493123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:43.493123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:43.493123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:43.493123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:43.493123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:43.493123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:43.493123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:43.493123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:43.494037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:43.494037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:43.494037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:43.494037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:43.494037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:43.494037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:43.494037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:43.494037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:43.494037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:43.494037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:43.494037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:43.494037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:43.494037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:43.494037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:43.494037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:43.494037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:43.494865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:43.494865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:43.494865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:43.494865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:43.494865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:43.494865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:43.494865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:43.494865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:43.494865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:43.494865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:43.494865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:43.494865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:43.494865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 266/562] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:31:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:43.495628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2732d-be8e-4ebe-8fd9-bd5428fa2eac None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:43.518350 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:43.543462 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe238d-557a-41ba-972e-a8fd1cef0158 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:43.584140 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9a12b-c249-456e-b7ea-16072397c97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:43.584743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9a12b-c249-456e-b7ea-16072397c97a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:43.585183 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9a12b-c249-456e-b7ea-16072397c97a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:43.585452 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9a12b-c249-456e-b7ea-16072397c97a None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:43.586117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9a12b-c249-456e-b7ea-16072397c97a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:43.586419 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9a12b-c249-456e-b7ea-16072397c97a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:43.587769 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9a12b-c249-456e-b7ea-16072397c97a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:43.597524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2732d-be8e-4ebe-8fd9-bd5428fa2eac None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:43.606955 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 297/563] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:43.606955 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9a12b-c249-456e-b7ea-16072397c97a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:43.634339 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793d187-3f44-4408-a3bf-fc871eb32ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:43.634961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793d187-3f44-4408-a3bf-fc871eb32ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:43.635233 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793d187-3f44-4408-a3bf-fc871eb32ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:43.635513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793d187-3f44-4408-a3bf-fc871eb32ad9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:43.645298 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793d187-3f44-4408-a3bf-fc871eb32ad9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:43.646844 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793d187-3f44-4408-a3bf-fc871eb32ad9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:43.660984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-1793d187-3f44-4408-a3bf-fc871eb32ad9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:43.660984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:43.660984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:43.660984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:43.660984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:43.660984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:43.660984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:43.660984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:43.660984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:43.660984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:43.660984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:43.660984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:43.660984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:43.660984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:43.660984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:43.660984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:43.662023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:43.662023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:43.662023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:43.662023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:43.662023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:43.662023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:43.662023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:43.662023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:43.662023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:43.662023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:43.662023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:43.662023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:43.662023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:43.662023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:43.662023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:43.662023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:43.662023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:43.662927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:43.662927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:43.662927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:43.665218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 267/564] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:43.666236 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793d187-3f44-4408-a3bf-fc871eb32ad9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:43.700328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:43.707655 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9a12b-c249-456e-b7ea-16072397c97a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:43.740742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad44b8d-aec5-4cd9-b93b-fe4ee5a95d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:43.741361 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad44b8d-aec5-4cd9-b93b-fe4ee5a95d91 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:43.741635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad44b8d-aec5-4cd9-b93b-fe4ee5a95d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:43.741995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad44b8d-aec5-4cd9-b93b-fe4ee5a95d91 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:43.743147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad44b8d-aec5-4cd9-b93b-fe4ee5a95d91 None admin] RBAC: Adding query filter params (name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:43.743448 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad44b8d-aec5-4cd9-b93b-fe4ee5a95d91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:43.744792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad44b8d-aec5-4cd9-b93b-fe4ee5a95d91 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:43.752420 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 298/565] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 15 00:31:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:43.753207 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad44b8d-aec5-4cd9-b93b-fe4ee5a95d91 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:43.755799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:43.764188 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793d187-3f44-4408-a3bf-fc871eb32ad9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:43.797288 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848cae0-1c52-470b-a9c4-bc8613ccd7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:43.797902 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848cae0-1c52-470b-a9c4-bc8613ccd7d6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:43.798179 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848cae0-1c52-470b-a9c4-bc8613ccd7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:43.798448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848cae0-1c52-470b-a9c4-bc8613ccd7d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:43.809221 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848cae0-1c52-470b-a9c4-bc8613ccd7d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:43.814747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-3848cae0-1c52-470b-a9c4-bc8613ccd7d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:43.814747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:43.814747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:43.814747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:43.814747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:43.814747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:43.814747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:43.814747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:43.814747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:43.814747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:43.814747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:43.814747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:43.814747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:43.814747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:43.814747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:43.814747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:43.815660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:43.815660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:43.815660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:43.815660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:43.815660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:43.815660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:43.815660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:43.815660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:43.815660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:43.815660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:43.815660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:43.815660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:43.815660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:43.815660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:43.815660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:43.815660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:43.816521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:43.816521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:43.816521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:43.816521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:43.816521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:43.816521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:43.816521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:43.816521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:43.816521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:43.816521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:43.816521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:43.816521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:43.816521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 268/566] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:31:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:43.817226 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848cae0-1c52-470b-a9c4-bc8613ccd7d6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:43.856934 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad44b8d-aec5-4cd9-b93b-fe4ee5a95d91 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:43.889650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b12484-35f2-4efa-80fe-6c75682af507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:43.890264 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b12484-35f2-4efa-80fe-6c75682af507 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:43.890538 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b12484-35f2-4efa-80fe-6c75682af507 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:43.890805 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b12484-35f2-4efa-80fe-6c75682af507 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:43.897383 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b12484-35f2-4efa-80fe-6c75682af507 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:43.898747 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b12484-35f2-4efa-80fe-6c75682af507 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:43.908383 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:43.910416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-19b12484-35f2-4efa-80fe-6c75682af507 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:43.910416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:43.910416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:43.910416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:43.910416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:43.910416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:43.910416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:43.910416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:43.910416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:43.910416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:43.910416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:43.910416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:43.910416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:31:43.910416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:31:43.910416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:31:43.911297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:31:43.911297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:43.911297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:43.911297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:43.911297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:43.911297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:43.911297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:43.911297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:43.911297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:43.911297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:43.911297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:43.911297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:43.911297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:43.911297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:43.911297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:43.911297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:43.911297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:43.912178 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:31:43.912178 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:31:43.912178 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:31:43.912178 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:31:43.912178 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:31:43.912178 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:31:43.912178 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:43.912178 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:43.912178 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 299/567] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:43.912178 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b12484-35f2-4efa-80fe-6c75682af507 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:43.914785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848cae0-1c52-470b-a9c4-bc8613ccd7d6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:43.950344 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298106f-78c5-405f-ba1e-bab9d1108c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:43.950964 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298106f-78c5-405f-ba1e-bab9d1108c9d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:43.951240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298106f-78c5-405f-ba1e-bab9d1108c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:43.951506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298106f-78c5-405f-ba1e-bab9d1108c9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:43.961812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298106f-78c5-405f-ba1e-bab9d1108c9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:43.967015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-6298106f-78c5-405f-ba1e-bab9d1108c9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:43.967015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:43.967015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:43.967015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:43.967015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:43.967015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:43.967015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:43.967015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:43.967015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:43.967015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:43.967015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:43.967015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:43.967015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:43.967015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:43.967015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:43.967015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:43.967918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:43.967918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:43.967918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:43.967918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:43.967918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:43.967918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:43.967918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:43.967918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:43.967918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:43.967918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:43.967918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:43.967918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:43.967918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:43.967918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:43.967918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:43.967918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:43.968757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:43.968757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:43.968757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:43.968757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:43.968757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:43.968757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:43.968757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:43.968757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:43.968757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:43.968757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:43.968757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:43.968757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:43.972967 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 269/568] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:31:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:43.973801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298106f-78c5-405f-ba1e-bab9d1108c9d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:43.977646 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:44.016894 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b12484-35f2-4efa-80fe-6c75682af507 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:44.050951 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918c641-12ae-42aa-baf0-c00794c40208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:44.051546 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918c641-12ae-42aa-baf0-c00794c40208 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:44.051821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918c641-12ae-42aa-baf0-c00794c40208 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:44.052084 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918c641-12ae-42aa-baf0-c00794c40208 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:44.052711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918c641-12ae-42aa-baf0-c00794c40208 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:44.053040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918c641-12ae-42aa-baf0-c00794c40208 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:44.054389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918c641-12ae-42aa-baf0-c00794c40208 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:44.066119 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 300/569] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:44.066716 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918c641-12ae-42aa-baf0-c00794c40208 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:44.071150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298106f-78c5-405f-ba1e-bab9d1108c9d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:44.105230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9b08c-e37a-44bc-998f-72af324ce3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:44.105835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9b08c-e37a-44bc-998f-72af324ce3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:44.106108 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9b08c-e37a-44bc-998f-72af324ce3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:44.106373 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9b08c-e37a-44bc-998f-72af324ce3e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:44.116577 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9b08c-e37a-44bc-998f-72af324ce3e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:44.118084 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9b08c-e37a-44bc-998f-72af324ce3e3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:44.131789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-bde9b08c-e37a-44bc-998f-72af324ce3e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:44.131789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:44.131789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:44.131789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:44.131789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:44.131789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:44.131789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:44.131789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:44.131789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:44.131789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:44.131789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:44.131789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:44.131789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:44.131789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:44.131789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:44.131789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:44.132927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:44.132927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:44.132927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:44.132927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:44.132927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:44.132927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:44.132927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:44.132927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:44.132927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:44.132927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:44.132927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:44.132927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:44.132927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:44.132927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:44.132927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:44.132927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:44.132927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:44.133987 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:44.133987 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:44.133987 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:44.133987 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 270/570] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:44.137928 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9b08c-e37a-44bc-998f-72af324ce3e3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:44.148773 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:44.164773 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918c641-12ae-42aa-baf0-c00794c40208 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:44.186629 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:44.199057 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214fa78f-277c-47d5-8d81-8ecdeb1afa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:44.199731 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fa78f-277c-47d5-8d81-8ecdeb1afa52 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:44.200010 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fa78f-277c-47d5-8d81-8ecdeb1afa52 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:44.200284 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fa78f-277c-47d5-8d81-8ecdeb1afa52 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:44.200946 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214fa78f-277c-47d5-8d81-8ecdeb1afa52 None admin] RBAC: Adding query filter params (name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:44.201289 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214fa78f-277c-47d5-8d81-8ecdeb1afa52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:44.202641 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214fa78f-277c-47d5-8d81-8ecdeb1afa52 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:44.210373 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 301/571] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 15 00:31:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:44.211669 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214fa78f-277c-47d5-8d81-8ecdeb1afa52 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:44.238196 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9b08c-e37a-44bc-998f-72af324ce3e3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:44.270209 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74679de-8f2b-4cf7-bb6a-d4f679ec455a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:44.270802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74679de-8f2b-4cf7-bb6a-d4f679ec455a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:44.271181 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74679de-8f2b-4cf7-bb6a-d4f679ec455a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:44.271347 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74679de-8f2b-4cf7-bb6a-d4f679ec455a None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:44.272042 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74679de-8f2b-4cf7-bb6a-d4f679ec455a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:44.272348 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74679de-8f2b-4cf7-bb6a-d4f679ec455a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:44.274350 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74679de-8f2b-4cf7-bb6a-d4f679ec455a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:44.293420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 271/572] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:31:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:44.294424 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74679de-8f2b-4cf7-bb6a-d4f679ec455a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:44.310269 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214fa78f-277c-47d5-8d81-8ecdeb1afa52 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:44.345531 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9250d-e965-40f9-b1ab-66183580f3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:44.346140 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9250d-e965-40f9-b1ab-66183580f3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:44.346421 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9250d-e965-40f9-b1ab-66183580f3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:44.346696 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9250d-e965-40f9-b1ab-66183580f3e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:44.347384 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9250d-e965-40f9-b1ab-66183580f3e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:44.347672 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9250d-e965-40f9-b1ab-66183580f3e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:44.349024 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9250d-e965-40f9-b1ab-66183580f3e2 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:44.360321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 302/573] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 15 00:31:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:44.361218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9250d-e965-40f9-b1ab-66183580f3e2 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:44.371362 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:44.405312 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74679de-8f2b-4cf7-bb6a-d4f679ec455a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:44.409896 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:44.440093 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce73ef9-71af-46f2-817b-8152c93a9c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:44.440735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce73ef9-71af-46f2-817b-8152c93a9c82 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:44.441010 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce73ef9-71af-46f2-817b-8152c93a9c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:44.441310 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce73ef9-71af-46f2-817b-8152c93a9c82 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:44.448570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce73ef9-71af-46f2-817b-8152c93a9c82 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:44.450029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce73ef9-71af-46f2-817b-8152c93a9c82 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:44.462203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-4ce73ef9-71af-46f2-817b-8152c93a9c82 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 00:31:44.462203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:44.462203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:44.462203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:44.462203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:44.462203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:44.462203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:44.462203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:44.462203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:44.462203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:44.462203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:44.462203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:44.462203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:31:44.462203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:31:44.462203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:31:44.462203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:31:44.463334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:44.463334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:44.463334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:31:44.463334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:44.463334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:31:44.463334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:44.463334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:44.463334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:44.463334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:44.463334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:44.463334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:44.463334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:44.463334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:44.463334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:44.463334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:44.463334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:44.463334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:44.463334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:44.464326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:44.464326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:44.464326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:31:44.464326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:31:44.464326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:31:44.464326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:31:44.464326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:31:44.464326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:31:44.464326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 00:31:44.464326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:44.464326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 272/574] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Sep 15 00:31:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:44.464938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9250d-e965-40f9-b1ab-66183580f3e2 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:44.465014 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce73ef9-71af-46f2-817b-8152c93a9c82 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:44.498180 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d54bdc-173e-4145-b5e7-acd5cae37ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:44.498881 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d54bdc-173e-4145-b5e7-acd5cae37ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:44.499157 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d54bdc-173e-4145-b5e7-acd5cae37ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:44.499422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d54bdc-173e-4145-b5e7-acd5cae37ac3 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:44.500050 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d54bdc-173e-4145-b5e7-acd5cae37ac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:44.500346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d54bdc-173e-4145-b5e7-acd5cae37ac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:44.501720 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d54bdc-173e-4145-b5e7-acd5cae37ac3 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:44.513455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 303/575] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:44.514219 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d54bdc-173e-4145-b5e7-acd5cae37ac3 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:44.568152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce73ef9-71af-46f2-817b-8152c93a9c82 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:44.593623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:44.601950 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d345e71-19b0-4610-823e-9bffc070b6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:44.602562 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d345e71-19b0-4610-823e-9bffc070b6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:44.602843 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d345e71-19b0-4610-823e-9bffc070b6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:44.603116 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d345e71-19b0-4610-823e-9bffc070b6e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:44.613711 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d345e71-19b0-4610-823e-9bffc070b6e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:44.613836 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d54bdc-173e-4145-b5e7-acd5cae37ac3 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:44.615150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d345e71-19b0-4610-823e-9bffc070b6e0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:44.621763 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:44.629388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-6d345e71-19b0-4610-823e-9bffc070b6e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:44.629388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:44.629388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:44.629388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:44.629388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:44.629388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:44.629388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:44.629388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:44.629388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:44.629388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:44.629388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:44.629388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:44.629388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:44.629388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:44.629388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:44.629388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:44.630531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:44.630531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:44.630531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:44.630531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:44.630531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:44.630531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:44.630531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:44.630531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:44.630531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:44.630531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:44.630531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:44.630531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:44.630531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:44.630531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:44.630531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:44.630531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:44.630531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:44.631585 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:44.631585 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:44.631585 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:44.631585 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 273/576] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:44.631585 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d345e71-19b0-4610-823e-9bffc070b6e0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:44.651911 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0ece2-677b-4186-96e5-02ba1ed70a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:44.652510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0ece2-677b-4186-96e5-02ba1ed70a93 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:44.652791 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0ece2-677b-4186-96e5-02ba1ed70a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:44.653063 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0ece2-677b-4186-96e5-02ba1ed70a93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:44.653812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0ece2-677b-4186-96e5-02ba1ed70a93 None admin] RBAC: Adding query filter params (role.id=e5b76a8345d542c2a899f8dbdd95290d, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=5fb248b85aba45b39132d0f92ede0b68) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:44.654120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0ece2-677b-4186-96e5-02ba1ed70a93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:44.655602 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0ece2-677b-4186-96e5-02ba1ed70a93 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:44.660822 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 304/577] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:31:44 2022] GET /identity/v3/role_assignments?user.id=5fb248b85aba45b39132d0f92ede0b68&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=e5b76a8345d542c2a899f8dbdd95290d => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:44.661609 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0ece2-677b-4186-96e5-02ba1ed70a93 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:44.743484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d345e71-19b0-4610-823e-9bffc070b6e0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:44.779594 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0ece2-677b-4186-96e5-02ba1ed70a93 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:44.779972 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a6c6a-0325-404d-8fe4-4191aaf22717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:44.780578 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a6c6a-0325-404d-8fe4-4191aaf22717 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:44.780858 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a6c6a-0325-404d-8fe4-4191aaf22717 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:44.781161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a6c6a-0325-404d-8fe4-4191aaf22717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:44.793559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a6c6a-0325-404d-8fe4-4191aaf22717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:44.795175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a6c6a-0325-404d-8fe4-4191aaf22717 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:44.812706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-3d4a6c6a-0325-404d-8fe4-4191aaf22717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:44.812706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:44.812706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:44.812706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:44.812706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:44.812706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:44.812706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:44.812706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:44.812706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:44.812706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:44.812706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:44.812706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:44.812706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:44.812706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:44.812706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:44.812706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:44.813983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:44.813983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:44.813983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:44.813983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:44.813983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:44.813983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:44.813983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:44.813983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:44.813983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:44.813983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:44.813983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:44.813983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:44.813983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:44.813983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:44.813983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:44.813983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:44.813983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:44.815132 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:44.815132 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:44.815132 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:44.815741 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 274/578] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:44.816615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a6c6a-0325-404d-8fe4-4191aaf22717 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:44.827283 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bcbbe-b6bf-4f2a-96ff-7b751b527d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:44.828024 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bcbbe-b6bf-4f2a-96ff-7b751b527d7e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:44.828354 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bcbbe-b6bf-4f2a-96ff-7b751b527d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:44.828631 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bcbbe-b6bf-4f2a-96ff-7b751b527d7e None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:44.830040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bcbbe-b6bf-4f2a-96ff-7b751b527d7e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:44.830355 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bcbbe-b6bf-4f2a-96ff-7b751b527d7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:44.832383 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bcbbe-b6bf-4f2a-96ff-7b751b527d7e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:44.851134 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 305/579] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Sep 15 00:31:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:44.851992 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bcbbe-b6bf-4f2a-96ff-7b751b527d7e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:44.856337 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:44.882173 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:44.933210 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a6c6a-0325-404d-8fe4-4191aaf22717 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:44.965622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bcbbe-b6bf-4f2a-96ff-7b751b527d7e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:44.966903 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d4385-311f-49ef-b132-42bd882240c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:44.967526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d4385-311f-49ef-b132-42bd882240c5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:44.967807 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d4385-311f-49ef-b132-42bd882240c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:44.968078 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d4385-311f-49ef-b132-42bd882240c5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:44.975640 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d4385-311f-49ef-b132-42bd882240c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:44.977763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d4385-311f-49ef-b132-42bd882240c5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:44.989702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-556d4385-311f-49ef-b132-42bd882240c5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 00:31:44.989702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:44.989702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:44.989702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:44.989702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:44.989702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:44.989702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:44.989702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:44.989702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:44.989702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:44.989702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:44.989702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:44.989702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:31:44.989702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:31:44.989702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:31:44.989702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:31:44.990649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:44.990649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:44.990649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:31:44.990649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:44.990649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:31:44.990649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:44.990649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:44.990649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:44.990649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:44.990649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:44.990649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:44.990649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:44.990649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:44.990649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:44.990649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:44.990649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:44.990649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:44.990649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:44.991561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:44.991561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:44.991561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:31:44.991561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:31:44.991561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:31:44.991561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:31:44.991561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:31:44.991561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:31:44.991561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 15 00:31:44.991561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:44.991561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 275/580] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:44.991561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d4385-311f-49ef-b132-42bd882240c5 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:45.007935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21794b8-4c48-4d7e-a608-89bf1a5b4134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:45.008786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21794b8-4c48-4d7e-a608-89bf1a5b4134 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:45.009063 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21794b8-4c48-4d7e-a608-89bf1a5b4134 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:45.009358 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21794b8-4c48-4d7e-a608-89bf1a5b4134 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:45.009992 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21794b8-4c48-4d7e-a608-89bf1a5b4134 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:45.010292 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21794b8-4c48-4d7e-a608-89bf1a5b4134 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:45.011705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21794b8-4c48-4d7e-a608-89bf1a5b4134 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:45.027049 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 306/581] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:45.027868 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21794b8-4c48-4d7e-a608-89bf1a5b4134 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:45.104774 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:45.116397 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d4385-311f-49ef-b132-42bd882240c5 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:45.123988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:45.137652 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21794b8-4c48-4d7e-a608-89bf1a5b4134 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:45.153546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91065d01-f460-4037-a3d8-cd445ae702fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:45.154148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91065d01-f460-4037-a3d8-cd445ae702fb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:45.154435 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91065d01-f460-4037-a3d8-cd445ae702fb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:45.154713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91065d01-f460-4037-a3d8-cd445ae702fb None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:45.155326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91065d01-f460-4037-a3d8-cd445ae702fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:45.155629 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91065d01-f460-4037-a3d8-cd445ae702fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:45.156994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91065d01-f460-4037-a3d8-cd445ae702fb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:45.172883 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 276/582] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:45.172883 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91065d01-f460-4037-a3d8-cd445ae702fb None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:45.179814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55f16c-8408-4bd6-9a30-51509709fc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:45.180433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55f16c-8408-4bd6-9a30-51509709fc75 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:45.180712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55f16c-8408-4bd6-9a30-51509709fc75 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:45.180980 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55f16c-8408-4bd6-9a30-51509709fc75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:45.192052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55f16c-8408-4bd6-9a30-51509709fc75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:45.193443 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55f16c-8408-4bd6-9a30-51509709fc75 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:45.208952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-ee55f16c-8408-4bd6-9a30-51509709fc75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:45.208952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:45.208952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:45.208952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:45.208952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:45.208952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:45.208952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:45.208952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:45.208952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:45.208952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:45.208952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:45.208952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:45.208952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:45.208952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:45.208952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:45.208952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:45.210087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:45.210087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:45.210087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:45.210087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:45.210087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:45.210087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:45.210087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:45.210087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:45.210087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:45.210087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:45.210087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:45.210087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:45.210087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:45.210087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:45.210087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:45.210087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:45.210087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:45.211550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:45.211550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:45.211550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:45.211550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 307/583] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:45.211550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55f16c-8408-4bd6-9a30-51509709fc75 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:45.273131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91065d01-f460-4037-a3d8-cd445ae702fb None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:45.308318 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dedd33-fcd6-4f82-a86d-49f54a1a6795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:45.309226 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dedd33-fcd6-4f82-a86d-49f54a1a6795 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:45.309610 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dedd33-fcd6-4f82-a86d-49f54a1a6795 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:45.309879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dedd33-fcd6-4f82-a86d-49f54a1a6795 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:45.310708 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dedd33-fcd6-4f82-a86d-49f54a1a6795 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:45.311014 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dedd33-fcd6-4f82-a86d-49f54a1a6795 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:45.312537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dedd33-fcd6-4f82-a86d-49f54a1a6795 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:45.319290 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55f16c-8408-4bd6-9a30-51509709fc75 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:45.338339 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 277/584] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Sep 15 00:31:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:45.338339 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dedd33-fcd6-4f82-a86d-49f54a1a6795 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:45.351114 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:45.364683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a930f81-2c96-46d3-9924-f0511ffdef89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:45.365423 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a930f81-2c96-46d3-9924-f0511ffdef89 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:45.365771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a930f81-2c96-46d3-9924-f0511ffdef89 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:45.366051 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a930f81-2c96-46d3-9924-f0511ffdef89 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:45.374438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a930f81-2c96-46d3-9924-f0511ffdef89 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:45.375875 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a930f81-2c96-46d3-9924-f0511ffdef89 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:45.378510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:45.389550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-8a930f81-2c96-46d3-9924-f0511ffdef89 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 00:31:45.389550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:45.389550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:45.389550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:45.389550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:45.389550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:45.389550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:45.389550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:45.389550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:45.389550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:45.389550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:45.389550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:45.389550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:31:45.389550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:31:45.389550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:31:45.389550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:31:45.390518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:45.390518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:45.390518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:31:45.390518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:45.390518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:31:45.390518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:45.390518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:45.390518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:45.390518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:45.390518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:45.390518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:45.390518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:45.390518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:45.390518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:45.390518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:45.390518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:45.390518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:45.390518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:45.391480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:45.391480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:45.391480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:31:45.391480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:31:45.391480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:31:45.391480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:31:45.391480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:31:45.391480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:31:45.391480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 00:31:45.391480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:45.391480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 308/585] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:45.391480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a930f81-2c96-46d3-9924-f0511ffdef89 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:45.447192 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dedd33-fcd6-4f82-a86d-49f54a1a6795 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:45.483423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab609cd-81f6-4f26-9bf2-0a91f76ac6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:45.484356 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab609cd-81f6-4f26-9bf2-0a91f76ac6fc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:45.484686 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab609cd-81f6-4f26-9bf2-0a91f76ac6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:45.484964 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab609cd-81f6-4f26-9bf2-0a91f76ac6fc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:45.492392 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab609cd-81f6-4f26-9bf2-0a91f76ac6fc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:45.493873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab609cd-81f6-4f26-9bf2-0a91f76ac6fc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:45.501389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a930f81-2c96-46d3-9924-f0511ffdef89 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:45.505878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-aab609cd-81f6-4f26-9bf2-0a91f76ac6fc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 00:31:45.505878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:45.505878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:45.505878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:45.505878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:45.505878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:45.505878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:45.505878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:45.505878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:45.505878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:45.505878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:45.505878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:45.505878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:31:45.505878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:31:45.505878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:31:45.505878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:31:45.506835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:45.506835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:45.506835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:31:45.506835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:45.506835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:31:45.506835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:45.506835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:45.506835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:45.506835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:45.506835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:45.506835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:45.506835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:45.506835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:45.506835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:45.506835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:45.506835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:45.506835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:45.506835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:45.508322 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:45.508322 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:45.508322 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:31:45.508322 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:31:45.508322 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:31:45.508322 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:31:45.508322 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:31:45.508322 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:31:45.508322 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 00:31:45.508322 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:45.508322 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 278/586] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:31:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:45.508920 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab609cd-81f6-4f26-9bf2-0a91f76ac6fc None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:45.543380 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b87ac4-18f7-44a6-bfc9-3ffd1e10849a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:45.544138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b87ac4-18f7-44a6-bfc9-3ffd1e10849a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:45.544428 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b87ac4-18f7-44a6-bfc9-3ffd1e10849a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:45.544996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b87ac4-18f7-44a6-bfc9-3ffd1e10849a None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:45.545715 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b87ac4-18f7-44a6-bfc9-3ffd1e10849a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:45.545980 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b87ac4-18f7-44a6-bfc9-3ffd1e10849a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:45.547326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b87ac4-18f7-44a6-bfc9-3ffd1e10849a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:45.560880 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 309/587] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:45.561949 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b87ac4-18f7-44a6-bfc9-3ffd1e10849a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:45.586757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:45.619228 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab609cd-81f6-4f26-9bf2-0a91f76ac6fc None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:45.627464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:45.652686 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61690b1c-4b11-47a0-9a15-044f2ef3bcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:45.653339 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61690b1c-4b11-47a0-9a15-044f2ef3bcaf None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:45.653616 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61690b1c-4b11-47a0-9a15-044f2ef3bcaf None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:45.653877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61690b1c-4b11-47a0-9a15-044f2ef3bcaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:45.664161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61690b1c-4b11-47a0-9a15-044f2ef3bcaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:45.665635 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61690b1c-4b11-47a0-9a15-044f2ef3bcaf None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:45.671464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b87ac4-18f7-44a6-bfc9-3ffd1e10849a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:45.680482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-61690b1c-4b11-47a0-9a15-044f2ef3bcaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:45.680482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:45.680482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:45.680482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:45.680482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:45.680482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:45.680482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:45.680482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:45.680482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:45.680482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:45.680482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:45.680482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:45.680482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:45.680482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:45.680482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:45.680482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:45.681466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:45.681466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:45.681466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:45.681466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:45.681466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:45.681466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:45.681466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:45.681466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:45.681466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:45.681466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:45.681466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:45.681466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:45.681466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:45.681466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:45.681466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:45.681466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:45.681466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:45.682388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:45.682388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:45.682388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:45.682388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 279/588] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:45.682700 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61690b1c-4b11-47a0-9a15-044f2ef3bcaf None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:45.714614 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5fbe5-945f-44a5-a1a5-c0fc5e96efd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:45.715138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5fbe5-945f-44a5-a1a5-c0fc5e96efd7 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:45.715421 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5fbe5-945f-44a5-a1a5-c0fc5e96efd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:45.715693 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5fbe5-945f-44a5-a1a5-c0fc5e96efd7 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:45.716410 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5fbe5-945f-44a5-a1a5-c0fc5e96efd7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:45.716714 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5fbe5-945f-44a5-a1a5-c0fc5e96efd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:45.718191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5fbe5-945f-44a5-a1a5-c0fc5e96efd7 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:45.735761 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 310/589] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Sep 15 00:31:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:45.736563 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5fbe5-945f-44a5-a1a5-c0fc5e96efd7 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:45.789307 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61690b1c-4b11-47a0-9a15-044f2ef3bcaf None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:45.812363 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:45.824445 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9fb6c-2f2b-403a-ae84-ca0dfe96d114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:45.825046 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9fb6c-2f2b-403a-ae84-ca0dfe96d114 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:45.825377 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9fb6c-2f2b-403a-ae84-ca0dfe96d114 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:45.825652 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9fb6c-2f2b-403a-ae84-ca0dfe96d114 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:45.826381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9fb6c-2f2b-403a-ae84-ca0dfe96d114 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:45.826678 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9fb6c-2f2b-403a-ae84-ca0dfe96d114 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:45.828104 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9fb6c-2f2b-403a-ae84-ca0dfe96d114 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:45.853412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 280/590] 10.222.0.52 () {56 vars in 1139 bytes} [Thu Sep 15 00:31:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:45.853412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9fb6c-2f2b-403a-ae84-ca0dfe96d114 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:45.860332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5fbe5-945f-44a5-a1a5-c0fc5e96efd7 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:45.879177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:45.900239 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905761bd-6a44-4723-b555-9313ebcafa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:45.900879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905761bd-6a44-4723-b555-9313ebcafa7d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:45.901190 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905761bd-6a44-4723-b555-9313ebcafa7d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:45.901465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905761bd-6a44-4723-b555-9313ebcafa7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:45.909067 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905761bd-6a44-4723-b555-9313ebcafa7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:45.910510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905761bd-6a44-4723-b555-9313ebcafa7d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:45.922329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-905761bd-6a44-4723-b555-9313ebcafa7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:45.922329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:45.922329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:45.922329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:45.922329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:45.922329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:45.922329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:45.922329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:45.922329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:45.922329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:45.922329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:45.922329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:45.922329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:31:45.922329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:31:45.922329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:31:45.923242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:31:45.923242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:45.923242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:45.923242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:45.923242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:45.923242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:45.923242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:45.923242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:45.923242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:45.923242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:45.923242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:45.923242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:45.923242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:45.923242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:45.923242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:45.923242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:45.923242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:45.924141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:31:45.924141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:31:45.924141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:31:45.924141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:31:45.924141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:31:45.924141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:31:45.924141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:45.924141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:45.924141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 311/591] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:45.924141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905761bd-6a44-4723-b555-9313ebcafa7d None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:45.969857 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9fb6c-2f2b-403a-ae84-ca0dfe96d114 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:46.005925 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8df577-78a7-4629-8310-2d8d23a43294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:46.006520 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8df577-78a7-4629-8310-2d8d23a43294 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:46.006795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8df577-78a7-4629-8310-2d8d23a43294 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:46.007306 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8df577-78a7-4629-8310-2d8d23a43294 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:46.007741 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8df577-78a7-4629-8310-2d8d23a43294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:46.008038 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8df577-78a7-4629-8310-2d8d23a43294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:46.009417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8df577-78a7-4629-8310-2d8d23a43294 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:46.020611 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 281/592] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:46.021337 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8df577-78a7-4629-8310-2d8d23a43294 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:46.037529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905761bd-6a44-4723-b555-9313ebcafa7d None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:46.065860 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:46.072814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de490d4-02ac-4a51-861f-aac28063a638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:46.073480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de490d4-02ac-4a51-861f-aac28063a638 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:46.073763 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de490d4-02ac-4a51-861f-aac28063a638 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:46.074037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de490d4-02ac-4a51-861f-aac28063a638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:46.084623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de490d4-02ac-4a51-861f-aac28063a638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:46.086114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de490d4-02ac-4a51-861f-aac28063a638 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:46.100734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-3de490d4-02ac-4a51-861f-aac28063a638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:46.100734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:46.100734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:46.100734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:46.100734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:46.100734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:46.100734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:46.100734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:46.100734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:46.100734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:46.100734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:46.100734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:46.100734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:46.100734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:46.100734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:46.100734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:46.102342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:46.102342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:46.102342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:46.102342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:46.102342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:46.102342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:46.102342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:46.102342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:46.102342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:46.102342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:46.102342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:46.102342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:46.102342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:46.102342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:46.102342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:46.102342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:46.102342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:46.103228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:46.103228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:46.103228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:46.107009 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 312/593] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:46.107654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de490d4-02ac-4a51-861f-aac28063a638 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:46.129395 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8df577-78a7-4629-8310-2d8d23a43294 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:46.140929 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:46.165382 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc869f-8579-48d2-bc04-48b30bf8a915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:46.166282 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc869f-8579-48d2-bc04-48b30bf8a915 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:46.166708 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc869f-8579-48d2-bc04-48b30bf8a915 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:46.167155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc869f-8579-48d2-bc04-48b30bf8a915 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:46.178315 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc869f-8579-48d2-bc04-48b30bf8a915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:46.180670 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc869f-8579-48d2-bc04-48b30bf8a915 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:46.196506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-45bc869f-8579-48d2-bc04-48b30bf8a915 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:46.196506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:46.196506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:46.196506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:46.196506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:46.196506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:46.196506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:46.196506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:46.196506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:46.196506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:46.196506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:46.196506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:46.196506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:46.196506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:46.196506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:46.196506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:46.197695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:46.197695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:46.197695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:46.197695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:46.197695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:46.197695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:46.197695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:46.197695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:46.197695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:46.197695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:46.197695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:46.197695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:46.197695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:46.197695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:46.197695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:46.197695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:46.197695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:46.198765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:46.198765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:46.198765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:46.200206 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 282/594] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:46.201145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc869f-8579-48d2-bc04-48b30bf8a915 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:46.218867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de490d4-02ac-4a51-861f-aac28063a638 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:46.256289 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cb1f4-1c03-452a-bebc-844cc95d70b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:46.256839 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cb1f4-1c03-452a-bebc-844cc95d70b2 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:46.257145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cb1f4-1c03-452a-bebc-844cc95d70b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:46.257510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cb1f4-1c03-452a-bebc-844cc95d70b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:46.258698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cb1f4-1c03-452a-bebc-844cc95d70b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:46.259004 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cb1f4-1c03-452a-bebc-844cc95d70b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:46.260520 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cb1f4-1c03-452a-bebc-844cc95d70b2 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:46.273916 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 313/595] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:31:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:46.274722 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cb1f4-1c03-452a-bebc-844cc95d70b2 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:46.306336 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:46.316144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc869f-8579-48d2-bc04-48b30bf8a915 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:46.357676 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9ca7c-1059-414a-b71c-95c24862faa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:46.358067 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9ca7c-1059-414a-b71c-95c24862faa0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:46.358340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9ca7c-1059-414a-b71c-95c24862faa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:46.358609 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9ca7c-1059-414a-b71c-95c24862faa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:46.365933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9ca7c-1059-414a-b71c-95c24862faa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:46.367958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9ca7c-1059-414a-b71c-95c24862faa0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:46.375306 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:46.379982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-33e9ca7c-1059-414a-b71c-95c24862faa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:46.379982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:46.379982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:46.379982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:46.379982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:46.379982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:46.379982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:46.379982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:46.379982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:46.379982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:46.379982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:46.379982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:46.379982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:31:46.379982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:31:46.379982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:31:46.381026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:31:46.381026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:46.381026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:46.381026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:46.381026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:46.381026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:46.381026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:46.381026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:46.381026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:46.381026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:46.381026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:46.381026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:46.381026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:46.381026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:46.381026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:46.381026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:46.381026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:46.382091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:31:46.382091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:31:46.382091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:31:46.382091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:31:46.382091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:31:46.382091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:31:46.382091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:46.382091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:46.382091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 283/596] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:46.382091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9ca7c-1059-414a-b71c-95c24862faa0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:46.391804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cb1f4-1c03-452a-bebc-844cc95d70b2 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:46.427535 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70ceb1-e833-499a-9e56-9ac9f86cd01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:46.428136 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70ceb1-e833-499a-9e56-9ac9f86cd01b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:46.428578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70ceb1-e833-499a-9e56-9ac9f86cd01b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:46.428685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70ceb1-e833-499a-9e56-9ac9f86cd01b None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:46.429901 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70ceb1-e833-499a-9e56-9ac9f86cd01b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:46.430197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70ceb1-e833-499a-9e56-9ac9f86cd01b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:46.431553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70ceb1-e833-499a-9e56-9ac9f86cd01b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:46.442892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 314/597] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:46.443592 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70ceb1-e833-499a-9e56-9ac9f86cd01b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:46.493994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9ca7c-1059-414a-b71c-95c24862faa0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:46.529361 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a1857-a279-4da1-85e7-c55e872256bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:46.529877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a1857-a279-4da1-85e7-c55e872256bf None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:46.530155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a1857-a279-4da1-85e7-c55e872256bf None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:46.530416 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a1857-a279-4da1-85e7-c55e872256bf None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:46.531050 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a1857-a279-4da1-85e7-c55e872256bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:46.531350 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a1857-a279-4da1-85e7-c55e872256bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:46.533122 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a1857-a279-4da1-85e7-c55e872256bf None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:46.545304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 284/598] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:46.545995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a1857-a279-4da1-85e7-c55e872256bf None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:46.557345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70ceb1-e833-499a-9e56-9ac9f86cd01b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:46.560747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:46.595681 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462acbb6-cff3-457b-89fb-f1fd6465b1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:46.596414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462acbb6-cff3-457b-89fb-f1fd6465b1f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:46.596755 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462acbb6-cff3-457b-89fb-f1fd6465b1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:46.597112 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462acbb6-cff3-457b-89fb-f1fd6465b1f9 None admin] PATH_INFO: `/v3/projects/f25792dd210b42c4a3491096a735f909/users/bfcfcf8061f24231858b9b0205a8abaa/roles/e5b76a8345d542c2a899f8dbdd95290d` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:46.612480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462acbb6-cff3-457b-89fb-f1fd6465b1f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f25792dd210b42c4a3491096a735f909, user_id=bfcfcf8061f24231858b9b0205a8abaa, role_id=e5b76a8345d542c2a899f8dbdd95290d)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:46.613915 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462acbb6-cff3-457b-89fb-f1fd6465b1f9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:46.624256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:46.637212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 315/599] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:31:46 2022] PUT /identity/v3/projects/f25792dd210b42c4a3491096a735f909/users/bfcfcf8061f24231858b9b0205a8abaa/roles/e5b76a8345d542c2a899f8dbdd95290d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:31:46.638669 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462acbb6-cff3-457b-89fb-f1fd6465b1f9 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:46.650162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a1857-a279-4da1-85e7-c55e872256bf None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:46.702439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c4a00-7b0c-489b-ac25-1217f3ce4a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:46.703246 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c4a00-7b0c-489b-ac25-1217f3ce4a34 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:46.703682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c4a00-7b0c-489b-ac25-1217f3ce4a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:46.704061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c4a00-7b0c-489b-ac25-1217f3ce4a34 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:46.705820 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c4a00-7b0c-489b-ac25-1217f3ce4a34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:46.706305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c4a00-7b0c-489b-ac25-1217f3ce4a34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:46.708871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c4a00-7b0c-489b-ac25-1217f3ce4a34 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:46.728699 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 285/600] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:31:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:46.730211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c4a00-7b0c-489b-ac25-1217f3ce4a34 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:46.776270 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462acbb6-cff3-457b-89fb-f1fd6465b1f9 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:46.826582 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca9618-fd50-4fd7-b2be-aa035e4a553a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:46.827818 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca9618-fd50-4fd7-b2be-aa035e4a553a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:46.827818 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca9618-fd50-4fd7-b2be-aa035e4a553a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:46.827818 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca9618-fd50-4fd7-b2be-aa035e4a553a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:46.833938 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:46.835001 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca9618-fd50-4fd7-b2be-aa035e4a553a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:46.836690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca9618-fd50-4fd7-b2be-aa035e4a553a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:46.848732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-ffca9618-fd50-4fd7-b2be-aa035e4a553a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:46.848732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:46.848732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:46.848732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:46.848732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:46.848732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:46.848732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:46.848732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:46.848732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:46.848732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:46.848732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:46.848732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:46.848732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:31:46.848732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:31:46.848732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:31:46.849824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:31:46.849824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:46.849824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:46.849824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:46.849824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:46.849824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:46.849824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:46.849824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:46.849824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:46.849824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:46.849824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:46.849824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:46.849824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:46.849824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:46.849824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:46.849824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:46.849824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:46.850719 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:31:46.850719 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:31:46.850719 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:31:46.850719 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:31:46.850719 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:31:46.850719 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:31:46.850719 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:46.850719 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:46.850719 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 316/601] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:46.850719 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca9618-fd50-4fd7-b2be-aa035e4a553a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:46.870399 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c4a00-7b0c-489b-ac25-1217f3ce4a34 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:46.911432 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c834735-20ec-4a18-b0e0-cc74459c7892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:46.912214 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c834735-20ec-4a18-b0e0-cc74459c7892 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:46.912502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c834735-20ec-4a18-b0e0-cc74459c7892 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:46.912763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c834735-20ec-4a18-b0e0-cc74459c7892 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:46.915003 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:46.919713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c834735-20ec-4a18-b0e0-cc74459c7892 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:46.921199 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c834735-20ec-4a18-b0e0-cc74459c7892 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:46.932412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-5c834735-20ec-4a18-b0e0-cc74459c7892 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:46.932412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:46.932412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:46.932412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:46.932412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:46.932412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:46.932412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:46.932412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:46.932412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:46.932412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:46.932412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:46.932412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:46.932412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:31:46.932412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:31:46.932412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:31:46.933615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:31:46.933615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:46.933615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:46.933615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:46.933615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:46.933615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:46.933615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:46.933615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:46.933615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:46.933615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:46.933615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:46.933615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:46.933615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:46.933615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:46.933615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:46.933615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:46.933615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:46.935180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:31:46.935180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:31:46.935180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:31:46.935180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:31:46.935180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:31:46.935180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:31:46.935180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:46.935180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:46.935180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 286/602] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:46.936077 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5c9cd-a4b3-4905-8dc8-457840e8bb5b None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:46.936077 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5c9cd-a4b3-4905-8dc8-457840e8bb5b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:46.936077 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5c9cd-a4b3-4905-8dc8-457840e8bb5b None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:46.937574 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 287/603] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:46.940898 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5c9cd-a4b3-4905-8dc8-457840e8bb5b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:46.963727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca9618-fd50-4fd7-b2be-aa035e4a553a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:46.999413 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505666d0-94c4-4416-b7d3-803c6ad3241f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:47.000065 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505666d0-94c4-4416-b7d3-803c6ad3241f None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:47.000346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505666d0-94c4-4416-b7d3-803c6ad3241f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:47.000618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505666d0-94c4-4416-b7d3-803c6ad3241f None admin] PATH_INFO: `/v3/projects/f25792dd210b42c4a3491096a735f909/users/f12ce70a7c4f4396ab3fbb635dfc548b/roles/e5b76a8345d542c2a899f8dbdd95290d` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:47.016953 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505666d0-94c4-4416-b7d3-803c6ad3241f None admin] RBAC: Authorizing `identity:create_grant(project_id=f25792dd210b42c4a3491096a735f909, user_id=f12ce70a7c4f4396ab3fbb635dfc548b, role_id=e5b76a8345d542c2a899f8dbdd95290d)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:47.018512 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505666d0-94c4-4416-b7d3-803c6ad3241f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:47.035228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 317/604] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:31:46 2022] PUT /identity/v3/projects/f25792dd210b42c4a3491096a735f909/users/f12ce70a7c4f4396ab3fbb635dfc548b/roles/e5b76a8345d542c2a899f8dbdd95290d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:31:47.036066 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505666d0-94c4-4416-b7d3-803c6ad3241f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:47.059021 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5c9cd-a4b3-4905-8dc8-457840e8bb5b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:47.102363 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:47.110485 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55f7be-8725-4611-b0eb-968e1be6bd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:47.111666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55f7be-8725-4611-b0eb-968e1be6bd48 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:47.112201 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55f7be-8725-4611-b0eb-968e1be6bd48 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:47.113208 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55f7be-8725-4611-b0eb-968e1be6bd48 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:47.114442 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55f7be-8725-4611-b0eb-968e1be6bd48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:47.114986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55f7be-8725-4611-b0eb-968e1be6bd48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:47.117831 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55f7be-8725-4611-b0eb-968e1be6bd48 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:47.139643 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 288/605] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:31:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:47.142058 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf823-89ce-4c4a-8072-00bea22fb708 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:47.142495 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf823-89ce-4c4a-8072-00bea22fb708 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:47.142914 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bf823-89ce-4c4a-8072-00bea22fb708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:47.167348 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d91bf823-89ce-4c4a-8072-00bea22fb708 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:47.169341 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d91bf823-89ce-4c4a-8072-00bea22fb708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:47.180507 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505666d0-94c4-4416-b7d3-803c6ad3241f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:47.219379 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:47.224768 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b170cc-3b5f-4545-8f20-d58f594c00b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:47.225299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b170cc-3b5f-4545-8f20-d58f594c00b5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:47.226363 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b170cc-3b5f-4545-8f20-d58f594c00b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:47.226789 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b170cc-3b5f-4545-8f20-d58f594c00b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:47.227664 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b170cc-3b5f-4545-8f20-d58f594c00b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:47.227978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b170cc-3b5f-4545-8f20-d58f594c00b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:47.229656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b170cc-3b5f-4545-8f20-d58f594c00b5 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:47.248311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 318/606] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:31:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:47.253147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b170cc-3b5f-4545-8f20-d58f594c00b5 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:47.260876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 289/607] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:47.262520 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bf823-89ce-4c4a-8072-00bea22fb708 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:47.383483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bf823-89ce-4c4a-8072-00bea22fb708 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:47.419073 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:47.423288 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf9878-0abe-45b0-bb44-ca4e69cc158c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:47.423961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf9878-0abe-45b0-bb44-ca4e69cc158c None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:47.424881 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf9878-0abe-45b0-bb44-ca4e69cc158c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:47.425127 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf9878-0abe-45b0-bb44-ca4e69cc158c None admin] PATH_INFO: `/v3/projects/f25792dd210b42c4a3491096a735f909/users/50ec251be76543b4ad97442664db6858/roles/e5b76a8345d542c2a899f8dbdd95290d` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:47.452289 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf9878-0abe-45b0-bb44-ca4e69cc158c None admin] RBAC: Authorizing `identity:create_grant(project_id=f25792dd210b42c4a3491096a735f909, user_id=50ec251be76543b4ad97442664db6858, role_id=e5b76a8345d542c2a899f8dbdd95290d)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:47.454955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf9878-0abe-45b0-bb44-ca4e69cc158c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:47.461574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b170cc-3b5f-4545-8f20-d58f594c00b5 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:47.482888 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 290/608] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:31:47 2022] PUT /identity/v3/projects/f25792dd210b42c4a3491096a735f909/users/50ec251be76543b4ad97442664db6858/roles/e5b76a8345d542c2a899f8dbdd95290d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:31:47.506724 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03483dd-5ab3-468e-93e2-b802de0afd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:47.507928 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03483dd-5ab3-468e-93e2-b802de0afd52 None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:47.508221 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03483dd-5ab3-468e-93e2-b802de0afd52 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:47.508495 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03483dd-5ab3-468e-93e2-b802de0afd52 None admin] PATH_INFO: `/v3/projects/f25792dd210b42c4a3491096a735f909/users/a8e11feaab0c4d29b78b2e9273e5d2ce/roles/e5b76a8345d542c2a899f8dbdd95290d` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:47.525773 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03483dd-5ab3-468e-93e2-b802de0afd52 None admin] RBAC: Authorizing `identity:create_grant(project_id=f25792dd210b42c4a3491096a735f909, user_id=a8e11feaab0c4d29b78b2e9273e5d2ce, role_id=e5b76a8345d542c2a899f8dbdd95290d)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:47.527357 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03483dd-5ab3-468e-93e2-b802de0afd52 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:47.550451 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 319/609] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:31:47 2022] PUT /identity/v3/projects/f25792dd210b42c4a3491096a735f909/users/a8e11feaab0c4d29b78b2e9273e5d2ce/roles/e5b76a8345d542c2a899f8dbdd95290d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:31:47.623585 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf9878-0abe-45b0-bb44-ca4e69cc158c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:47.748418 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf9878-0abe-45b0-bb44-ca4e69cc158c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:47.791232 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb25174-27b1-4cbe-9c55-3bb2c3706a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:47.791933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb25174-27b1-4cbe-9c55-3bb2c3706a6d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:47.792213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb25174-27b1-4cbe-9c55-3bb2c3706a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:47.792483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb25174-27b1-4cbe-9c55-3bb2c3706a6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:47.803302 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb25174-27b1-4cbe-9c55-3bb2c3706a6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:47.808788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-6bb25174-27b1-4cbe-9c55-3bb2c3706a6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:47.808788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:47.808788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:47.808788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:47.808788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:47.808788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:47.808788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:47.808788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:47.808788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:47.808788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:47.808788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:47.808788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:47.808788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:47.808788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:47.808788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:47.808788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:47.809771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:47.809771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:47.809771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:47.809771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:47.809771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:47.809771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:47.809771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:47.809771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:47.809771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:47.809771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:47.809771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:47.809771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:47.809771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:47.809771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:47.809771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:47.809771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:47.810613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:47.810613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:47.810613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:47.810613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:47.810613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:47.810613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:47.810613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:47.810613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:47.810613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:47.810613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:47.810613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:47.810613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:47.810613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 291/610] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:31:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:47.817217 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03483dd-5ab3-468e-93e2-b802de0afd52 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:47.840808 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:47.925176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03483dd-5ab3-468e-93e2-b802de0afd52 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:47.961693 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48c377-1231-400c-9dfe-325769537451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:47.962304 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48c377-1231-400c-9dfe-325769537451 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:47.962581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48c377-1231-400c-9dfe-325769537451 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:47.962852 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48c377-1231-400c-9dfe-325769537451 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:47.963573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48c377-1231-400c-9dfe-325769537451 None admin] RBAC: Adding query filter params (name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:47.963877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48c377-1231-400c-9dfe-325769537451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:47.965258 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48c377-1231-400c-9dfe-325769537451 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:47.974812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 320/611] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 15 00:31:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:47.981400 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb25174-27b1-4cbe-9c55-3bb2c3706a6d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:48.024442 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:48.110222 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb25174-27b1-4cbe-9c55-3bb2c3706a6d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:48.149746 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06fb94-ff6c-479d-abc9-4f46a3881017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:48.150393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06fb94-ff6c-479d-abc9-4f46a3881017 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:48.150673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06fb94-ff6c-479d-abc9-4f46a3881017 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:48.150946 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06fb94-ff6c-479d-abc9-4f46a3881017 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:48.165828 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06fb94-ff6c-479d-abc9-4f46a3881017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:48.167647 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06fb94-ff6c-479d-abc9-4f46a3881017 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:48.189591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-9c06fb94-ff6c-479d-abc9-4f46a3881017 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:48.189591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:48.189591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:48.189591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:48.189591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:48.189591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:48.189591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:48.189591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:48.189591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:48.189591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:48.189591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:48.189591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:48.189591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:48.189591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:48.189591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:48.189591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:48.190555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:48.190555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:48.190555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:48.190555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:48.190555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:48.190555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:48.190555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:48.190555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:48.190555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:48.190555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:48.190555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:48.190555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:48.190555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:48.190555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:48.190555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:48.190555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:48.190555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:48.191449 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:48.191449 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:48.191449 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:48.193176 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 292/612] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:48.198985 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48c377-1231-400c-9dfe-325769537451 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:48.318005 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:48.340891 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48c377-1231-400c-9dfe-325769537451 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:48.400974 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cd8e0-71ac-429b-8145-b81643b46fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:48.401616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cd8e0-71ac-429b-8145-b81643b46fad None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:48.401895 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cd8e0-71ac-429b-8145-b81643b46fad None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:48.402164 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cd8e0-71ac-429b-8145-b81643b46fad None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:48.402857 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101cd8e0-71ac-429b-8145-b81643b46fad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:48.403164 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101cd8e0-71ac-429b-8145-b81643b46fad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:48.404514 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101cd8e0-71ac-429b-8145-b81643b46fad None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:48.421258 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 321/613] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:48.426127 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06fb94-ff6c-479d-abc9-4f46a3881017 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:48.564911 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:48.584949 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06fb94-ff6c-479d-abc9-4f46a3881017 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:48.626852 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf37c3d-fc96-459d-931b-aa6b9795deb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:48.627483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf37c3d-fc96-459d-931b-aa6b9795deb6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:48.627768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf37c3d-fc96-459d-931b-aa6b9795deb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:48.628041 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf37c3d-fc96-459d-931b-aa6b9795deb6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:48.646970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf37c3d-fc96-459d-931b-aa6b9795deb6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:48.648562 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf37c3d-fc96-459d-931b-aa6b9795deb6 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:48.662921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-9cf37c3d-fc96-459d-931b-aa6b9795deb6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 00:31:48.662921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:48.662921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:48.662921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:48.662921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:48.662921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:48.662921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:48.662921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:48.662921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:48.662921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:48.662921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:48.662921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:48.662921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:31:48.662921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:31:48.662921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:31:48.662921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:31:48.663974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:48.663974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:48.663974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:31:48.663974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:48.663974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:31:48.663974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:48.663974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:48.663974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:48.663974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:48.663974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:48.663974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:48.663974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:48.663974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:48.663974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:48.663974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:48.663974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:48.663974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:48.663974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:48.664947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:48.664947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:48.664947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:31:48.664947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:31:48.664947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:31:48.664947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:31:48.664947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:31:48.664947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:31:48.664947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 00:31:48.664947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:48.667303 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 293/614] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:31:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:48.672946 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cd8e0-71ac-429b-8145-b81643b46fad None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:48.845039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cd8e0-71ac-429b-8145-b81643b46fad None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:48.903217 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b82a3e-aa84-487a-8411-def6854f709c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:48.904175 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b82a3e-aa84-487a-8411-def6854f709c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:48.904650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b82a3e-aa84-487a-8411-def6854f709c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:48.905158 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b82a3e-aa84-487a-8411-def6854f709c None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:48.906064 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b82a3e-aa84-487a-8411-def6854f709c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:48.906580 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b82a3e-aa84-487a-8411-def6854f709c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:48.908227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b82a3e-aa84-487a-8411-def6854f709c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:48.931640 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:48.939548 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 322/615] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Sep 15 00:31:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:48.946275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf37c3d-fc96-459d-931b-aa6b9795deb6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:49.085352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf37c3d-fc96-459d-931b-aa6b9795deb6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:49.128682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88236d-21a2-49a6-b624-5c7dea6ae8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:49.129263 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88236d-21a2-49a6-b624-5c7dea6ae8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:49.129544 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88236d-21a2-49a6-b624-5c7dea6ae8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:49.129815 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88236d-21a2-49a6-b624-5c7dea6ae8d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:49.144386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccea7db-6cab-4c72-aa4f-0e6d1cda9788 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:49.144675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccea7db-6cab-4c72-aa4f-0e6d1cda9788 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:49.144960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccea7db-6cab-4c72-aa4f-0e6d1cda9788 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:49.146779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88236d-21a2-49a6-b624-5c7dea6ae8d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:49.148484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88236d-21a2-49a6-b624-5c7dea6ae8d1 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:49.152811 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 323/616] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:49.156036 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:49.157220 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53e1ba-2ea4-4be8-b95b-849f93b86dc1 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:49.157692 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53e1ba-2ea4-4be8-b95b-849f93b86dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:49.158679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53e1ba-2ea4-4be8-b95b-849f93b86dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:49.176534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-7b88236d-21a2-49a6-b624-5c7dea6ae8d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:49.176534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:49.176534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:49.176534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:49.176534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:49.176534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:49.176534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:49.176534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:49.176534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:49.176534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:49.176534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:49.176534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:49.176534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:49.176534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:49.176534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:49.176534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:49.177537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:49.177537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:49.177537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:49.177537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:49.177537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:49.177537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:49.177537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:49.177537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:49.177537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:49.177537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:49.177537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:49.177537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:49.177537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:49.177537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:49.177537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:49.177537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:49.177537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:49.178416 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:49.178416 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:49.178416 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:49.181182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 294/617] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:49.188417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88236d-21a2-49a6-b624-5c7dea6ae8d1 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:49.195499 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ea53e1ba-2ea4-4be8-b95b-849f93b86dc1 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:49.197023 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ea53e1ba-2ea4-4be8-b95b-849f93b86dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:49.293865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 324/618] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:49.382960 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88236d-21a2-49a6-b624-5c7dea6ae8d1 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:49.419302 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13839b80-86ec-4bbc-92bd-69203fb9edbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:49.419911 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13839b80-86ec-4bbc-92bd-69203fb9edbe None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:49.420190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13839b80-86ec-4bbc-92bd-69203fb9edbe None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:49.420463 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13839b80-86ec-4bbc-92bd-69203fb9edbe None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:49.421128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13839b80-86ec-4bbc-92bd-69203fb9edbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:49.421439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13839b80-86ec-4bbc-92bd-69203fb9edbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:49.422812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13839b80-86ec-4bbc-92bd-69203fb9edbe None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:49.435321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 295/619] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:31:49.440832 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53e1ba-2ea4-4be8-b95b-849f93b86dc1 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:49.547544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53e1ba-2ea4-4be8-b95b-849f93b86dc1 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:49.584846 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:49.595133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbe0de-4a55-4c52-826a-cf55ffca7b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:49.595779 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbe0de-4a55-4c52-826a-cf55ffca7b42 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:49.596060 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbe0de-4a55-4c52-826a-cf55ffca7b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:49.596331 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbe0de-4a55-4c52-826a-cf55ffca7b42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:49.610318 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cbe0de-4a55-4c52-826a-cf55ffca7b42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:49.611772 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cbe0de-4a55-4c52-826a-cf55ffca7b42 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:49.626866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-c0cbe0de-4a55-4c52-826a-cf55ffca7b42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:49.626866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:49.626866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:49.626866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:49.626866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:49.626866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:49.626866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:49.626866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:49.626866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:49.626866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:49.626866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:49.626866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:49.626866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:31:49.626866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:31:49.626866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:31:49.627792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:31:49.627792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:49.627792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:49.627792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:49.627792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:49.627792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:49.627792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:49.627792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:49.627792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:49.627792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:49.627792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:49.627792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:49.627792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:49.627792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:49.627792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:49.627792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:49.627792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:49.629078 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:31:49.629078 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:31:49.629078 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:31:49.629078 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:31:49.629078 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:31:49.629078 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:31:49.629078 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:49.629078 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:49.629078 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 325/620] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:49.635853 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13839b80-86ec-4bbc-92bd-69203fb9edbe None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:49.723935 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:49.783854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13839b80-86ec-4bbc-92bd-69203fb9edbe None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:49.810157 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbe0de-4a55-4c52-826a-cf55ffca7b42 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:49.838396 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f917957-2416-4328-adae-369abae0a184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:49.839289 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f917957-2416-4328-adae-369abae0a184 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:49.839573 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f917957-2416-4328-adae-369abae0a184 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:49.839850 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f917957-2416-4328-adae-369abae0a184 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:49.841300 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f917957-2416-4328-adae-369abae0a184 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:49.841620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f917957-2416-4328-adae-369abae0a184 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:49.844088 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f917957-2416-4328-adae-369abae0a184 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:49.860771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 296/621] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:31:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:49.862488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9f9fa-a10e-46d3-817a-783c5b3bd208 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:49.862774 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9f9fa-a10e-46d3-817a-783c5b3bd208 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:49.863052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9f9fa-a10e-46d3-817a-783c5b3bd208 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:49.864865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 297/622] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:49.870085 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9f9fa-a10e-46d3-817a-783c5b3bd208 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:49.926243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbe0de-4a55-4c52-826a-cf55ffca7b42 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:49.968355 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfba76-e104-42c5-a10b-dda371c70655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:49.969891 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfba76-e104-42c5-a10b-dda371c70655 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:49.970185 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfba76-e104-42c5-a10b-dda371c70655 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:49.970461 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfba76-e104-42c5-a10b-dda371c70655 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:49.984667 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bfba76-e104-42c5-a10b-dda371c70655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:49.992433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-07bfba76-e104-42c5-a10b-dda371c70655 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:49.992433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:49.992433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:49.992433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:49.992433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:49.992433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:49.992433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:49.992433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:49.992433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:49.992433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:49.992433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:49.992433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:49.992433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:49.992433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:49.992433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:49.992433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:49.993411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:49.993411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:49.993411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:49.993411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:49.993411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:49.993411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:49.993411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:49.993411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:49.993411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:49.993411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:49.993411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:49.993411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:49.993411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:49.993411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:49.993411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:49.993411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:49.994905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:49.994905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:49.994905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:49.994905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:49.994905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:49.994905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:49.994905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:49.994905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:49.994905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:49.994905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:49.994905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:49.994905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:49.994905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 326/623] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:31:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:49.996591 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db598e-af2b-49ca-8adb-33da0b6b4b8c None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:49.996591 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db598e-af2b-49ca-8adb-33da0b6b4b8c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:49.996591 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db598e-af2b-49ca-8adb-33da0b6b4b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:50.007280 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9f9fa-a10e-46d3-817a-783c5b3bd208 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:50.018774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-93db598e-af2b-49ca-8adb-33da0b6b4b8c None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:50.020668 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-93db598e-af2b-49ca-8adb-33da0b6b4b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:50.026682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:50.048734 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c56f5-8dc3-40da-a80a-b61bbc071e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:50.049412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c56f5-8dc3-40da-a80a-b61bbc071e31 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:50.049689 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c56f5-8dc3-40da-a80a-b61bbc071e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:50.049962 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c56f5-8dc3-40da-a80a-b61bbc071e31 None admin] PATH_INFO: `/v3/projects/f25792dd210b42c4a3491096a735f909/users/5fb248b85aba45b39132d0f92ede0b68/roles/e5b76a8345d542c2a899f8dbdd95290d` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:50.065912 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c56f5-8dc3-40da-a80a-b61bbc071e31 None admin] RBAC: Authorizing `identity:create_grant(project_id=f25792dd210b42c4a3491096a735f909, user_id=5fb248b85aba45b39132d0f92ede0b68, role_id=e5b76a8345d542c2a899f8dbdd95290d)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:50.067781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c56f5-8dc3-40da-a80a-b61bbc071e31 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:50.084009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 298/624] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:31:49 2022] PUT /identity/v3/projects/f25792dd210b42c4a3491096a735f909/users/5fb248b85aba45b39132d0f92ede0b68/roles/e5b76a8345d542c2a899f8dbdd95290d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:31:50.085226 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c56f5-8dc3-40da-a80a-b61bbc071e31 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:50.090865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:50.118604 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 327/625] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:50.251487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c56f5-8dc3-40da-a80a-b61bbc071e31 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:50.305781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35725801-0935-4832-b874-298d7d3d4513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:50.306392 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35725801-0935-4832-b874-298d7d3d4513 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:50.306666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35725801-0935-4832-b874-298d7d3d4513 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:50.306944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35725801-0935-4832-b874-298d7d3d4513 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:50.307609 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35725801-0935-4832-b874-298d7d3d4513 None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:50.307908 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35725801-0935-4832-b874-298d7d3d4513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:50.309303 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35725801-0935-4832-b874-298d7d3d4513 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:50.321591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 299/626] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 15 00:31:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:50.327218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db598e-af2b-49ca-8adb-33da0b6b4b8c None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:50.340471 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a2917-a3b0-4cf4-bbfb-50f19c434531 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:50.340785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a2917-a3b0-4cf4-bbfb-50f19c434531 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:50.341022 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a2917-a3b0-4cf4-bbfb-50f19c434531 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:50.342565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 300/627] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:31:50.348231 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205adf69-2758-473a-ade5-4bc4c50c9f9b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:50.348502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205adf69-2758-473a-ade5-4bc4c50c9f9b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:50.348778 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205adf69-2758-473a-ade5-4bc4c50c9f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:50.378164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-205adf69-2758-473a-ade5-4bc4c50c9f9b None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:50.379465 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-205adf69-2758-473a-ade5-4bc4c50c9f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:50.409114 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:50.458405 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db598e-af2b-49ca-8adb-33da0b6b4b8c None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:50.466258 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 301/628] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:50.468432 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efa417-01f4-4e5b-88f2-c4efed6e9e77 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:50.468976 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efa417-01f4-4e5b-88f2-c4efed6e9e77 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:50.469939 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efa417-01f4-4e5b-88f2-c4efed6e9e77 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:50.472302 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 302/629] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:50.477900 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdff15-d46c-4c48-bfec-db1c041eb425 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:50.478484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdff15-d46c-4c48-bfec-db1c041eb425 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:50.478984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdff15-d46c-4c48-bfec-db1c041eb425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:50.497814 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-57fdff15-d46c-4c48-bfec-db1c041eb425 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:50.499340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-57fdff15-d46c-4c48-bfec-db1c041eb425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:50.501443 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca2510-e327-426b-b4a7-e70f6b5c732b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:50.502128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca2510-e327-426b-b4a7-e70f6b5c732b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:50.502352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca2510-e327-426b-b4a7-e70f6b5c732b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:50.502626 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca2510-e327-426b-b4a7-e70f6b5c732b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:50.514013 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca2510-e327-426b-b4a7-e70f6b5c732b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:50.515439 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca2510-e327-426b-b4a7-e70f6b5c732b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:50.531252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-76ca2510-e327-426b-b4a7-e70f6b5c732b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:50.531252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:50.531252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:50.531252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:50.531252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:50.531252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:50.531252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:50.531252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:50.531252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:50.531252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:50.531252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:50.531252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:50.531252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:50.531252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:50.531252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:50.531252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:50.532230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:50.532230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:50.532230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:50.532230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:50.532230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:50.532230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:50.532230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:50.532230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:50.532230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:50.532230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:50.532230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:50.532230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:50.532230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:50.532230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:50.532230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:50.532230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:50.532230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:50.533168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:50.533168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:50.533168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:50.533168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 328/630] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:50.533850 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca2510-e327-426b-b4a7-e70f6b5c732b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:50.566025 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:50.576199 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 303/631] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:31:50.581529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdff15-d46c-4c48-bfec-db1c041eb425 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:50.645131 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca2510-e327-426b-b4a7-e70f6b5c732b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:50.681111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fa8ac-8e1e-4d59-b382-f1774a852d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:50.681111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa8ac-8e1e-4d59-b382-f1774a852d10 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:50.681111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa8ac-8e1e-4d59-b382-f1774a852d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:50.681111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa8ac-8e1e-4d59-b382-f1774a852d10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:50.688281 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fa8ac-8e1e-4d59-b382-f1774a852d10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:50.697162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-621fa8ac-8e1e-4d59-b382-f1774a852d10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:50.697162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:50.697162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:50.697162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:50.697162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:50.697162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:50.697162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:50.697162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:50.697162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:50.697162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:50.697162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:50.697162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:50.697162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:50.697162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:50.697162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:50.697162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:50.698145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:50.698145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:50.698145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:50.698145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:50.698145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:50.698145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:50.698145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:50.698145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:50.698145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:50.698145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:50.698145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:50.698145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:50.698145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:50.698145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:50.698145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:50.698145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:50.698996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:50.698996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:50.698996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:50.698996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:50.698996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:50.698996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:50.698996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:50.698996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:50.698996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:50.698996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:50.698996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:50.698996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:50.698996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 329/632] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:31:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:50.701290 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fa8ac-8e1e-4d59-b382-f1774a852d10 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:50.740997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:50.757055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdff15-d46c-4c48-bfec-db1c041eb425 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:50.793241 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680c83a-f9cf-494a-bed0-ae64960c84f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:50.794234 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680c83a-f9cf-494a-bed0-ae64960c84f3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:50.794719 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680c83a-f9cf-494a-bed0-ae64960c84f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:50.795594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680c83a-f9cf-494a-bed0-ae64960c84f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:50.796732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680c83a-f9cf-494a-bed0-ae64960c84f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:50.797342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680c83a-f9cf-494a-bed0-ae64960c84f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:50.799687 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680c83a-f9cf-494a-bed0-ae64960c84f3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:50.800713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:50.809032 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fa8ac-8e1e-4d59-b382-f1774a852d10 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:50.815250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 304/633] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:50.816320 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680c83a-f9cf-494a-bed0-ae64960c84f3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:50.846291 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50559fd5-f954-4e65-8a76-273b85b7f83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:50.846965 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50559fd5-f954-4e65-8a76-273b85b7f83a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:50.847153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50559fd5-f954-4e65-8a76-273b85b7f83a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:50.847502 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50559fd5-f954-4e65-8a76-273b85b7f83a None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:50.848223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50559fd5-f954-4e65-8a76-273b85b7f83a None admin] RBAC: Adding query filter params (name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:50.848523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50559fd5-f954-4e65-8a76-273b85b7f83a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:50.849953 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50559fd5-f954-4e65-8a76-273b85b7f83a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:50.864270 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 330/634] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 15 00:31:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:31:50.865161 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50559fd5-f954-4e65-8a76-273b85b7f83a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:50.952295 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680c83a-f9cf-494a-bed0-ae64960c84f3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:50.974693 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50559fd5-f954-4e65-8a76-273b85b7f83a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:50.994183 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c764d34-a986-4cc3-97f9-fb5bdf349cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:50.994818 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c764d34-a986-4cc3-97f9-fb5bdf349cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:50.995162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c764d34-a986-4cc3-97f9-fb5bdf349cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:50.995443 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c764d34-a986-4cc3-97f9-fb5bdf349cf1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:51.009593 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c764d34-a986-4cc3-97f9-fb5bdf349cf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:51.010479 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28e81b-8b38-4d16-8f9f-8701274a82f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:51.011109 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28e81b-8b38-4d16-8f9f-8701274a82f8 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:51.011390 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28e81b-8b38-4d16-8f9f-8701274a82f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:51.011661 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28e81b-8b38-4d16-8f9f-8701274a82f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:51.015709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-7c764d34-a986-4cc3-97f9-fb5bdf349cf1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:51.015709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:51.015709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:51.015709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:51.015709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:51.015709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:51.015709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:51.015709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:51.015709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:51.015709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:51.015709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:51.015709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:51.015709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:51.015709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:51.015709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:51.015709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:51.016591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:51.016591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:51.016591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:51.016591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:51.016591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:51.016591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:51.016591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:51.016591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:51.016591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:51.016591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:51.016591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:51.016591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:51.016591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:51.016591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:51.016591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:51.016591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:51.022264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:51.022264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:51.022264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:51.022264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:51.022264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:51.022264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:51.022264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:51.022264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:51.022264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:51.022264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:51.022264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:51.022264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:51.022264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 305/635] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:31:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:51.022264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c764d34-a986-4cc3-97f9-fb5bdf349cf1 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:51.023703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28e81b-8b38-4d16-8f9f-8701274a82f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:51.023703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28e81b-8b38-4d16-8f9f-8701274a82f8 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:51.035579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-1f28e81b-8b38-4d16-8f9f-8701274a82f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 00:31:51.035579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:51.035579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:51.035579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:51.035579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:51.035579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:51.035579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:51.035579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:51.035579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:51.035579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:51.035579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:51.035579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:51.035579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:31:51.035579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:31:51.035579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:31:51.035579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:31:51.036560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:51.036560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:51.036560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:31:51.036560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:51.036560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:31:51.036560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:51.036560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:51.036560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:51.036560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:51.036560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:51.036560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:51.036560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:51.036560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:51.036560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:51.036560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:51.036560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:51.036560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:51.036560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:51.037571 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:51.037571 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:51.037571 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:31:51.037571 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:31:51.037571 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:31:51.037571 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:31:51.037571 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:31:51.037571 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:31:51.037571 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 00:31:51.037571 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:51.037571 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 331/636] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Sep 15 00:31:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:51.037571 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28e81b-8b38-4d16-8f9f-8701274a82f8 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:51.043819 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:51.058702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:51.140444 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c764d34-a986-4cc3-97f9-fb5bdf349cf1 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:51.149680 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28e81b-8b38-4d16-8f9f-8701274a82f8 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:51.179087 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1464b32-052d-4743-81ed-88b8fdd8f4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:51.179751 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1464b32-052d-4743-81ed-88b8fdd8f4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:51.180037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1464b32-052d-4743-81ed-88b8fdd8f4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:51.180313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1464b32-052d-4743-81ed-88b8fdd8f4d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:51.186391 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a46e37-bbb2-413f-9e94-fd857d8c57ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:51.187623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a46e37-bbb2-413f-9e94-fd857d8c57ed None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:51.188109 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a46e37-bbb2-413f-9e94-fd857d8c57ed None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:51.188580 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a46e37-bbb2-413f-9e94-fd857d8c57ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:51.190930 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1464b32-052d-4743-81ed-88b8fdd8f4d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:51.192387 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1464b32-052d-4743-81ed-88b8fdd8f4d0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:51.200660 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a46e37-bbb2-413f-9e94-fd857d8c57ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:51.206126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-98a46e37-bbb2-413f-9e94-fd857d8c57ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:51.206126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:51.206126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:51.206126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:51.206126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:51.206126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:51.206126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:51.206126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:51.206126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:51.206126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:51.206126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:51.206126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:51.206126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:51.206126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:51.206126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:51.206126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:51.207262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:51.207262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:51.207262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:51.207262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:51.207262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:51.207262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:51.207262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:51.207262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:51.207262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:51.207262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:51.207262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:51.207262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:51.207262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:51.207262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:51.207262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:51.207262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:51.208293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:51.208293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:51.208293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:51.208293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:51.208293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:51.208293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:51.208293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:51.208293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:51.208293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:51.208293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:51.208293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:51.208293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:51.208996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-a1464b32-052d-4743-81ed-88b8fdd8f4d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:51.208996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:51.208996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:51.208996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:51.208996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:51.208996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:51.208996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:51.208996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:51.208996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:51.208996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:51.208996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:51.208996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:51.208996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:51.208996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:51.208996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:51.208996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:51.210329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:51.210329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:51.210329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:51.210329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:51.210329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:51.210329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:51.210329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:51.210329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:51.210329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:51.210329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:51.210329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:51.210329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:51.210329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:51.210329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:51.210329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:51.210329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:51.210329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:51.211918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:51.211918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:51.211918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:51.211918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 306/637] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:51.211918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1464b32-052d-4743-81ed-88b8fdd8f4d0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:51.213389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 332/638] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:31:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:51.214546 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a46e37-bbb2-413f-9e94-fd857d8c57ed None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:51.283716 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:51.294049 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:51.327054 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a46e37-bbb2-413f-9e94-fd857d8c57ed None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:51.328800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1464b32-052d-4743-81ed-88b8fdd8f4d0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:51.365946 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c4dc5-c5a9-47cf-bd89-379826ea8321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:51.366649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c4dc5-c5a9-47cf-bd89-379826ea8321 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:51.366940 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c4dc5-c5a9-47cf-bd89-379826ea8321 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:51.367040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8ae87-bb0c-478e-a3bc-56d33a7de35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:51.367229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c4dc5-c5a9-47cf-bd89-379826ea8321 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:51.367539 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8ae87-bb0c-478e-a3bc-56d33a7de35c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:51.367821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8ae87-bb0c-478e-a3bc-56d33a7de35c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:51.367916 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c4dc5-c5a9-47cf-bd89-379826ea8321 None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:51.368094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8ae87-bb0c-478e-a3bc-56d33a7de35c None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:51.368198 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c4dc5-c5a9-47cf-bd89-379826ea8321 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:51.368871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8ae87-bb0c-478e-a3bc-56d33a7de35c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:51.369218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8ae87-bb0c-478e-a3bc-56d33a7de35c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:51.369523 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c4dc5-c5a9-47cf-bd89-379826ea8321 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:51.370784 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8ae87-bb0c-478e-a3bc-56d33a7de35c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:51.382115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 307/639] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 15 00:31:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:51.382115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c4dc5-c5a9-47cf-bd89-379826ea8321 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:51.402095 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 333/640] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Sep 15 00:31:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:51.402095 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8ae87-bb0c-478e-a3bc-56d33a7de35c None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:51.482728 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c4dc5-c5a9-47cf-bd89-379826ea8321 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:51.506074 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:51.517566 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8ae87-bb0c-478e-a3bc-56d33a7de35c None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:51.519886 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932507e-eddf-4c53-8339-f35cff30c990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:51.520563 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932507e-eddf-4c53-8339-f35cff30c990 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:51.520852 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932507e-eddf-4c53-8339-f35cff30c990 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:51.521150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932507e-eddf-4c53-8339-f35cff30c990 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:51.521801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932507e-eddf-4c53-8339-f35cff30c990 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:51.522104 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932507e-eddf-4c53-8339-f35cff30c990 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:51.523507 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932507e-eddf-4c53-8339-f35cff30c990 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:51.535608 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 308/641] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:51.536344 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932507e-eddf-4c53-8339-f35cff30c990 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:51.555693 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:51.562569 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ae4b7-3231-43cf-a98e-d5523d32a67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:51.563196 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ae4b7-3231-43cf-a98e-d5523d32a67a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:51.563446 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ae4b7-3231-43cf-a98e-d5523d32a67a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:51.563717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ae4b7-3231-43cf-a98e-d5523d32a67a None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:51.564375 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ae4b7-3231-43cf-a98e-d5523d32a67a None admin] RBAC: Adding query filter params (name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:51.564677 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ae4b7-3231-43cf-a98e-d5523d32a67a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:51.566120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ae4b7-3231-43cf-a98e-d5523d32a67a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:51.579197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 334/642] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 15 00:31:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:51.579197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ae4b7-3231-43cf-a98e-d5523d32a67a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:51.652936 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932507e-eddf-4c53-8339-f35cff30c990 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:51.688846 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d69dc8-1a5a-49f1-a34b-e840483fe352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:51.689485 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d69dc8-1a5a-49f1-a34b-e840483fe352 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:51.689761 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d69dc8-1a5a-49f1-a34b-e840483fe352 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:51.690028 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d69dc8-1a5a-49f1-a34b-e840483fe352 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:51.693461 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ae4b7-3231-43cf-a98e-d5523d32a67a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:51.700347 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d69dc8-1a5a-49f1-a34b-e840483fe352 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:51.701802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d69dc8-1a5a-49f1-a34b-e840483fe352 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:51.716553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-90d69dc8-1a5a-49f1-a34b-e840483fe352 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:51.716553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:51.716553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:51.716553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:51.716553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:51.716553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:51.716553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:51.716553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:51.716553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:51.716553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:51.716553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:51.716553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:51.716553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:51.716553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:51.716553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:51.716553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:51.717747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:51.717747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:51.717747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:51.717747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:51.717747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:51.717747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:51.717747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:51.717747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:51.717747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:51.717747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:51.717747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:51.717747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:51.717747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:51.717747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:51.717747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:51.717747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:51.717747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:51.718863 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:51.718863 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:51.718863 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:51.718863 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 309/643] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:51.718863 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d69dc8-1a5a-49f1-a34b-e840483fe352 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:51.738793 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338c364-a8b5-49e6-b661-7519780adfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:51.739395 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338c364-a8b5-49e6-b661-7519780adfdd None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:51.739671 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338c364-a8b5-49e6-b661-7519780adfdd None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:51.739942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338c364-a8b5-49e6-b661-7519780adfdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:51.753925 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:51.807580 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:51.816083 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338c364-a8b5-49e6-b661-7519780adfdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:51.817550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338c364-a8b5-49e6-b661-7519780adfdd None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:51.821465 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d69dc8-1a5a-49f1-a34b-e840483fe352 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:51.857870 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a53d61-cc44-4fd0-9737-0021cd8e82e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:51.858495 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a53d61-cc44-4fd0-9737-0021cd8e82e2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:51.858772 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a53d61-cc44-4fd0-9737-0021cd8e82e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:51.859302 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a53d61-cc44-4fd0-9737-0021cd8e82e2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:51.866674 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a53d61-cc44-4fd0-9737-0021cd8e82e2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:51.868682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a53d61-cc44-4fd0-9737-0021cd8e82e2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:51.880094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-e7a53d61-cc44-4fd0-9737-0021cd8e82e2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 00:31:51.880094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:51.880094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:51.880094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:51.880094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:51.880094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:51.880094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:51.880094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:51.880094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:51.880094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:51.880094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:51.880094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:51.880094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:31:51.880094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:31:51.880094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:31:51.880094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:31:51.881007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:51.881007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:51.881007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:31:51.881007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:51.881007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:31:51.881007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:51.881007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:51.881007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:51.881007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:51.881007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:51.881007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:51.881007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:51.881007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:51.881007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:51.881007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:51.881007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:51.881007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:51.881007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:51.882117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:51.882117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:51.882117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:31:51.882117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:31:51.882117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:31:51.882117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:31:51.882117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:31:51.882117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:31:51.882117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 15 00:31:51.882117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:51.882117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 310/644] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:51.882117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a53d61-cc44-4fd0-9737-0021cd8e82e2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:51.928409 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 335/645] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:31:51.928409 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338c364-a8b5-49e6-b661-7519780adfdd None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:51.988408 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:51.998518 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a53d61-cc44-4fd0-9737-0021cd8e82e2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:52.034916 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:52.037377 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f5595-d2be-46fe-9a4a-7a6c938ee86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:52.038029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f5595-d2be-46fe-9a4a-7a6c938ee86d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:52.038307 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f5595-d2be-46fe-9a4a-7a6c938ee86d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:52.039115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f5595-d2be-46fe-9a4a-7a6c938ee86d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:52.043720 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338c364-a8b5-49e6-b661-7519780adfdd None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:52.049630 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f5595-d2be-46fe-9a4a-7a6c938ee86d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:52.051083 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f5595-d2be-46fe-9a4a-7a6c938ee86d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:52.065942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-a46f5595-d2be-46fe-9a4a-7a6c938ee86d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:52.065942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:52.065942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:52.065942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:52.065942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:52.065942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:52.065942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:52.065942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:52.065942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:52.065942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:52.065942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:52.065942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:52.065942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:52.065942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:52.065942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:52.065942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:52.066887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:52.066887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:52.066887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:52.066887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:52.066887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:52.066887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:52.066887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:52.066887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:52.066887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:52.066887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:52.066887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:52.066887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:52.066887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:52.066887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:52.066887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:52.066887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:52.066887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:52.067760 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:52.067760 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:52.067760 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:52.067760 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 311/646] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:52.067760 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f5595-d2be-46fe-9a4a-7a6c938ee86d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:52.085997 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec301a6-e029-4eb5-9d58-5aaadabb8213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:52.086607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec301a6-e029-4eb5-9d58-5aaadabb8213 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:52.086917 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec301a6-e029-4eb5-9d58-5aaadabb8213 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:52.087153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec301a6-e029-4eb5-9d58-5aaadabb8213 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:52.087832 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec301a6-e029-4eb5-9d58-5aaadabb8213 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:52.088091 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec301a6-e029-4eb5-9d58-5aaadabb8213 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:52.089493 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec301a6-e029-4eb5-9d58-5aaadabb8213 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:52.102655 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 336/647] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:52.107618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec301a6-e029-4eb5-9d58-5aaadabb8213 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:52.172437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f5595-d2be-46fe-9a4a-7a6c938ee86d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:52.207379 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b866694-0957-4423-9244-b1761414ea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:52.207979 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b866694-0957-4423-9244-b1761414ea33 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:52.208261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b866694-0957-4423-9244-b1761414ea33 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:52.208539 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b866694-0957-4423-9244-b1761414ea33 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:52.209301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b866694-0957-4423-9244-b1761414ea33 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:52.209611 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b866694-0957-4423-9244-b1761414ea33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:52.211584 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b866694-0957-4423-9244-b1761414ea33 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:52.214097 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec301a6-e029-4eb5-9d58-5aaadabb8213 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:52.229644 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 312/648] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Sep 15 00:31:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:52.230800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b866694-0957-4423-9244-b1761414ea33 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:52.236231 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:52.254174 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75458143-7768-4a7d-83f3-93d51a7456a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:52.254799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75458143-7768-4a7d-83f3-93d51a7456a0 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:52.255075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75458143-7768-4a7d-83f3-93d51a7456a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:52.255341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75458143-7768-4a7d-83f3-93d51a7456a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:52.266180 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75458143-7768-4a7d-83f3-93d51a7456a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:52.267580 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75458143-7768-4a7d-83f3-93d51a7456a0 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:52.284104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-75458143-7768-4a7d-83f3-93d51a7456a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:52.284104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:52.284104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:52.284104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:52.284104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:52.284104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:52.284104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:52.284104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:52.284104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:52.284104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:52.284104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:52.284104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:52.284104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:52.284104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:52.284104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:52.284104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:52.285262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:52.285262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:52.285262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:52.285262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:52.285262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:52.285262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:52.285262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:52.285262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:52.285262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:52.285262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:52.285262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:52.285262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:52.285262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:52.285262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:52.285262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:52.285262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:52.285262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:52.286165 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:52.286165 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:52.286165 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:52.286165 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 337/649] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:52.286165 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75458143-7768-4a7d-83f3-93d51a7456a0 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:52.299495 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:52.360294 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b866694-0957-4423-9244-b1761414ea33 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:52.399924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef787165-4cc6-4da4-aa3e-28a10ca2adbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:52.400528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef787165-4cc6-4da4-aa3e-28a10ca2adbe None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:52.400815 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef787165-4cc6-4da4-aa3e-28a10ca2adbe None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:52.401076 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef787165-4cc6-4da4-aa3e-28a10ca2adbe None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:52.401737 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef787165-4cc6-4da4-aa3e-28a10ca2adbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:52.402044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef787165-4cc6-4da4-aa3e-28a10ca2adbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:52.403408 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef787165-4cc6-4da4-aa3e-28a10ca2adbe None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:52.408782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75458143-7768-4a7d-83f3-93d51a7456a0 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:52.415202 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 313/650] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:52.415997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef787165-4cc6-4da4-aa3e-28a10ca2adbe None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:52.449906 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e7324-78cb-4a35-be64-1ef92677f37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:52.450531 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e7324-78cb-4a35-be64-1ef92677f37b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:52.450812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e7324-78cb-4a35-be64-1ef92677f37b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:52.451111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e7324-78cb-4a35-be64-1ef92677f37b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:52.458799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e7324-78cb-4a35-be64-1ef92677f37b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:52.460263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e7324-78cb-4a35-be64-1ef92677f37b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:52.471913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-132e7324-78cb-4a35-be64-1ef92677f37b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 00:31:52.471913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:52.471913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:52.471913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:52.471913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:52.471913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:52.471913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:52.471913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:52.471913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:52.471913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:52.471913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:52.471913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:52.471913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:31:52.471913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:31:52.471913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:31:52.471913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:31:52.472876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:52.472876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:52.472876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:31:52.472876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:52.472876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:31:52.472876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:52.472876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:52.472876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:52.472876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:52.472876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:52.472876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:52.472876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:52.472876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:52.472876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:52.472876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:52.472876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:52.472876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:52.472876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:52.473849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:52.473849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:52.473849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:31:52.473849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:31:52.473849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:31:52.473849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:31:52.473849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:31:52.473849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:31:52.473849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 00:31:52.473849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:52.473849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 338/651] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:31:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:52.473849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e7324-78cb-4a35-be64-1ef92677f37b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:52.484546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:52.523278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef787165-4cc6-4da4-aa3e-28a10ca2adbe None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:52.541458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:52.557845 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05e6ce-cf9b-4d9d-a348-44b5ebbf4964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:52.558446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05e6ce-cf9b-4d9d-a348-44b5ebbf4964 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:52.558724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05e6ce-cf9b-4d9d-a348-44b5ebbf4964 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:52.558998 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05e6ce-cf9b-4d9d-a348-44b5ebbf4964 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:52.576912 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e7324-78cb-4a35-be64-1ef92677f37b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:52.609803 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c6921-ad39-41fe-a313-697d40bc6398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:52.610335 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c6921-ad39-41fe-a313-697d40bc6398 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:52.610613 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c6921-ad39-41fe-a313-697d40bc6398 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:52.610878 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c6921-ad39-41fe-a313-697d40bc6398 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:52.611504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c6921-ad39-41fe-a313-697d40bc6398 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:52.611805 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c6921-ad39-41fe-a313-697d40bc6398 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:52.613169 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c6921-ad39-41fe-a313-697d40bc6398 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:52.625219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05e6ce-cf9b-4d9d-a348-44b5ebbf4964 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:52.625521 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 339/652] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:52.626308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c6921-ad39-41fe-a313-697d40bc6398 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:52.626735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05e6ce-cf9b-4d9d-a348-44b5ebbf4964 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:52.685714 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:52.722830 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 314/653] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:31:52.723563 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c6921-ad39-41fe-a313-697d40bc6398 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:52.724212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e971f54-f8e7-4b04-bbda-133e274f87a7 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:52.724494 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e971f54-f8e7-4b04-bbda-133e274f87a7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:52.724769 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e971f54-f8e7-4b04-bbda-133e274f87a7 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:52.726620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 315/654] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:52.727306 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e971f54-f8e7-4b04-bbda-133e274f87a7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:52.752702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:52.762190 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd3f84-ea28-429a-90d1-6ab488ff4bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:52.762816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd3f84-ea28-429a-90d1-6ab488ff4bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:52.763092 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd3f84-ea28-429a-90d1-6ab488ff4bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:52.763355 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd3f84-ea28-429a-90d1-6ab488ff4bc8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:52.770177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd3f84-ea28-429a-90d1-6ab488ff4bc8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:52.771598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd3f84-ea28-429a-90d1-6ab488ff4bc8 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:52.783029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-babd3f84-ea28-429a-90d1-6ab488ff4bc8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 00:31:52.783029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:52.783029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:52.783029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:52.783029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:52.783029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:52.783029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:52.783029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:52.783029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:52.783029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:52.783029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:52.783029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:52.783029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:31:52.783029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:31:52.783029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:31:52.783029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:31:52.784037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:52.784037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:52.784037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:31:52.784037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:52.784037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:31:52.784037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:52.784037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:52.784037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:52.784037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:52.784037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:52.784037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:52.784037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:52.784037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:52.784037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:52.784037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:52.784037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:52.784037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:52.784037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:52.785014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:52.785014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:52.785014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:31:52.785014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:31:52.785014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:31:52.785014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:31:52.785014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:31:52.785014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:31:52.785014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 00:31:52.785014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:52.785014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 340/655] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:52.785014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd3f84-ea28-429a-90d1-6ab488ff4bc8 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:52.832205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e971f54-f8e7-4b04-bbda-133e274f87a7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:52.864921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf947b93-bbad-4e7f-be50-86902b123b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:52.865466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf947b93-bbad-4e7f-be50-86902b123b63 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:52.865745 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf947b93-bbad-4e7f-be50-86902b123b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:52.866015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf947b93-bbad-4e7f-be50-86902b123b63 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:52.866759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf947b93-bbad-4e7f-be50-86902b123b63 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:52.867061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf947b93-bbad-4e7f-be50-86902b123b63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:52.868484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf947b93-bbad-4e7f-be50-86902b123b63 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:52.881304 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd3f84-ea28-429a-90d1-6ab488ff4bc8 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:52.885491 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 316/656] 10.222.0.52 () {56 vars in 1139 bytes} [Thu Sep 15 00:31:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:52.886294 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf947b93-bbad-4e7f-be50-86902b123b63 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:52.909195 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:52.917339 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d7d3c-9b22-4f0d-ab03-5709e898f045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:52.917958 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d7d3c-9b22-4f0d-ab03-5709e898f045 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:52.918231 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d7d3c-9b22-4f0d-ab03-5709e898f045 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:52.918499 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d7d3c-9b22-4f0d-ab03-5709e898f045 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:52.925055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d7d3c-9b22-4f0d-ab03-5709e898f045 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:52.926476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d7d3c-9b22-4f0d-ab03-5709e898f045 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:52.937718 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-528d7d3c-9b22-4f0d-ab03-5709e898f045 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:52.937718 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:52.937718 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:52.937718 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:52.937718 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:52.937718 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:52.937718 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:52.937718 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:52.937718 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:52.937718 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:52.937718 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:52.937718 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:52.937718 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:31:52.937718 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:31:52.937718 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:31:52.939225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:31:52.939225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:52.939225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:52.939225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:52.939225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:52.939225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:52.939225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:52.939225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:52.939225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:52.939225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:52.939225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:52.939225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:52.939225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:52.939225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:52.939225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:52.939225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:52.939225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:52.940429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:31:52.940429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:31:52.940429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:31:52.940429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:31:52.940429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:31:52.940429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:31:52.940429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:52.940429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:52.941383 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 341/657] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:52.942704 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b6a91-1f5f-494a-b56e-5c584724ca2d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:52.943151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b6a91-1f5f-494a-b56e-5c584724ca2d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:52.943524 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b6a91-1f5f-494a-b56e-5c584724ca2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:52.961971 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-6d0b6a91-1f5f-494a-b56e-5c584724ca2d None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:52.963134 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6d0b6a91-1f5f-494a-b56e-5c584724ca2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:52.983330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf947b93-bbad-4e7f-be50-86902b123b63 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:53.003857 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:53.017191 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403f0ec-f881-468b-8625-90b3f19de95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:53.017804 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403f0ec-f881-468b-8625-90b3f19de95b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:53.018163 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403f0ec-f881-468b-8625-90b3f19de95b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:53.018352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403f0ec-f881-468b-8625-90b3f19de95b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:53.028679 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403f0ec-f881-468b-8625-90b3f19de95b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:53.029253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 342/658] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:53.030068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b6a91-1f5f-494a-b56e-5c584724ca2d None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:53.030198 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403f0ec-f881-468b-8625-90b3f19de95b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:53.046207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-c403f0ec-f881-468b-8625-90b3f19de95b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:53.046207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:53.046207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:53.046207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:53.046207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:53.046207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:53.046207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:53.046207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:53.046207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:53.046207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:53.046207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:53.046207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:53.046207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:53.046207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:53.046207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:53.046207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:53.047166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:53.047166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:53.047166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:53.047166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:53.047166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:53.047166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:53.047166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:53.047166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:53.047166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:53.047166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:53.047166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:53.047166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:53.047166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:53.047166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:53.047166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:53.047166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:53.047166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:53.048059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:53.048059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:53.048059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:53.048059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 317/659] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:53.048059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403f0ec-f881-468b-8625-90b3f19de95b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:53.124505 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:53.141697 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b6a91-1f5f-494a-b56e-5c584724ca2d None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:53.153361 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403f0ec-f881-468b-8625-90b3f19de95b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:53.176090 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce748d-3cd5-4b54-a7bd-cfccb8241707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:53.176690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce748d-3cd5-4b54-a7bd-cfccb8241707 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:53.176969 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce748d-3cd5-4b54-a7bd-cfccb8241707 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:53.177267 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce748d-3cd5-4b54-a7bd-cfccb8241707 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:53.178054 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce748d-3cd5-4b54-a7bd-cfccb8241707 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:53.178345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce748d-3cd5-4b54-a7bd-cfccb8241707 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:53.180286 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce748d-3cd5-4b54-a7bd-cfccb8241707 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:53.188655 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d04f05-6995-40f2-a0a0-5e91fd059693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:53.189617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d04f05-6995-40f2-a0a0-5e91fd059693 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:53.189617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d04f05-6995-40f2-a0a0-5e91fd059693 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:53.189890 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d04f05-6995-40f2-a0a0-5e91fd059693 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:53.202216 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 343/660] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Sep 15 00:31:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:53.202216 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce748d-3cd5-4b54-a7bd-cfccb8241707 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:53.234290 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:53.266381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d04f05-6995-40f2-a0a0-5e91fd059693 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:53.267967 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d04f05-6995-40f2-a0a0-5e91fd059693 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:53.309250 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce748d-3cd5-4b54-a7bd-cfccb8241707 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:53.344302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aad050-5e29-459c-938d-5bfbae49dd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:53.344911 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aad050-5e29-459c-938d-5bfbae49dd1a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:53.345224 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aad050-5e29-459c-938d-5bfbae49dd1a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:53.345491 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aad050-5e29-459c-938d-5bfbae49dd1a None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:53.346171 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aad050-5e29-459c-938d-5bfbae49dd1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:53.346472 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aad050-5e29-459c-938d-5bfbae49dd1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:53.346711 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:53.347934 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aad050-5e29-459c-938d-5bfbae49dd1a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:53.366280 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 344/661] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:31:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:53.366280 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aad050-5e29-459c-938d-5bfbae49dd1a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:53.376902 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 318/662] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:31:53.377721 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d04f05-6995-40f2-a0a0-5e91fd059693 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:53.458358 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:53.465531 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aad050-5e29-459c-938d-5bfbae49dd1a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:53.471350 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d04f05-6995-40f2-a0a0-5e91fd059693 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:53.499583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c184ba7-11fc-4e53-96d0-675309eafd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:53.500176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c184ba7-11fc-4e53-96d0-675309eafd90 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:53.500452 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c184ba7-11fc-4e53-96d0-675309eafd90 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:53.500719 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c184ba7-11fc-4e53-96d0-675309eafd90 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:53.501375 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c184ba7-11fc-4e53-96d0-675309eafd90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:53.501674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c184ba7-11fc-4e53-96d0-675309eafd90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:53.503009 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c184ba7-11fc-4e53-96d0-675309eafd90 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:53.505194 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca95040-2174-4d48-bc9d-1f0dfc990dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:53.505781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca95040-2174-4d48-bc9d-1f0dfc990dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:53.506058 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca95040-2174-4d48-bc9d-1f0dfc990dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:53.506330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca95040-2174-4d48-bc9d-1f0dfc990dd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:53.514888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 345/663] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:53.515727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c184ba7-11fc-4e53-96d0-675309eafd90 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:53.549004 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:53.574337 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca95040-2174-4d48-bc9d-1f0dfc990dd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:53.575852 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca95040-2174-4d48-bc9d-1f0dfc990dd8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:53.612290 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c184ba7-11fc-4e53-96d0-675309eafd90 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:53.644982 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06823607-ce80-4e58-b9f6-8658f036c2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:53.645569 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06823607-ce80-4e58-b9f6-8658f036c2db None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:53.645842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06823607-ce80-4e58-b9f6-8658f036c2db None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:53.646111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06823607-ce80-4e58-b9f6-8658f036c2db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:53.656397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06823607-ce80-4e58-b9f6-8658f036c2db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:53.661227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-06823607-ce80-4e58-b9f6-8658f036c2db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:53.661227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:53.661227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:53.661227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:53.661227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:53.661227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:53.661227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:53.661227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:53.661227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:53.661227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:53.661227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:53.661227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:53.661227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:53.661227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:53.661227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:53.661227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:53.662336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:53.662336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:53.662336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:53.662336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:53.662336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:53.662336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:53.662336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:53.662336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:53.662336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:53.662336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:53.662336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:53.662336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:53.662336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:53.662336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:53.662336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:53.662336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:53.663370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:53.663370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:53.663370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:53.663370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:53.663370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:53.663370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:53.663370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:53.663370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:53.663370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:53.663370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:53.663370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:31:53.663370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:53.667153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 346/664] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:31:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:53.667915 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06823607-ce80-4e58-b9f6-8658f036c2db None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:53.671620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 319/665] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:31:53.672468 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca95040-2174-4d48-bc9d-1f0dfc990dd8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:53.684944 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:53.745894 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:53.769343 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06823607-ce80-4e58-b9f6-8658f036c2db None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:53.771634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca95040-2174-4d48-bc9d-1f0dfc990dd8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:53.801399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557bf8a-1ba7-43a5-aa7b-918715dd09e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:53.801986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557bf8a-1ba7-43a5-aa7b-918715dd09e4 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:53.802258 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557bf8a-1ba7-43a5-aa7b-918715dd09e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:53.802525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557bf8a-1ba7-43a5-aa7b-918715dd09e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:53.803233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557bf8a-1ba7-43a5-aa7b-918715dd09e4 None admin] RBAC: Adding query filter params (role.id=e5b76a8345d542c2a899f8dbdd95290d, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=bfcfcf8061f24231858b9b0205a8abaa) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:53.803537 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557bf8a-1ba7-43a5-aa7b-918715dd09e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:53.805070 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467e403-95d0-4817-b5a8-ffbad22b3549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:53.805532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557bf8a-1ba7-43a5-aa7b-918715dd09e4 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:53.805699 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467e403-95d0-4817-b5a8-ffbad22b3549 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:53.805974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467e403-95d0-4817-b5a8-ffbad22b3549 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:53.806241 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467e403-95d0-4817-b5a8-ffbad22b3549 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:53.811034 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 347/666] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:31:53 2022] GET /identity/v3/role_assignments?user.id=bfcfcf8061f24231858b9b0205a8abaa&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=e5b76a8345d542c2a899f8dbdd95290d => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:53.811787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557bf8a-1ba7-43a5-aa7b-918715dd09e4 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:53.816589 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467e403-95d0-4817-b5a8-ffbad22b3549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:53.818229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467e403-95d0-4817-b5a8-ffbad22b3549 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:53.834986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-8467e403-95d0-4817-b5a8-ffbad22b3549 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:53.834986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:53.834986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:53.834986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:53.834986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:53.834986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:53.834986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:53.834986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:53.834986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:53.834986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:53.834986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:53.834986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:53.834986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:53.834986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:53.834986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:53.834986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:53.836682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:53.836682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:53.836682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:53.836682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:53.836682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:53.836682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:53.836682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:53.836682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:53.836682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:53.836682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:53.836682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:53.836682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:53.836682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:53.836682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:53.836682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:53.836682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:53.836682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:53.837798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:53.837798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:53.837798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:53.843268 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 320/667] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:53.843268 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467e403-95d0-4817-b5a8-ffbad22b3549 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:53.926219 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:53.946895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467e403-95d0-4817-b5a8-ffbad22b3549 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:53.951999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557bf8a-1ba7-43a5-aa7b-918715dd09e4 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:53.973644 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:53.983487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc096af6-15cf-4018-be5f-900a5a8a87f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:53.984349 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc096af6-15cf-4018-be5f-900a5a8a87f5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:53.984620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc096af6-15cf-4018-be5f-900a5a8a87f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:53.984886 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc096af6-15cf-4018-be5f-900a5a8a87f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:53.985584 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc096af6-15cf-4018-be5f-900a5a8a87f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:53.985881 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc096af6-15cf-4018-be5f-900a5a8a87f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:53.987232 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc096af6-15cf-4018-be5f-900a5a8a87f5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:53.996008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34212f02-21f7-482b-a55f-390a94095ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:53.996206 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 321/668] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 15 00:31:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:53.996844 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc096af6-15cf-4018-be5f-900a5a8a87f5 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:53.997151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34212f02-21f7-482b-a55f-390a94095ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:53.997650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34212f02-21f7-482b-a55f-390a94095ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:53.998073 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34212f02-21f7-482b-a55f-390a94095ba3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:54.006643 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34212f02-21f7-482b-a55f-390a94095ba3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:54.008137 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34212f02-21f7-482b-a55f-390a94095ba3 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:54.019751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-34212f02-21f7-482b-a55f-390a94095ba3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:54.019751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:54.019751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:54.019751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:54.019751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:54.019751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:54.019751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:54.019751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:54.019751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:54.019751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:54.019751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:54.019751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:54.019751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:31:54.019751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:31:54.019751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:31:54.020644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:31:54.020644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:54.020644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:54.020644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:54.020644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:54.020644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:54.020644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:54.020644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:54.020644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:54.020644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:54.020644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:54.020644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:54.020644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:54.020644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:54.020644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:54.020644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:54.020644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:54.021550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:31:54.021550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:31:54.021550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:31:54.021550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:31:54.021550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:31:54.021550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:31:54.021550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:54.021550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:54.021550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 348/669] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:54.022062 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34212f02-21f7-482b-a55f-390a94095ba3 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:54.110528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc096af6-15cf-4018-be5f-900a5a8a87f5 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:54.136863 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34212f02-21f7-482b-a55f-390a94095ba3 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:54.146727 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf99031-831c-4f0f-8009-ea67cd9b41a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:54.147463 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf99031-831c-4f0f-8009-ea67cd9b41a0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:54.147739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf99031-831c-4f0f-8009-ea67cd9b41a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:54.148667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf99031-831c-4f0f-8009-ea67cd9b41a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:54.159905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf99031-831c-4f0f-8009-ea67cd9b41a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:54.161499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf99031-831c-4f0f-8009-ea67cd9b41a0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:54.171505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94f41d-4449-4054-a0b5-b0dc2cad8296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:54.172110 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94f41d-4449-4054-a0b5-b0dc2cad8296 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:54.172392 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94f41d-4449-4054-a0b5-b0dc2cad8296 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:54.172666 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94f41d-4449-4054-a0b5-b0dc2cad8296 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:54.173419 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94f41d-4449-4054-a0b5-b0dc2cad8296 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:54.173726 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94f41d-4449-4054-a0b5-b0dc2cad8296 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:54.175071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94f41d-4449-4054-a0b5-b0dc2cad8296 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:54.175794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-dcf99031-831c-4f0f-8009-ea67cd9b41a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:54.175794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:54.175794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:54.175794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:54.175794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:54.175794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:54.175794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:54.175794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:54.175794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:54.175794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:54.175794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:54.175794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:54.175794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:54.175794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:54.175794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:54.175794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:54.176735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:54.176735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:54.176735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:54.176735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:54.176735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:54.176735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:54.176735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:54.176735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:54.176735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:54.176735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:54.176735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:54.176735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:54.176735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:54.176735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:54.176735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:54.176735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:54.176735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:54.178125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:54.178125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:54.178125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:54.178125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 322/670] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:54.178125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf99031-831c-4f0f-8009-ea67cd9b41a0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:54.187785 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:54.198599 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 349/671] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:54.198599 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94f41d-4449-4054-a0b5-b0dc2cad8296 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:54.234547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:54.297872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf99031-831c-4f0f-8009-ea67cd9b41a0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:54.306050 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94f41d-4449-4054-a0b5-b0dc2cad8296 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:54.332179 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dff632-4ba9-44f5-b548-09225614fe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:54.332797 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dff632-4ba9-44f5-b548-09225614fe37 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:54.333075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dff632-4ba9-44f5-b548-09225614fe37 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:54.333394 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dff632-4ba9-44f5-b548-09225614fe37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:54.344606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dff632-4ba9-44f5-b548-09225614fe37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:54.346111 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dff632-4ba9-44f5-b548-09225614fe37 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:54.352851 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594edca-4b7b-44c0-af04-21c16a9130b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:54.353924 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594edca-4b7b-44c0-af04-21c16a9130b7 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:54.354204 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594edca-4b7b-44c0-af04-21c16a9130b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:54.354563 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594edca-4b7b-44c0-af04-21c16a9130b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:54.355646 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594edca-4b7b-44c0-af04-21c16a9130b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:54.355952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594edca-4b7b-44c0-af04-21c16a9130b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:54.357535 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594edca-4b7b-44c0-af04-21c16a9130b7 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:54.361833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-57dff632-4ba9-44f5-b548-09225614fe37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:54.361833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:54.361833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:54.361833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:54.361833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:54.361833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:54.361833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:54.361833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:54.361833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:54.361833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:54.361833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:54.361833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:54.361833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:54.361833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:54.361833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:54.361833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:54.362732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:54.362732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:54.362732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:54.362732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:54.362732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:54.362732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:54.362732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:54.362732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:54.362732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:54.362732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:54.362732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:54.362732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:54.362732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:54.362732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:54.362732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:54.362732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:54.362732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:54.363653 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:54.363653 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:54.363653 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:54.363653 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 323/672] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:54.363873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dff632-4ba9-44f5-b548-09225614fe37 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:54.376069 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 350/673] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:31:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:54.381264 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594edca-4b7b-44c0-af04-21c16a9130b7 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:54.440218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:54.466088 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:54.477428 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dff632-4ba9-44f5-b548-09225614fe37 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:54.486247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594edca-4b7b-44c0-af04-21c16a9130b7 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:54.514308 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45392b9-db7e-43b7-8ce7-134ece17efaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:54.515144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45392b9-db7e-43b7-8ce7-134ece17efaf None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:54.515795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45392b9-db7e-43b7-8ce7-134ece17efaf None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:54.516143 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45392b9-db7e-43b7-8ce7-134ece17efaf None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:54.517053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45392b9-db7e-43b7-8ce7-134ece17efaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:54.517404 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45392b9-db7e-43b7-8ce7-134ece17efaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:54.518875 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45392b9-db7e-43b7-8ce7-134ece17efaf None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:54.520409 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcb551-f2b9-4b49-b503-17a6cbaeded6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:54.521547 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcb551-f2b9-4b49-b503-17a6cbaeded6 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:54.521892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcb551-f2b9-4b49-b503-17a6cbaeded6 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:54.522223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcb551-f2b9-4b49-b503-17a6cbaeded6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:54.530388 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bcb551-f2b9-4b49-b503-17a6cbaeded6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:54.531864 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bcb551-f2b9-4b49-b503-17a6cbaeded6 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:54.536669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 324/674] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:54.537722 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45392b9-db7e-43b7-8ce7-134ece17efaf None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:54.547397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-25bcb551-f2b9-4b49-b503-17a6cbaeded6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:54.547397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:54.547397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:54.547397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:54.547397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:54.547397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:54.547397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:54.547397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:54.547397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:54.547397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:54.547397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:54.547397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:54.547397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:31:54.547397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:31:54.547397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:31:54.548528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:31:54.548528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:54.548528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:54.548528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:54.548528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:54.548528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:54.548528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:54.548528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:54.548528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:54.548528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:54.548528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:54.548528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:54.548528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:54.548528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:54.548528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:54.548528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:54.548528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:54.549689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:31:54.549689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:31:54.549689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:31:54.549689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:31:54.549689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:31:54.549689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:31:54.549689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:54.549689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:54.555921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 351/675] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:54.555921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcb551-f2b9-4b49-b503-17a6cbaeded6 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:54.639946 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45392b9-db7e-43b7-8ce7-134ece17efaf None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:54.665821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcb551-f2b9-4b49-b503-17a6cbaeded6 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:54.672583 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1310fe-a10d-4ada-a1f9-67f87cd69c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:54.673289 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1310fe-a10d-4ada-a1f9-67f87cd69c3b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:54.673679 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1310fe-a10d-4ada-a1f9-67f87cd69c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:54.674047 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1310fe-a10d-4ada-a1f9-67f87cd69c3b None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:54.674789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1310fe-a10d-4ada-a1f9-67f87cd69c3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:54.675210 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1310fe-a10d-4ada-a1f9-67f87cd69c3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:54.676654 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1310fe-a10d-4ada-a1f9-67f87cd69c3b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:54.684534 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:54.693436 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 325/676] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:54.693436 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1310fe-a10d-4ada-a1f9-67f87cd69c3b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:54.709330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:54.714441 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e18bd-709a-429c-8b07-1f7992594954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:54.715034 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e18bd-709a-429c-8b07-1f7992594954 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:54.715312 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e18bd-709a-429c-8b07-1f7992594954 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:54.715578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e18bd-709a-429c-8b07-1f7992594954 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:54.716302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e18bd-709a-429c-8b07-1f7992594954 None admin] RBAC: Adding query filter params (role.id=e5b76a8345d542c2a899f8dbdd95290d, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=f12ce70a7c4f4396ab3fbb635dfc548b) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:54.716607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e18bd-709a-429c-8b07-1f7992594954 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:54.718077 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e18bd-709a-429c-8b07-1f7992594954 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:54.724105 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 352/677] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:31:54 2022] GET /identity/v3/role_assignments?user.id=f12ce70a7c4f4396ab3fbb635dfc548b&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=e5b76a8345d542c2a899f8dbdd95290d => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:54.724625 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e18bd-709a-429c-8b07-1f7992594954 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:54.826390 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1310fe-a10d-4ada-a1f9-67f87cd69c3b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:54.857739 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e18bd-709a-429c-8b07-1f7992594954 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:54.874085 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270e8fc-a956-40e7-87b2-b9b9c14c498b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:54.875168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270e8fc-a956-40e7-87b2-b9b9c14c498b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:54.875451 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270e8fc-a956-40e7-87b2-b9b9c14c498b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:54.875725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270e8fc-a956-40e7-87b2-b9b9c14c498b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:54.886247 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270e8fc-a956-40e7-87b2-b9b9c14c498b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:54.888470 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270e8fc-a956-40e7-87b2-b9b9c14c498b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:54.904045 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c9c0d-ee6b-45e7-bfc2-9c9f9378a1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:54.904690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-f270e8fc-a956-40e7-87b2-b9b9c14c498b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:54.904690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:54.904690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:54.904690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:54.904690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:54.904690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:54.904690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:54.904690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:54.904690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:54.904690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:54.904690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:54.904690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:54.904690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:31:54.904690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:31:54.904690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:31:54.905801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:31:54.905801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:54.905801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:54.905801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:54.905801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:54.905801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:54.905801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:54.905801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:54.905801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:54.905801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:54.905801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:54.905801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:54.905801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:54.905801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:54.905801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:54.905801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:54.905801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:54.906980 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:31:54.906980 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:31:54.906980 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:31:54.906980 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:31:54.906980 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:31:54.906980 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:31:54.906980 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:54.906980 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:54.907708 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c9c0d-ee6b-45e7-bfc2-9c9f9378a1ab None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:54.908117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c9c0d-ee6b-45e7-bfc2-9c9f9378a1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:54.908514 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c9c0d-ee6b-45e7-bfc2-9c9f9378a1ab None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:54.909376 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c9c0d-ee6b-45e7-bfc2-9c9f9378a1ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:54.909812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c9c0d-ee6b-45e7-bfc2-9c9f9378a1ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:54.910702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 326/678] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:54.911593 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270e8fc-a956-40e7-87b2-b9b9c14c498b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:54.912178 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c9c0d-ee6b-45e7-bfc2-9c9f9378a1ab None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:54.933392 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 353/679] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:31:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:54.934332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c9c0d-ee6b-45e7-bfc2-9c9f9378a1ab None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:54.994719 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:55.019517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:55.054419 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270e8fc-a956-40e7-87b2-b9b9c14c498b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:55.073901 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c9c0d-ee6b-45e7-bfc2-9c9f9378a1ab None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:55.092007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46eda6-4056-42e9-9247-169cdad58aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:55.092633 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46eda6-4056-42e9-9247-169cdad58aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:55.092914 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46eda6-4056-42e9-9247-169cdad58aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:55.093216 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46eda6-4056-42e9-9247-169cdad58aa8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:55.101023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46eda6-4056-42e9-9247-169cdad58aa8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:55.102558 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46eda6-4056-42e9-9247-169cdad58aa8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:55.112576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34845bd4-4719-4325-9a88-adefcd49d670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:55.113410 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34845bd4-4719-4325-9a88-adefcd49d670 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:55.113787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34845bd4-4719-4325-9a88-adefcd49d670 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:55.114156 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34845bd4-4719-4325-9a88-adefcd49d670 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:55.114926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-0c46eda6-4056-42e9-9247-169cdad58aa8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 00:31:55.114926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:55.114926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:55.114926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:55.114926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:55.114926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:55.114926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:55.114926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:55.114926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:55.114926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:55.114926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:55.114926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:55.114926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:31:55.114926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:31:55.114926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:31:55.114926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:31:55.115905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:55.115905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:55.115905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:31:55.115905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:55.115905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:31:55.115905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:55.115905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:55.115905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:55.115905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:55.115905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:55.115905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:55.115905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:55.115905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:55.115905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:55.115905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:55.115905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:55.115905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:55.115905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:55.117152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:55.117152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:55.117152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:31:55.117152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:31:55.117152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:31:55.117152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:31:55.117152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:31:55.117152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:31:55.117152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 00:31:55.117152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:55.117717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34845bd4-4719-4325-9a88-adefcd49d670 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:55.117717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34845bd4-4719-4325-9a88-adefcd49d670 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:55.117843 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 327/680] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:31:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:55.117910 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34845bd4-4719-4325-9a88-adefcd49d670 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:55.121862 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46eda6-4056-42e9-9247-169cdad58aa8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:55.133825 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 354/681] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:31:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:55.137821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34845bd4-4719-4325-9a88-adefcd49d670 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:55.249721 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46eda6-4056-42e9-9247-169cdad58aa8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:55.258877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34845bd4-4719-4325-9a88-adefcd49d670 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:55.279599 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:55.290668 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:55.298553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730a774-a82d-4b0d-80d3-c6474140cdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:55.299243 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730a774-a82d-4b0d-80d3-c6474140cdc4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:55.299597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730a774-a82d-4b0d-80d3-c6474140cdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:55.299947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730a774-a82d-4b0d-80d3-c6474140cdc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:55.300753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730a774-a82d-4b0d-80d3-c6474140cdc4 None admin] RBAC: Adding query filter params (role.id=e5b76a8345d542c2a899f8dbdd95290d, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=50ec251be76543b4ad97442664db6858) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:55.301269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730a774-a82d-4b0d-80d3-c6474140cdc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:55.302836 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4786dd-e284-4319-949e-50eab43bd1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:55.302960 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730a774-a82d-4b0d-80d3-c6474140cdc4 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:55.303744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4786dd-e284-4319-949e-50eab43bd1df None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:55.304734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4786dd-e284-4319-949e-50eab43bd1df None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:55.305229 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4786dd-e284-4319-949e-50eab43bd1df None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:55.306368 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4786dd-e284-4319-949e-50eab43bd1df None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:55.307477 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4786dd-e284-4319-949e-50eab43bd1df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:55.309383 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4786dd-e284-4319-949e-50eab43bd1df None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:55.310487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 328/682] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:31:55 2022] GET /identity/v3/role_assignments?user.id=50ec251be76543b4ad97442664db6858&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=e5b76a8345d542c2a899f8dbdd95290d => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:55.311389 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730a774-a82d-4b0d-80d3-c6474140cdc4 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:55.337037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 355/683] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Sep 15 00:31:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:55.343500 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4786dd-e284-4319-949e-50eab43bd1df None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:55.479297 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730a774-a82d-4b0d-80d3-c6474140cdc4 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:55.550177 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1ada2-8cac-47e9-9127-0640bb2708d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:55.550740 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1ada2-8cac-47e9-9127-0640bb2708d3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:55.550984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1ada2-8cac-47e9-9127-0640bb2708d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:55.551254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1ada2-8cac-47e9-9127-0640bb2708d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:55.551981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1ada2-8cac-47e9-9127-0640bb2708d3 None admin] RBAC: Adding query filter params (role.id=e5b76a8345d542c2a899f8dbdd95290d, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=a8e11feaab0c4d29b78b2e9273e5d2ce) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:55.552292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1ada2-8cac-47e9-9127-0640bb2708d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:55.553764 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1ada2-8cac-47e9-9127-0640bb2708d3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:55.562970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 329/684] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:31:55 2022] GET /identity/v3/role_assignments?user.id=a8e11feaab0c4d29b78b2e9273e5d2ce&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=e5b76a8345d542c2a899f8dbdd95290d => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:55.569126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4786dd-e284-4319-949e-50eab43bd1df None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:55.615170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cc055-42a0-494c-9e57-34c1a2a42357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:55.615841 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cc055-42a0-494c-9e57-34c1a2a42357 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:55.616124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cc055-42a0-494c-9e57-34c1a2a42357 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:55.616395 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cc055-42a0-494c-9e57-34c1a2a42357 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:55.658594 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:55.722062 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cc055-42a0-494c-9e57-34c1a2a42357 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:55.723907 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cc055-42a0-494c-9e57-34c1a2a42357 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:55.849807 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 356/685] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:31:55.856138 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1ada2-8cac-47e9-9127-0640bb2708d3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:55.926132 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:55.977259 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1ada2-8cac-47e9-9127-0640bb2708d3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:56.016421 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b8a85-14c1-4de8-bbee-21e42df42420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:56.017053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b8a85-14c1-4de8-bbee-21e42df42420 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:56.017364 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b8a85-14c1-4de8-bbee-21e42df42420 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:56.017642 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b8a85-14c1-4de8-bbee-21e42df42420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:56.030384 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b8a85-14c1-4de8-bbee-21e42df42420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:56.031852 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b8a85-14c1-4de8-bbee-21e42df42420 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:56.048049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-dc6b8a85-14c1-4de8-bbee-21e42df42420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:56.048049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:56.048049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:56.048049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:56.048049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:56.048049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:56.048049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:56.048049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:56.048049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:56.048049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:56.048049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:56.048049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:56.048049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:56.048049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:56.048049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:56.048049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:56.048994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:56.048994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:56.048994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:56.048994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:56.048994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:56.048994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:56.048994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:56.048994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:56.048994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:56.048994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:56.048994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:56.048994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:56.048994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:56.048994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:56.048994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:56.048994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:56.048994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:56.049931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:56.049931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:56.049931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:56.049931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 330/686] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:56.055767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cc055-42a0-494c-9e57-34c1a2a42357 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:56.122178 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cb146-1359-41d5-8782-2fce2c5fbbb4 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:56.122383 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cb146-1359-41d5-8782-2fce2c5fbbb4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:56.122653 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cb146-1359-41d5-8782-2fce2c5fbbb4 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:56.124232 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 331/687] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:31:56.135900 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f9720-5274-422f-b97b-33f152996f24 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:56.136178 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f9720-5274-422f-b97b-33f152996f24 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:56.136447 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f9720-5274-422f-b97b-33f152996f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:56.169327 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c42f9720-5274-422f-b97b-33f152996f24 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:56.172006 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c42f9720-5274-422f-b97b-33f152996f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:56.173042 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:56.217959 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cc055-42a0-494c-9e57-34c1a2a42357 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:56.262375 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf09376-0c8c-4ece-8358-e30784cc0d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:56.264087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf09376-0c8c-4ece-8358-e30784cc0d02 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:56.264517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf09376-0c8c-4ece-8358-e30784cc0d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:56.264946 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf09376-0c8c-4ece-8358-e30784cc0d02 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:56.265830 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf09376-0c8c-4ece-8358-e30784cc0d02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:56.266268 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf09376-0c8c-4ece-8358-e30784cc0d02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:56.267760 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf09376-0c8c-4ece-8358-e30784cc0d02 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:56.282555 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 357/688] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:56.290595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf09376-0c8c-4ece-8358-e30784cc0d02 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:56.314220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 332/689] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 15 00:31:56.434484 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf09376-0c8c-4ece-8358-e30784cc0d02 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:56.458769 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:56.477633 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813701dc-619c-4bab-989b-275bbef9525d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:56.478399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813701dc-619c-4bab-989b-275bbef9525d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:56.478686 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813701dc-619c-4bab-989b-275bbef9525d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:56.478957 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813701dc-619c-4bab-989b-275bbef9525d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:56.490843 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813701dc-619c-4bab-989b-275bbef9525d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:56.492383 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813701dc-619c-4bab-989b-275bbef9525d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:56.511117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-813701dc-619c-4bab-989b-275bbef9525d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:56.511117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:56.511117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:56.511117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:56.511117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:56.511117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:56.511117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:56.511117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:56.511117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:56.511117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:56.511117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:56.511117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:56.511117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:31:56.511117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:31:56.511117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:31:56.512028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:31:56.512028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:56.512028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:56.512028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:56.512028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:56.512028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:56.512028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:56.512028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:56.512028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:56.512028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:56.512028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:56.512028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:56.512028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:56.512028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:56.512028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:56.512028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:56.512028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:56.512933 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:31:56.512933 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:31:56.512933 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:31:56.512933 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:31:56.512933 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:31:56.512933 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:31:56.512933 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:56.512933 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:56.512933 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 358/690] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:56.518072 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f9720-5274-422f-b97b-33f152996f24 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:56.563068 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:56.622630 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f9720-5274-422f-b97b-33f152996f24 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:56.657997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5f000-dd32-4733-910e-58241151e0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:56.658609 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5f000-dd32-4733-910e-58241151e0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:56.658888 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5f000-dd32-4733-910e-58241151e0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:56.659159 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5f000-dd32-4733-910e-58241151e0f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:56.659905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5f000-dd32-4733-910e-58241151e0f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:56.660213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5f000-dd32-4733-910e-58241151e0f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:56.661672 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5f000-dd32-4733-910e-58241151e0f8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:56.673917 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 333/691] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:31:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:56.682225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813701dc-619c-4bab-989b-275bbef9525d None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:56.760538 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5f000-dd32-4733-910e-58241151e0f8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:56.830225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813701dc-619c-4bab-989b-275bbef9525d None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:56.871082 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f46ac8-135a-4d8e-8558-3f30db78bf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:56.872308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f46ac8-135a-4d8e-8558-3f30db78bf2f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:56.872849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f46ac8-135a-4d8e-8558-3f30db78bf2f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:56.873384 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f46ac8-135a-4d8e-8558-3f30db78bf2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:56.874742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f46ac8-135a-4d8e-8558-3f30db78bf2f None admin] RBAC: Adding query filter params (role.id=e5b76a8345d542c2a899f8dbdd95290d, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=5fb248b85aba45b39132d0f92ede0b68) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:56.875397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f46ac8-135a-4d8e-8558-3f30db78bf2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:56.877036 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f46ac8-135a-4d8e-8558-3f30db78bf2f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:56.884260 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 359/692] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:31:56 2022] GET /identity/v3/role_assignments?user.id=5fb248b85aba45b39132d0f92ede0b68&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=e5b76a8345d542c2a899f8dbdd95290d => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:56.965588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5f000-dd32-4733-910e-58241151e0f8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:56.967573 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:57.019619 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95289a2a-190b-4a89-b089-34110289bf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:57.020164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95289a2a-190b-4a89-b089-34110289bf32 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:57.020438 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95289a2a-190b-4a89-b089-34110289bf32 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:57.020705 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95289a2a-190b-4a89-b089-34110289bf32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:57.041134 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95289a2a-190b-4a89-b089-34110289bf32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:31:57.045921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-95289a2a-190b-4a89-b089-34110289bf32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:31:57.045921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:57.045921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:57.045921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:57.045921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:57.045921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:57.045921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:57.045921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:57.045921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:57.045921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:57.045921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:57.045921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:57.045921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:31:57.045921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:31:57.045921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:31:57.045921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:31:57.046869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:31:57.046869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:31:57.046869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:31:57.046869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:31:57.046869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:57.046869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:57.046869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:57.046869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:57.046869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:57.046869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:57.046869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:57.046869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:57.046869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:57.046869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:57.046869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:57.046869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:57.047724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:57.047724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:57.047724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:57.047724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:57.047724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:31:57.047724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:31:57.047724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:31:57.047724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:31:57.047724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:31:57.047724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:31:57.047724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:31:57.047724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:57.047724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 334/693] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:31:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:31:57.053298 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f46ac8-135a-4d8e-8558-3f30db78bf2f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:57.157872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:57.223456 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f46ac8-135a-4d8e-8558-3f30db78bf2f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:57.269050 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3316ec-238d-4e35-8935-2b2366a699b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:57.270720 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3316ec-238d-4e35-8935-2b2366a699b9 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:57.271426 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3316ec-238d-4e35-8935-2b2366a699b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:57.272118 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3316ec-238d-4e35-8935-2b2366a699b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:57.274106 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3316ec-238d-4e35-8935-2b2366a699b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:57.274660 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3316ec-238d-4e35-8935-2b2366a699b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:57.277048 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3316ec-238d-4e35-8935-2b2366a699b9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:57.289040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 360/694] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:31:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:57.298486 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95289a2a-190b-4a89-b089-34110289bf32 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:57.404467 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60128c9-7901-4eb2-9ceb-b9556b5460c6 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:57.405161 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60128c9-7901-4eb2-9ceb-b9556b5460c6 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:57.405649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60128c9-7901-4eb2-9ceb-b9556b5460c6 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:57.407432 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 361/695] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:31:57.412746 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98522ef4-298e-4645-a8de-81d344773434 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:57.413934 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98522ef4-298e-4645-a8de-81d344773434 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:57.414407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98522ef4-298e-4645-a8de-81d344773434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:57.436698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-98522ef4-298e-4645-a8de-81d344773434 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:57.438686 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-98522ef4-298e-4645-a8de-81d344773434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:57.458872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95289a2a-190b-4a89-b089-34110289bf32 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:57.511649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e78200-9b8a-4c7f-91f9-b394b21e801e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:57.512676 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e78200-9b8a-4c7f-91f9-b394b21e801e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:57.513196 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e78200-9b8a-4c7f-91f9-b394b21e801e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:57.514217 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e78200-9b8a-4c7f-91f9-b394b21e801e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:57.528588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e78200-9b8a-4c7f-91f9-b394b21e801e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:57.530954 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e78200-9b8a-4c7f-91f9-b394b21e801e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:57.539427 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 362/696] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:31:57.549854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-d5e78200-9b8a-4c7f-91f9-b394b21e801e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:57.549854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:57.549854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:57.549854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:57.549854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:57.549854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:57.549854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:57.549854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:57.549854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:57.549854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:57.549854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:57.549854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:57.549854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:57.549854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:57.549854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:57.549854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:57.550808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:57.550808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:57.550808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:57.550808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:57.550808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:57.550808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:57.550808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:57.550808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:57.550808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:57.550808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:57.550808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:57.550808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:57.550808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:57.550808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:57.550808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:57.550808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:57.550808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:57.551748 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:57.551748 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:57.551748 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:57.553841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 335/697] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:57.560636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98522ef4-298e-4645-a8de-81d344773434 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:57.616051 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:57.702076 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98522ef4-298e-4645-a8de-81d344773434 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:57.736622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce52105-e695-4fc3-b33a-77f30a2bec31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:57.737260 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce52105-e695-4fc3-b33a-77f30a2bec31 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:57.737541 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce52105-e695-4fc3-b33a-77f30a2bec31 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:57.737816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce52105-e695-4fc3-b33a-77f30a2bec31 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:57.738458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce52105-e695-4fc3-b33a-77f30a2bec31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:57.738765 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce52105-e695-4fc3-b33a-77f30a2bec31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:57.740128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce52105-e695-4fc3-b33a-77f30a2bec31 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:57.756806 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 363/698] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:57.758756 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e78200-9b8a-4c7f-91f9-b394b21e801e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:57.780858 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:57.879118 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e78200-9b8a-4c7f-91f9-b394b21e801e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:57.918999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d18ac-1276-4d4a-a43d-024f5e46c9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:57.919621 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d18ac-1276-4d4a-a43d-024f5e46c9f7 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:57.919897 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d18ac-1276-4d4a-a43d-024f5e46c9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:57.920168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d18ac-1276-4d4a-a43d-024f5e46c9f7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:57.928094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d18ac-1276-4d4a-a43d-024f5e46c9f7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:57.930265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d18ac-1276-4d4a-a43d-024f5e46c9f7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:57.945765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-ae2d18ac-1276-4d4a-a43d-024f5e46c9f7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 00:31:57.945765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:57.945765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:57.945765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:57.945765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:57.945765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:57.945765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:57.945765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:57.945765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:57.945765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:57.945765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:57.945765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:57.945765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:31:57.945765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:31:57.945765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:31:57.945765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:31:57.946747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:57.946747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:57.946747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:31:57.946747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:57.946747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:31:57.946747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:31:57.946747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:57.946747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:57.946747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:57.946747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:57.946747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:57.946747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:57.946747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:57.946747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:57.946747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:57.946747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:57.946747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:57.946747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:57.947713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:57.947713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:57.947713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:31:57.947713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:31:57.947713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:31:57.947713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:31:57.947713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:31:57.947713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:31:57.947713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 00:31:57.947713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:57.951470 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 336/699] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Sep 15 00:31:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:57.952875 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce52105-e695-4fc3-b33a-77f30a2bec31 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:58.008411 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d18ac-1276-4d4a-a43d-024f5e46c9f7 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:58.093708 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:58.097458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce52105-e695-4fc3-b33a-77f30a2bec31 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:58.136853 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b79281-c1f3-4261-bc59-510a5828fe90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:58.137496 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b79281-c1f3-4261-bc59-510a5828fe90 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:58.137775 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b79281-c1f3-4261-bc59-510a5828fe90 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:58.138045 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b79281-c1f3-4261-bc59-510a5828fe90 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:58.139182 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b79281-c1f3-4261-bc59-510a5828fe90 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:58.139493 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b79281-c1f3-4261-bc59-510a5828fe90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:58.140963 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b79281-c1f3-4261-bc59-510a5828fe90 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:58.165171 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 364/700] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Sep 15 00:31:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:31:58.167961 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a5abd-f3dc-47c0-bd5d-42e39f40dd79 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:58.168254 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a5abd-f3dc-47c0-bd5d-42e39f40dd79 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:58.168525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a5abd-f3dc-47c0-bd5d-42e39f40dd79 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:58.170069 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 365/701] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:58.170778 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a5abd-f3dc-47c0-bd5d-42e39f40dd79 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:58.188223 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:58.216350 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d18ac-1276-4d4a-a43d-024f5e46c9f7 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:58.253330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d4f2d-98cf-4c0a-b132-2cd07e6613c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:58.254292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d4f2d-98cf-4c0a-b132-2cd07e6613c2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:58.254751 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d4f2d-98cf-4c0a-b132-2cd07e6613c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:58.255244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d4f2d-98cf-4c0a-b132-2cd07e6613c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:58.268379 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d4f2d-98cf-4c0a-b132-2cd07e6613c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:58.270370 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d4f2d-98cf-4c0a-b132-2cd07e6613c2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:58.287620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-449d4f2d-98cf-4c0a-b132-2cd07e6613c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:58.287620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:58.287620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:58.287620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:58.287620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:58.287620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:58.287620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:58.287620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:58.287620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:58.287620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:58.287620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:58.287620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:58.287620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:58.287620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:58.287620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:58.287620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:58.289229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:58.289229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:58.289229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:58.289229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:58.289229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:58.289229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:58.289229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:58.289229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:58.289229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:58.289229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:58.289229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:58.289229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:58.289229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:58.289229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:58.289229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:58.289229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:58.289229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:58.290170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:58.290170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:58.290170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:58.292452 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 337/702] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:31:58.294121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69da5a1-ad2b-4b7c-a7f2-b0f603db38a6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:58.294590 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69da5a1-ad2b-4b7c-a7f2-b0f603db38a6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:58.295038 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69da5a1-ad2b-4b7c-a7f2-b0f603db38a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:58.299885 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a5abd-f3dc-47c0-bd5d-42e39f40dd79 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:58.314650 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f69da5a1-ad2b-4b7c-a7f2-b0f603db38a6 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:58.316112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f69da5a1-ad2b-4b7c-a7f2-b0f603db38a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:58.347926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05084416-cb88-4977-a759-50d477e3f988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:58.348599 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05084416-cb88-4977-a759-50d477e3f988 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:58.348949 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05084416-cb88-4977-a759-50d477e3f988 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:58.349349 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05084416-cb88-4977-a759-50d477e3f988 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:58.379663 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:58.396518 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 338/703] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:58.397665 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69da5a1-ad2b-4b7c-a7f2-b0f603db38a6 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:58.449218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05084416-cb88-4977-a759-50d477e3f988 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:58.451026 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05084416-cb88-4977-a759-50d477e3f988 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:58.461229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:58.507978 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69da5a1-ad2b-4b7c-a7f2-b0f603db38a6 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:58.542764 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4481a0-11e5-41ef-b2c0-91bd0fbb91b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:58.543506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4481a0-11e5-41ef-b2c0-91bd0fbb91b8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:58.543886 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4481a0-11e5-41ef-b2c0-91bd0fbb91b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:58.544444 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4481a0-11e5-41ef-b2c0-91bd0fbb91b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:58.545060 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4481a0-11e5-41ef-b2c0-91bd0fbb91b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:58.545497 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4481a0-11e5-41ef-b2c0-91bd0fbb91b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:58.546951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4481a0-11e5-41ef-b2c0-91bd0fbb91b8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:58.559308 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 339/704] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:58.560817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672df94-274f-47c8-b8b3-d7f056e3134f None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:58.563218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672df94-274f-47c8-b8b3-d7f056e3134f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:58.563218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672df94-274f-47c8-b8b3-d7f056e3134f None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:58.563546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 340/705] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:58.564404 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672df94-274f-47c8-b8b3-d7f056e3134f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:58.583668 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 366/706] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:31:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:31:58.584909 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9606b3-cf07-4ebb-8e33-4c7253dabc7a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:58.585257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9606b3-cf07-4ebb-8e33-4c7253dabc7a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:58.585534 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9606b3-cf07-4ebb-8e33-4c7253dabc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:58.607059 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-1a9606b3-cf07-4ebb-8e33-4c7253dabc7a None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:58.608350 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1a9606b3-cf07-4ebb-8e33-4c7253dabc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:58.667481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:58.680877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672df94-274f-47c8-b8b3-d7f056e3134f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:58.688780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 367/707] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:31:58.693762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9606b3-cf07-4ebb-8e33-4c7253dabc7a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:58.709076 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:58.734493 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefa53c-47bc-4201-a5c7-124fac79037f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:58.735140 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefa53c-47bc-4201-a5c7-124fac79037f None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:58.735416 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefa53c-47bc-4201-a5c7-124fac79037f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:58.735690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefa53c-47bc-4201-a5c7-124fac79037f None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:58.736391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefa53c-47bc-4201-a5c7-124fac79037f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:58.738406 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefa53c-47bc-4201-a5c7-124fac79037f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:58.773114 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 341/708] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 15 00:31:58 2022] POST /identity/v3/users => generated 254 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:31:58.773114 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefa53c-47bc-4201-a5c7-124fac79037f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:58.849117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9606b3-cf07-4ebb-8e33-4c7253dabc7a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:58.919223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644aea0-28ff-47ab-8a1b-bfaf0e1b9166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:58.920016 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644aea0-28ff-47ab-8a1b-bfaf0e1b9166 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:58.921016 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644aea0-28ff-47ab-8a1b-bfaf0e1b9166 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:58.921683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644aea0-28ff-47ab-8a1b-bfaf0e1b9166 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:58.946438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644aea0-28ff-47ab-8a1b-bfaf0e1b9166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:58.947918 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644aea0-28ff-47ab-8a1b-bfaf0e1b9166 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:58.968002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-5644aea0-28ff-47ab-8a1b-bfaf0e1b9166 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:58.968002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:58.968002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:58.968002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:58.968002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:58.968002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:58.968002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:58.968002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:58.968002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:58.968002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:58.968002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:58.968002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:58.968002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:31:58.968002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:31:58.968002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:31:58.968002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:31:58.969166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:58.969166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:58.969166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:58.969166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:58.969166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:58.969166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:58.969166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:58.969166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:58.969166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:58.969166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:58.969166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:58.969166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:58.969166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:58.969166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:58.969166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:58.969166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:58.969166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:31:58.970545 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:31:58.970545 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:31:58.970545 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:31:58.970545 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 368/709] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:31:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:58.974759 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644aea0-28ff-47ab-8a1b-bfaf0e1b9166 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:58.974985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefa53c-47bc-4201-a5c7-124fac79037f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:59.022157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1eb53-cb2d-4410-936e-02b3c4debf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:59.023343 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1eb53-cb2d-4410-936e-02b3c4debf40 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:59.023621 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1eb53-cb2d-4410-936e-02b3c4debf40 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:59.023891 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1eb53-cb2d-4410-936e-02b3c4debf40 None admin] PATH_INFO: `/v3/services/network` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:59.024470 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1eb53-cb2d-4410-936e-02b3c4debf40 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:59.025910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1eb53-cb2d-4410-936e-02b3c4debf40 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:59.028713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:59.041103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-c0d1eb53-cb2d-4410-936e-02b3c4debf40 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 00:31:59.041103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:59.041103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:31:59.041103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:31:59.041103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:31:59.041103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:31:59.041103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:31:59.041103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:31:59.041103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 00:31:59.041103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:59.041103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:31:59.041103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:59.041103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:59.041103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:59.041103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:59.041103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:59.041103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:59.042164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:59.042164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:59.042164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:59.042164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:59.042164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:59.042164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:59.042164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:31:59.042164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:31:59.042164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:31:59.042164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:31:59.042164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:59.042164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:59.042164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:59.042164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:59.042164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:59.042164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:59.043169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:59.043169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:59.043169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:59.043169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:59.043169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:59.043169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:59.043169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:59.043169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:59.043169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:59.043169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:59.043169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:31:59.043169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:31:59.043169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 00:31:59.043169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:59.043169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 342/710] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:58 2022] GET /identity/v3/services/network => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:59.044008 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1eb53-cb2d-4410-936e-02b3c4debf40 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:59.092260 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:59.136738 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644aea0-28ff-47ab-8a1b-bfaf0e1b9166 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:59.175889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a0866-634f-4db7-a504-f4d6b1ced4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:59.177252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a0866-634f-4db7-a504-f4d6b1ced4d4 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:59.177525 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1eb53-cb2d-4410-936e-02b3c4debf40 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:59.177888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a0866-634f-4db7-a504-f4d6b1ced4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:59.178301 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a0866-634f-4db7-a504-f4d6b1ced4d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:59.179121 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a0866-634f-4db7-a504-f4d6b1ced4d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:59.179636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a0866-634f-4db7-a504-f4d6b1ced4d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:59.181294 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a0866-634f-4db7-a504-f4d6b1ced4d4 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:59.195342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 369/711] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:31:59.200851 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a0866-634f-4db7-a504-f4d6b1ced4d4 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:59.221735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee9ac5-54cc-4ac9-adcd-2e3d1ba60e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:59.223471 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee9ac5-54cc-4ac9-adcd-2e3d1ba60e32 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:59.225498 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee9ac5-54cc-4ac9-adcd-2e3d1ba60e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:59.226542 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee9ac5-54cc-4ac9-adcd-2e3d1ba60e32 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:59.227784 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee9ac5-54cc-4ac9-adcd-2e3d1ba60e32 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:59.229615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee9ac5-54cc-4ac9-adcd-2e3d1ba60e32 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:59.243639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-e7ee9ac5-54cc-4ac9-adcd-2e3d1ba60e32 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 00:31:59.243639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:59.243639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:31:59.243639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:31:59.243639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:31:59.243639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:31:59.243639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:31:59.243639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:31:59.243639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 00:31:59.243639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:59.243639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:31:59.243639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:59.243639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:59.243639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:59.243639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:59.243639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:59.243639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:59.244735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:59.244735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:59.244735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:59.244735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:59.244735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:59.244735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:59.244735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:31:59.244735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:31:59.244735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:31:59.244735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:31:59.244735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:59.244735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:59.244735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:59.244735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:59.244735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:59.244735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:59.245612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:59.245612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:59.245612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:59.245612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:59.245612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:59.245612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:59.245612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:59.245612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:59.245612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:59.245612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:59.245612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:31:59.245612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:31:59.245612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 00:31:59.245612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:59.249758 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 343/712] 10.222.0.52 () {56 vars in 1129 bytes} [Thu Sep 15 00:31:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:59.250611 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee9ac5-54cc-4ac9-adcd-2e3d1ba60e32 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:59.325661 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:59.334997 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a0866-634f-4db7-a504-f4d6b1ced4d4 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:59.378397 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:59.381465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bd7a0-9984-465a-abe1-7e4efb29b80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:59.382853 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bd7a0-9984-465a-abe1-7e4efb29b80b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:59.383294 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bd7a0-9984-465a-abe1-7e4efb29b80b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:59.383754 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee9ac5-54cc-4ac9-adcd-2e3d1ba60e32 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:59.383886 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bd7a0-9984-465a-abe1-7e4efb29b80b None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:59.384636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bd7a0-9984-465a-abe1-7e4efb29b80b None admin] RBAC: Adding query filter params (name=network) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:59.385078 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bd7a0-9984-465a-abe1-7e4efb29b80b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:59.387727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bd7a0-9984-465a-abe1-7e4efb29b80b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:59.397461 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 370/713] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 15 00:31:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:59.400328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bd7a0-9984-465a-abe1-7e4efb29b80b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:59.426148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001c581-78f6-4a39-958a-f58dd76d07fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:59.426695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001c581-78f6-4a39-958a-f58dd76d07fa None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:59.426973 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001c581-78f6-4a39-958a-f58dd76d07fa None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:59.427242 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001c581-78f6-4a39-958a-f58dd76d07fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:59.434523 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001c581-78f6-4a39-958a-f58dd76d07fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:59.435967 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001c581-78f6-4a39-958a-f58dd76d07fa None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:59.448982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-3001c581-78f6-4a39-958a-f58dd76d07fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:59.448982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:31:59.448982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:31:59.448982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:31:59.448982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:31:59.448982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:31:59.448982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:31:59.448982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:31:59.448982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:31:59.448982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:31:59.448982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:31:59.448982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:31:59.448982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:31:59.448982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:31:59.448982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:31:59.449923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:31:59.449923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:31:59.449923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:31:59.449923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:31:59.449923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:31:59.449923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:31:59.449923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:31:59.449923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:31:59.449923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:31:59.449923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:31:59.449923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:31:59.449923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:31:59.449923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:31:59.449923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:31:59.449923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:31:59.449923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:31:59.449923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:31:59.450861 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:31:59.450861 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:31:59.450861 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:31:59.450861 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:31:59.450861 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:31:59.450861 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:31:59.450861 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:31:59.450861 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:31:59.454859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 344/714] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:31:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:31:59.455718 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001c581-78f6-4a39-958a-f58dd76d07fa None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:59.537062 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bd7a0-9984-465a-abe1-7e4efb29b80b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:59.561907 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001c581-78f6-4a39-958a-f58dd76d07fa None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:59.585898 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed82ab-defa-48dd-b780-2aaf3f6d7ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:59.587511 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed82ab-defa-48dd-b780-2aaf3f6d7ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:59.587986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed82ab-defa-48dd-b780-2aaf3f6d7ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:59.588666 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed82ab-defa-48dd-b780-2aaf3f6d7ed8 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:59.589746 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed82ab-defa-48dd-b780-2aaf3f6d7ed8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:59.590227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed82ab-defa-48dd-b780-2aaf3f6d7ed8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:59.592427 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed82ab-defa-48dd-b780-2aaf3f6d7ed8 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:59.603417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d30efe-c311-44db-93ac-2b5792b25c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:59.603417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d30efe-c311-44db-93ac-2b5792b25c13 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:59.603417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d30efe-c311-44db-93ac-2b5792b25c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:59.603417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d30efe-c311-44db-93ac-2b5792b25c13 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:59.603852 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d30efe-c311-44db-93ac-2b5792b25c13 None admin] RBAC: Adding query filter params (type=network) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:59.603852 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d30efe-c311-44db-93ac-2b5792b25c13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:59.603852 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d30efe-c311-44db-93ac-2b5792b25c13 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:59.604789 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 371/715] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Sep 15 00:31:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:59.605943 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed82ab-defa-48dd-b780-2aaf3f6d7ed8 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:59.610259 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 345/716] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 15 00:31:59 2022] GET /identity/v3/services?type=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:59.612175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d30efe-c311-44db-93ac-2b5792b25c13 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:59.660379 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:59.666427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:59.779572 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed82ab-defa-48dd-b780-2aaf3f6d7ed8 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:59.783065 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d30efe-c311-44db-93ac-2b5792b25c13 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:31:59.821513 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466dcb47-1fcc-41b1-a91d-097ada20ec17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:59.821777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b60aad-9130-40c1-9220-58a23bc4e5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:31:59.822137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b60aad-9130-40c1-9220-58a23bc4e5cf None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:59.822237 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dcb47-1fcc-41b1-a91d-097ada20ec17 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:59.822414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dcb47-1fcc-41b1-a91d-097ada20ec17 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:59.822549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b60aad-9130-40c1-9220-58a23bc4e5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:59.822698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b60aad-9130-40c1-9220-58a23bc4e5cf None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:59.822787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dcb47-1fcc-41b1-a91d-097ada20ec17 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:59.823337 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b60aad-9130-40c1-9220-58a23bc4e5cf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:59.823439 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466dcb47-1fcc-41b1-a91d-097ada20ec17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:31:59.823640 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b60aad-9130-40c1-9220-58a23bc4e5cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:59.823743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466dcb47-1fcc-41b1-a91d-097ada20ec17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:31:59.825057 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b60aad-9130-40c1-9220-58a23bc4e5cf None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:59.825192 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466dcb47-1fcc-41b1-a91d-097ada20ec17 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:31:59.831830 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 346/717] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Sep 15 00:31:59 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:59.832254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddc6de-4979-4da7-ab60-13a64c0dbb0f None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:59.832541 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddc6de-4979-4da7-ab60-13a64c0dbb0f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:59.832814 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddc6de-4979-4da7-ab60-13a64c0dbb0f None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:59.834318 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 347/718] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:31:59.844818 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 372/719] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:31:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:31:59.846348 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f39a96-9c77-416f-a083-6acfdc44202c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:31:59.846636 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f39a96-9c77-416f-a083-6acfdc44202c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:31:59.846906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f39a96-9c77-416f-a083-6acfdc44202c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:31:59.851578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466dcb47-1fcc-41b1-a91d-097ada20ec17 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:31:59.877116 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-22f39a96-9c77-416f-a083-6acfdc44202c None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:31:59.877116 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-22f39a96-9c77-416f-a083-6acfdc44202c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:31:59.983703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:31:59.991872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 348/720] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:31:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 00:32:00.005387 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466dcb47-1fcc-41b1-a91d-097ada20ec17 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:00.046881 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06ca6c-36a6-40a7-a0b2-7d408abcce71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:00.047406 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06ca6c-36a6-40a7-a0b2-7d408abcce71 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:00.047680 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06ca6c-36a6-40a7-a0b2-7d408abcce71 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:00.047947 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06ca6c-36a6-40a7-a0b2-7d408abcce71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:00.049527 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06ca6c-36a6-40a7-a0b2-7d408abcce71 None admin] RBAC: Adding query filter params (role.id=0ee2daa9cb3c41fb901603e3d8caf784, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=bfcfcf8061f24231858b9b0205a8abaa) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:00.049527 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06ca6c-36a6-40a7-a0b2-7d408abcce71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:00.050466 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06ca6c-36a6-40a7-a0b2-7d408abcce71 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:00.057068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 373/721] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:31:59 2022] GET /identity/v3/role_assignments?user.id=bfcfcf8061f24231858b9b0205a8abaa&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=0ee2daa9cb3c41fb901603e3d8caf784 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:00.302562 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f39a96-9c77-416f-a083-6acfdc44202c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:00.330268 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:00.440388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f39a96-9c77-416f-a083-6acfdc44202c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:00.475591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321c136-5b71-4efa-ba04-c526439438b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:00.476243 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321c136-5b71-4efa-ba04-c526439438b7 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:00.476522 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321c136-5b71-4efa-ba04-c526439438b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:00.476789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321c136-5b71-4efa-ba04-c526439438b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:00.488983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321c136-5b71-4efa-ba04-c526439438b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:32:00.495757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-1321c136-5b71-4efa-ba04-c526439438b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:32:00.495757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:00.495757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:00.495757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:00.495757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:00.495757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:00.495757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:00.495757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:00.495757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:00.495757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:00.495757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:00.495757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:00.495757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:32:00.495757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:32:00.495757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:32:00.495757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:32:00.496681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:32:00.496681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:32:00.496681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:32:00.496681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:32:00.496681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:00.496681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:00.496681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:00.496681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:00.496681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:00.496681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:00.496681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:00.496681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:00.496681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:00.496681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:00.496681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:00.496681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:00.497694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:00.497694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:00.497694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:00.497694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:00.497694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:32:00.497694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:32:00.497694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:32:00.497694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:32:00.497694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:32:00.497694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:32:00.497694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:32:00.497694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:00.497694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 349/722] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:32:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:00.506570 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06ca6c-36a6-40a7-a0b2-7d408abcce71 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:00.642056 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06ca6c-36a6-40a7-a0b2-7d408abcce71 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:00.693662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe8b18-882f-49c6-b83d-93fbfe2bfb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:00.694278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe8b18-882f-49c6-b83d-93fbfe2bfb49 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:00.695123 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe8b18-882f-49c6-b83d-93fbfe2bfb49 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:00.695400 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe8b18-882f-49c6-b83d-93fbfe2bfb49 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:00.696063 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe8b18-882f-49c6-b83d-93fbfe2bfb49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:00.696367 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe8b18-882f-49c6-b83d-93fbfe2bfb49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:00.697749 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe8b18-882f-49c6-b83d-93fbfe2bfb49 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:00.708790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 374/723] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:32:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:00.714214 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321c136-5b71-4efa-ba04-c526439438b7 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:00.825834 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:00.848804 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321c136-5b71-4efa-ba04-c526439438b7 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:00.884746 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a97c5a-be7e-4d59-bb58-b768bbe0241c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:00.885404 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a97c5a-be7e-4d59-bb58-b768bbe0241c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:00.885683 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a97c5a-be7e-4d59-bb58-b768bbe0241c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:00.885954 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a97c5a-be7e-4d59-bb58-b768bbe0241c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:00.896385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a97c5a-be7e-4d59-bb58-b768bbe0241c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:00.898416 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a97c5a-be7e-4d59-bb58-b768bbe0241c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:00.914079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-66a97c5a-be7e-4d59-bb58-b768bbe0241c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:00.914079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:00.914079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:00.914079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:00.914079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:00.914079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:00.914079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:00.914079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:00.914079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:00.914079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:00.914079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:00.914079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:00.914079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:00.914079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:00.914079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:00.914079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:00.915101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:00.915101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:00.915101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:00.915101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:00.915101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:00.915101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:00.915101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:00.915101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:00.915101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:00.915101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:00.915101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:00.915101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:00.915101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:00.915101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:00.915101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:00.915101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:00.915101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:00.916079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:00.916079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:00.916079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:00.916079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 350/724] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:00.922693 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe8b18-882f-49c6-b83d-93fbfe2bfb49 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:00.939552 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:01.055134 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe8b18-882f-49c6-b83d-93fbfe2bfb49 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:01.093610 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715fc60-f7d2-47ef-9ffd-e2c8dbc7a900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:01.094223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715fc60-f7d2-47ef-9ffd-e2c8dbc7a900 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:01.094501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715fc60-f7d2-47ef-9ffd-e2c8dbc7a900 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:01.094830 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715fc60-f7d2-47ef-9ffd-e2c8dbc7a900 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:01.095487 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715fc60-f7d2-47ef-9ffd-e2c8dbc7a900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:01.095787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715fc60-f7d2-47ef-9ffd-e2c8dbc7a900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:01.097236 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715fc60-f7d2-47ef-9ffd-e2c8dbc7a900 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:01.115351 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 375/725] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:01.121402 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a97c5a-be7e-4d59-bb58-b768bbe0241c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:01.245643 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a97c5a-be7e-4d59-bb58-b768bbe0241c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:01.277515 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:01.284539 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93376864-ab5c-4334-8339-613972b6d4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:01.285198 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93376864-ab5c-4334-8339-613972b6d4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:01.285559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93376864-ab5c-4334-8339-613972b6d4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:01.285763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93376864-ab5c-4334-8339-613972b6d4d9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:01.291162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435a081-1930-4ab8-88ef-55514faebadd None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:01.291505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435a081-1930-4ab8-88ef-55514faebadd None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:01.291784 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435a081-1930-4ab8-88ef-55514faebadd None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:01.293695 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 376/726] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:32:01.297585 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93376864-ab5c-4334-8339-613972b6d4d9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:01.299250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93376864-ab5c-4334-8339-613972b6d4d9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:01.306741 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884fcfa-a953-440f-92ff-16b6ead2e314 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:01.307031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884fcfa-a953-440f-92ff-16b6ead2e314 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:01.307307 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884fcfa-a953-440f-92ff-16b6ead2e314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:01.311559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-93376864-ab5c-4334-8339-613972b6d4d9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 00:32:01.311559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:01.311559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:01.311559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:01.311559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:01.311559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:01.311559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:01.311559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:01.311559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:01.311559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:01.311559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:01.311559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:01.311559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:32:01.311559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:32:01.311559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:32:01.311559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:32:01.312476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:01.312476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:01.312476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:32:01.312476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:01.312476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:32:01.312476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:01.312476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:01.312476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:01.312476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:01.312476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:01.312476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:01.312476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:01.312476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:01.312476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:01.312476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:01.312476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:01.312476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:01.312476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:01.313432 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:01.313432 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:01.313432 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:32:01.313432 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:32:01.313432 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:32:01.313432 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:32:01.313432 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:32:01.313432 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:32:01.313432 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 00:32:01.313432 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:01.316136 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 351/727] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:32:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:01.321332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93376864-ab5c-4334-8339-613972b6d4d9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:01.350094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-6884fcfa-a953-440f-92ff-16b6ead2e314 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:01.353019 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6884fcfa-a953-440f-92ff-16b6ead2e314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:01.490596 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:01.496447 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93376864-ab5c-4334-8339-613972b6d4d9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:01.498673 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 377/728] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:32:01.532391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45199a85-b59f-4050-999a-02d6c332f3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:01.533407 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45199a85-b59f-4050-999a-02d6c332f3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:01.533929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45199a85-b59f-4050-999a-02d6c332f3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:01.534424 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45199a85-b59f-4050-999a-02d6c332f3f9 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:01.535361 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45199a85-b59f-4050-999a-02d6c332f3f9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:01.535886 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45199a85-b59f-4050-999a-02d6c332f3f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:01.537519 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45199a85-b59f-4050-999a-02d6c332f3f9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:01.556048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 352/729] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Sep 15 00:32:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:01.562402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884fcfa-a953-440f-92ff-16b6ead2e314 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:01.807386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884fcfa-a953-440f-92ff-16b6ead2e314 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:01.836679 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45199a85-b59f-4050-999a-02d6c332f3f9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:01.909799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98b10d-afda-47ed-8aea-94655dec36f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:01.910424 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98b10d-afda-47ed-8aea-94655dec36f3 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:01.910709 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98b10d-afda-47ed-8aea-94655dec36f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:01.911004 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98b10d-afda-47ed-8aea-94655dec36f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:01.922931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:01.986969 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45199a85-b59f-4050-999a-02d6c332f3f9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:02.034613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbf148-2eda-49d3-bd65-b57d15126ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:02.035359 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbf148-2eda-49d3-bd65-b57d15126ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:02.037375 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbf148-2eda-49d3-bd65-b57d15126ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:02.037650 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbf148-2eda-49d3-bd65-b57d15126ee7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:02.063009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cbf148-2eda-49d3-bd65-b57d15126ee7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:32:02.068889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:02.072242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98b10d-afda-47ed-8aea-94655dec36f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:02.073556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-39cbf148-2eda-49d3-bd65-b57d15126ee7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:32:02.073556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:02.073556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:02.073556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:02.073556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:02.073556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:02.073556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:02.073556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:02.073556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:02.073556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:02.073556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:02.073556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:02.073556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:32:02.073556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:32:02.073556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:32:02.073556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:32:02.074666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:32:02.074666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:32:02.074666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:32:02.074666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:32:02.074666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:02.074666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:02.074666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:02.074666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:02.074666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:02.074666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:02.074666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:02.074666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:02.074666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:02.074666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:02.074666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:02.074666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:02.075524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:02.075524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:02.075524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:02.075524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:02.075524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:32:02.075524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:32:02.075524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:32:02.075524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:32:02.075524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:32:02.075524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:32:02.075524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:32:02.075524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:02.076180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 353/730] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:32:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:02.076701 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98b10d-afda-47ed-8aea-94655dec36f3 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:02.083437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbf148-2eda-49d3-bd65-b57d15126ee7 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:02.271890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 378/731] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:32:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 00:32:02.274514 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef7d9b-b1d6-49e0-a627-9474439b7033 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:02.274891 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef7d9b-b1d6-49e0-a627-9474439b7033 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:02.275802 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef7d9b-b1d6-49e0-a627-9474439b7033 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:02.279070 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 379/732] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:02.280569 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef7d9b-b1d6-49e0-a627-9474439b7033 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:02.288751 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbf148-2eda-49d3-bd65-b57d15126ee7 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:02.311867 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:02.372022 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877df5c-0708-48b5-83ae-36f1d811cacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:02.372625 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877df5c-0708-48b5-83ae-36f1d811cacd None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:02.372900 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877df5c-0708-48b5-83ae-36f1d811cacd None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:02.373208 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877df5c-0708-48b5-83ae-36f1d811cacd None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:02.373877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877df5c-0708-48b5-83ae-36f1d811cacd None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:02.374172 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877df5c-0708-48b5-83ae-36f1d811cacd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:02.375534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877df5c-0708-48b5-83ae-36f1d811cacd None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:02.393802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 354/733] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 15 00:32:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:02.395046 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e9952-acf4-45b3-8e66-bd2feae60966 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:02.395330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e9952-acf4-45b3-8e66-bd2feae60966 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:02.395599 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e9952-acf4-45b3-8e66-bd2feae60966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:02.437512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-bd6e9952-acf4-45b3-8e66-bd2feae60966 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:02.438703 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bd6e9952-acf4-45b3-8e66-bd2feae60966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:02.457496 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:02.462583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef7d9b-b1d6-49e0-a627-9474439b7033 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:02.498151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7acc70-a858-4190-a902-aa2efa605036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:02.498862 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7acc70-a858-4190-a902-aa2efa605036 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:02.499211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7acc70-a858-4190-a902-aa2efa605036 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:02.499481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7acc70-a858-4190-a902-aa2efa605036 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:02.510554 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7acc70-a858-4190-a902-aa2efa605036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:02.512002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7acc70-a858-4190-a902-aa2efa605036 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:02.527725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-9a7acc70-a858-4190-a902-aa2efa605036 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:02.527725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:02.527725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:02.527725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:02.527725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:02.527725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:02.527725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:02.527725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:02.527725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:02.527725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:02.527725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:02.527725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:02.527725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:02.527725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:02.527725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:02.527725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:02.528744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:02.528744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:02.528744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:02.528744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:02.528744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:02.528744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:02.528744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:02.528744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:02.528744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:02.528744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:02.528744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:02.528744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:02.528744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:02.528744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:02.528744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:02.528744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:02.528744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:02.529679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:02.529679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:02.529679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:02.529679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 380/734] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:02.529679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7acc70-a858-4190-a902-aa2efa605036 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:02.537288 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 355/735] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:32:02.540375 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e9952-acf4-45b3-8e66-bd2feae60966 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:02.703418 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7acc70-a858-4190-a902-aa2efa605036 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:02.729118 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:02.734710 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e9952-acf4-45b3-8e66-bd2feae60966 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:02.746741 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363341ac-1674-485d-846c-925d5744d81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:02.747378 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363341ac-1674-485d-846c-925d5744d81e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:02.747654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363341ac-1674-485d-846c-925d5744d81e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:02.747925 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363341ac-1674-485d-846c-925d5744d81e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:02.759936 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363341ac-1674-485d-846c-925d5744d81e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:02.761416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363341ac-1674-485d-846c-925d5744d81e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:02.776200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-363341ac-1674-485d-846c-925d5744d81e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:02.776200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:02.776200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:02.776200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:02.776200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:02.776200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:02.776200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:02.776200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:02.776200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:02.776200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:02.776200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:02.776200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:02.776200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:02.776200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:02.776200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:02.776200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:02.777205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:02.777205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:02.777205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:02.777205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:02.777205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:02.777205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:02.777205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:02.777205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:02.777205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:02.777205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:02.777205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:02.777205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:02.777205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:02.777205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:02.777205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:02.777205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:02.777205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:02.778093 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:02.778093 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:02.778093 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:02.778093 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 381/736] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:02.778733 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eaa973-c7cd-48a0-9ba8-912027f749fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:02.778932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492588e7-ccc9-423d-901d-2d28c182c94e None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:02.783450 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492588e7-ccc9-423d-901d-2d28c182c94e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:02.783590 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaa973-c7cd-48a0-9ba8-912027f749fb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:02.783675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492588e7-ccc9-423d-901d-2d28c182c94e None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:02.783745 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaa973-c7cd-48a0-9ba8-912027f749fb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:02.783745 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaa973-c7cd-48a0-9ba8-912027f749fb None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:02.783745 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eaa973-c7cd-48a0-9ba8-912027f749fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:02.783745 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eaa973-c7cd-48a0-9ba8-912027f749fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:02.783745 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eaa973-c7cd-48a0-9ba8-912027f749fb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:02.785047 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 382/737] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:02.785856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492588e7-ccc9-423d-901d-2d28c182c94e None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:02.790658 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:02.799667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 356/738] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:02.801454 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1eaa93-bdc7-4e4a-a9cf-258450e13858 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:02.801986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1eaa93-bdc7-4e4a-a9cf-258450e13858 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:02.802312 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1eaa93-bdc7-4e4a-a9cf-258450e13858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:02.825277 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9d1eaa93-bdc7-4e4a-a9cf-258450e13858 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:02.826589 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9d1eaa93-bdc7-4e4a-a9cf-258450e13858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:02.902973 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492588e7-ccc9-423d-901d-2d28c182c94e None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:02.908589 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 357/739] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:32:02.909459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1eaa93-bdc7-4e4a-a9cf-258450e13858 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:02.956659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a2c23-f8aa-4503-b270-a9a486982cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:02.957590 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a2c23-f8aa-4503-b270-a9a486982cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:02.958050 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a2c23-f8aa-4503-b270-a9a486982cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:02.958483 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a2c23-f8aa-4503-b270-a9a486982cd9 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:02.959295 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a2c23-f8aa-4503-b270-a9a486982cd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:02.959757 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a2c23-f8aa-4503-b270-a9a486982cd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:02.961936 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a2c23-f8aa-4503-b270-a9a486982cd9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:02.976471 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 383/740] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:02.977580 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a2c23-f8aa-4503-b270-a9a486982cd9 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:03.021737 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:03.039042 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1eaa93-bdc7-4e4a-a9cf-258450e13858 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:03.044186 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:03.081785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f3e41-8794-4d56-a832-b79006f94498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:03.082417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f3e41-8794-4d56-a832-b79006f94498 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:03.082696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f3e41-8794-4d56-a832-b79006f94498 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:03.082973 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f3e41-8794-4d56-a832-b79006f94498 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:03.085502 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a2c23-f8aa-4503-b270-a9a486982cd9 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:03.090348 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f3e41-8794-4d56-a832-b79006f94498 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:03.091818 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f3e41-8794-4d56-a832-b79006f94498 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:03.103617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-164f3e41-8794-4d56-a832-b79006f94498 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:03.103617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:03.103617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:03.103617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:03.103617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:03.103617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:03.103617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:03.103617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:03.103617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:03.103617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:03.103617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:03.103617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:03.103617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:32:03.103617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:32:03.103617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:32:03.104484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:32:03.104484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:03.104484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:03.104484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:03.104484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:03.104484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:03.104484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:03.104484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:03.104484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:03.104484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:03.104484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:03.104484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:03.104484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:03.104484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:03.104484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:03.104484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:03.104484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:03.110790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:32:03.110790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:32:03.110790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:32:03.110790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:32:03.110790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:32:03.110790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:32:03.110790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:03.110790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:03.110790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 358/741] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:32:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:03.110790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f3e41-8794-4d56-a832-b79006f94498 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:03.127067 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f9c66-fda9-4bcf-a52b-3c54b1dfb204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:03.127668 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f9c66-fda9-4bcf-a52b-3c54b1dfb204 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:03.127950 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f9c66-fda9-4bcf-a52b-3c54b1dfb204 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:03.128220 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f9c66-fda9-4bcf-a52b-3c54b1dfb204 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:03.128866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f9c66-fda9-4bcf-a52b-3c54b1dfb204 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:03.130242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f9c66-fda9-4bcf-a52b-3c54b1dfb204 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:03.149039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 384/742] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 15 00:32:02 2022] POST /identity/v3/services => generated 240 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:32:03.158685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d4cfe-dea8-4f6e-b1de-df8a0979d673 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:03.159014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d4cfe-dea8-4f6e-b1de-df8a0979d673 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:03.159242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d4cfe-dea8-4f6e-b1de-df8a0979d673 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:03.160579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 385/743] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:03.161294 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d4cfe-dea8-4f6e-b1de-df8a0979d673 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:03.224454 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f3e41-8794-4d56-a832-b79006f94498 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:03.271541 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ac96c-3ae6-4770-b1a1-3f17c79a8e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:03.272178 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ac96c-3ae6-4770-b1a1-3f17c79a8e59 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:03.272933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ac96c-3ae6-4770-b1a1-3f17c79a8e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:03.273255 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ac96c-3ae6-4770-b1a1-3f17c79a8e59 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:03.281457 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ac96c-3ae6-4770-b1a1-3f17c79a8e59 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:03.282984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ac96c-3ae6-4770-b1a1-3f17c79a8e59 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:03.295235 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d4cfe-dea8-4f6e-b1de-df8a0979d673 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:03.296948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-4a8ac96c-3ae6-4770-b1a1-3f17c79a8e59 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 00:32:03.296948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:03.296948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:03.296948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:03.296948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:03.296948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:03.296948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:03.296948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:03.296948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:03.296948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:03.296948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:03.296948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:03.296948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:32:03.296948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:32:03.296948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:32:03.296948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:32:03.298090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:03.298090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:03.298090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:32:03.298090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:03.298090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:32:03.298090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:03.298090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:03.298090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:03.298090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:03.298090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:03.298090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:03.298090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:03.298090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:03.298090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:03.298090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:03.298090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:03.298090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:03.298090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:03.299218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:03.299218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:03.299218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:32:03.299218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:32:03.299218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:32:03.299218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:32:03.299218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:32:03.299218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:32:03.299218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 00:32:03.299218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:03.302809 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 359/744] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Sep 15 00:32:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:03.304865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdedca-b998-4b90-ac4f-aad3fad39010 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:03.305168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdedca-b998-4b90-ac4f-aad3fad39010 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:03.305440 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdedca-b998-4b90-ac4f-aad3fad39010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:03.318614 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:03.328494 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-04bdedca-b998-4b90-ac4f-aad3fad39010 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:03.328806 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:03.329844 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-04bdedca-b998-4b90-ac4f-aad3fad39010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:03.344873 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a91734-8f08-43af-9315-43fda4a5489f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:03.345842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a91734-8f08-43af-9315-43fda4a5489f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:03.345842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a91734-8f08-43af-9315-43fda4a5489f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:03.346133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a91734-8f08-43af-9315-43fda4a5489f None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:03.347479 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a91734-8f08-43af-9315-43fda4a5489f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:03.347479 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a91734-8f08-43af-9315-43fda4a5489f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:03.348826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a91734-8f08-43af-9315-43fda4a5489f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:03.364098 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 386/745] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:32:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:03.365953 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a91734-8f08-43af-9315-43fda4a5489f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:03.413545 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 360/746] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:03 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 00:32:03.413545 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdedca-b998-4b90-ac4f-aad3fad39010 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:03.499038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a91734-8f08-43af-9315-43fda4a5489f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:03.525747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdedca-b998-4b90-ac4f-aad3fad39010 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:03.535591 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9dae3-71b9-4b2e-967e-69b2eb844177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:03.536221 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9dae3-71b9-4b2e-967e-69b2eb844177 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:03.536503 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9dae3-71b9-4b2e-967e-69b2eb844177 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:03.536775 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9dae3-71b9-4b2e-967e-69b2eb844177 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:03.537470 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9dae3-71b9-4b2e-967e-69b2eb844177 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:03.539432 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9dae3-71b9-4b2e-967e-69b2eb844177 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:03.558994 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 387/747] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 15 00:32:03 2022] POST /identity/v3/services => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:32:03.560353 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9dae3-71b9-4b2e-967e-69b2eb844177 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:03.569280 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:03.575904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7419176-3dd7-4498-92b7-250e58a8e24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:03.577033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7419176-3dd7-4498-92b7-250e58a8e24d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:03.581907 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7419176-3dd7-4498-92b7-250e58a8e24d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:03.582191 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7419176-3dd7-4498-92b7-250e58a8e24d None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:03.583103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7419176-3dd7-4498-92b7-250e58a8e24d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:03.583513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7419176-3dd7-4498-92b7-250e58a8e24d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:03.590924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7419176-3dd7-4498-92b7-250e58a8e24d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:03.620893 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 361/748] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Sep 15 00:32:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:03.623768 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:03.626258 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7419176-3dd7-4498-92b7-250e58a8e24d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:03.697583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9dae3-71b9-4b2e-967e-69b2eb844177 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:03.751599 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bc8fa-f693-4941-9f20-f813a8b21c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:03.753035 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bc8fa-f693-4941-9f20-f813a8b21c92 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:03.753554 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bc8fa-f693-4941-9f20-f813a8b21c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:03.754026 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bc8fa-f693-4941-9f20-f813a8b21c92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:03.754982 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bc8fa-f693-4941-9f20-f813a8b21c92 None admin] RBAC: Adding query filter params (role.id=0ee2daa9cb3c41fb901603e3d8caf784, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=5fb248b85aba45b39132d0f92ede0b68) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:03.755517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bc8fa-f693-4941-9f20-f813a8b21c92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:03.757787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bc8fa-f693-4941-9f20-f813a8b21c92 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:03.764842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 388/749] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:32:03 2022] GET /identity/v3/role_assignments?user.id=5fb248b85aba45b39132d0f92ede0b68&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=0ee2daa9cb3c41fb901603e3d8caf784 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:03.766042 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bc8fa-f693-4941-9f20-f813a8b21c92 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:03.785439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7419176-3dd7-4498-92b7-250e58a8e24d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:03.841811 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf678c-b31e-453b-a3cb-df6c884925a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:03.842959 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf678c-b31e-453b-a3cb-df6c884925a4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:03.843248 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf678c-b31e-453b-a3cb-df6c884925a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:03.843525 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf678c-b31e-453b-a3cb-df6c884925a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:03.919313 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bc8fa-f693-4941-9f20-f813a8b21c92 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:03.926185 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:03.932144 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:03.939929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf678c-b31e-453b-a3cb-df6c884925a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:03.941605 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf678c-b31e-453b-a3cb-df6c884925a4 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:03.960926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea95a90-ebb6-4d3e-ae08-3d69d0e9efa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:03.962247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea95a90-ebb6-4d3e-ae08-3d69d0e9efa8 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:03.962713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea95a90-ebb6-4d3e-ae08-3d69d0e9efa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:03.963163 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea95a90-ebb6-4d3e-ae08-3d69d0e9efa8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:03.976727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea95a90-ebb6-4d3e-ae08-3d69d0e9efa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:32:03.982523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-4ea95a90-ebb6-4d3e-ae08-3d69d0e9efa8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:32:03.982523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:03.982523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:03.982523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:03.982523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:03.982523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:03.982523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:03.982523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:03.982523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:03.982523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:03.982523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:03.982523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:03.982523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:32:03.982523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:32:03.982523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:32:03.982523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:32:03.983504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:32:03.983504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:32:03.983504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:32:03.983504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:32:03.983504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:03.983504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:03.983504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:03.983504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:03.983504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:03.983504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:03.983504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:03.983504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:03.983504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:03.983504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:03.983504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:03.983504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:03.984877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:03.984877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:03.984877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:03.984877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:03.984877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:32:03.984877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:32:03.984877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:32:03.984877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:32:03.984877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:32:03.984877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:32:03.984877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:32:03.984877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:03.984877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 389/750] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:32:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:03.989820 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea95a90-ebb6-4d3e-ae08-3d69d0e9efa8 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:04.060261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 362/751] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:32:03 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 00:32:04.065431 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf678c-b31e-453b-a3cb-df6c884925a4 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:04.158882 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea95a90-ebb6-4d3e-ae08-3d69d0e9efa8 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:04.197750 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767be1d-cf4e-4955-a66d-5e7b12dd3262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:04.198706 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767be1d-cf4e-4955-a66d-5e7b12dd3262 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:04.199375 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767be1d-cf4e-4955-a66d-5e7b12dd3262 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:04.199873 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767be1d-cf4e-4955-a66d-5e7b12dd3262 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:04.201295 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767be1d-cf4e-4955-a66d-5e7b12dd3262 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:04.201833 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767be1d-cf4e-4955-a66d-5e7b12dd3262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:04.203576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767be1d-cf4e-4955-a66d-5e7b12dd3262 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:04.211856 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:04.215547 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 390/752] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:32:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:04.221706 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767be1d-cf4e-4955-a66d-5e7b12dd3262 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:04.236808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf678c-b31e-453b-a3cb-df6c884925a4 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:04.286469 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:04.307322 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f347d42-aaff-4e94-833d-aef99655d819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:04.308331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f347d42-aaff-4e94-833d-aef99655d819 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:04.308836 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f347d42-aaff-4e94-833d-aef99655d819 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:04.309373 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f347d42-aaff-4e94-833d-aef99655d819 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:04.321186 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f347d42-aaff-4e94-833d-aef99655d819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:04.323284 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f347d42-aaff-4e94-833d-aef99655d819 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:04.340048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-5f347d42-aaff-4e94-833d-aef99655d819 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:04.340048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:04.340048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:04.340048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:04.340048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:04.340048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:04.340048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:04.340048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:04.340048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:04.340048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:04.340048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:04.340048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:04.340048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:04.340048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:04.340048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:04.340048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:04.341052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:04.341052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:04.341052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:04.341052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:04.341052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:04.341052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:04.341052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:04.341052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:04.341052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:04.341052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:04.341052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:04.341052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:04.341052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:04.341052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:04.341052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:04.341052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:04.341052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:04.342280 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:04.342280 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:04.342280 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:04.344358 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 363/753] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:04.349332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f347d42-aaff-4e94-833d-aef99655d819 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:04.422271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767be1d-cf4e-4955-a66d-5e7b12dd3262 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:04.499860 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934bc8f-2962-4280-9ad2-e1b11137046e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:04.500894 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934bc8f-2962-4280-9ad2-e1b11137046e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:04.501401 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934bc8f-2962-4280-9ad2-e1b11137046e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:04.501879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934bc8f-2962-4280-9ad2-e1b11137046e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:04.525710 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934bc8f-2962-4280-9ad2-e1b11137046e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:04.527508 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934bc8f-2962-4280-9ad2-e1b11137046e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:04.546306 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f347d42-aaff-4e94-833d-aef99655d819 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:04.567871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-7934bc8f-2962-4280-9ad2-e1b11137046e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:04.567871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:04.567871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:04.567871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:04.567871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:04.567871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:04.567871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:04.567871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:04.567871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:04.567871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:04.567871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:04.567871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:04.567871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:04.567871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:04.567871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:04.567871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:04.568872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:04.568872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:04.568872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:04.568872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:04.568872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:04.568872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:04.568872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:04.568872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:04.568872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:04.568872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:04.568872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:04.568872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:04.568872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:04.568872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:04.568872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:04.568872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:04.568872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:04.570486 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:04.570486 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:04.570486 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:04.570486 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 391/754] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:04.570486 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934bc8f-2962-4280-9ad2-e1b11137046e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:04.612726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadb653-72f3-4e93-a63c-131bfcd0f63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:04.613279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadb653-72f3-4e93-a63c-131bfcd0f63c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:04.613559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadb653-72f3-4e93-a63c-131bfcd0f63c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:04.613830 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadb653-72f3-4e93-a63c-131bfcd0f63c None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:04.614478 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadb653-72f3-4e93-a63c-131bfcd0f63c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:04.614778 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadb653-72f3-4e93-a63c-131bfcd0f63c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:04.616212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadb653-72f3-4e93-a63c-131bfcd0f63c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:04.644129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 364/755] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:04.649871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadb653-72f3-4e93-a63c-131bfcd0f63c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:04.653188 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:04.700958 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:04.709658 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934bc8f-2962-4280-9ad2-e1b11137046e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:04.755846 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be729a-a780-4deb-a098-3dd04ddae75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:04.756485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be729a-a780-4deb-a098-3dd04ddae75e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:04.757321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be729a-a780-4deb-a098-3dd04ddae75e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:04.758401 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be729a-a780-4deb-a098-3dd04ddae75e None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:04.758401 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be729a-a780-4deb-a098-3dd04ddae75e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:04.758592 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be729a-a780-4deb-a098-3dd04ddae75e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:04.759808 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be729a-a780-4deb-a098-3dd04ddae75e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:04.788382 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 392/756] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:04.789510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be729a-a780-4deb-a098-3dd04ddae75e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:04.871935 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadb653-72f3-4e93-a63c-131bfcd0f63c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:04.913676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be729a-a780-4deb-a098-3dd04ddae75e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:04.946586 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4ceee-e659-4740-90c9-151cda2c4190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:04.947901 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4ceee-e659-4740-90c9-151cda2c4190 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:04.949445 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4ceee-e659-4740-90c9-151cda2c4190 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:04.950630 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4ceee-e659-4740-90c9-151cda2c4190 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:04.963463 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4ceee-e659-4740-90c9-151cda2c4190 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:04.966471 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4ceee-e659-4740-90c9-151cda2c4190 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:04.967413 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5b13d-a236-419f-b38f-0036a9a81e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:04.968260 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5b13d-a236-419f-b38f-0036a9a81e76 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:04.968740 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5b13d-a236-419f-b38f-0036a9a81e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:04.969281 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5b13d-a236-419f-b38f-0036a9a81e76 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:04.984703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5b13d-a236-419f-b38f-0036a9a81e76 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:04.988473 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5b13d-a236-419f-b38f-0036a9a81e76 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:04.999743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-80a4ceee-e659-4740-90c9-151cda2c4190 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:04.999743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:04.999743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:04.999743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:04.999743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:04.999743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:04.999743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:04.999743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:04.999743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:04.999743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:04.999743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:04.999743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:04.999743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:32:04.999743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:32:04.999743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:32:05.000638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:32:05.000638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:05.000638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:05.000638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:05.000638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:05.000638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:05.000638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:05.000638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:05.000638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:05.000638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:05.000638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:05.000638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:05.000638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:05.000638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:05.000638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:05.000638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:05.000638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:05.001587 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:32:05.001587 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:32:05.001587 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:32:05.001587 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:32:05.001587 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:32:05.001587 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:32:05.001587 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:05.001587 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:05.005617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 365/757] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:32:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:05.009440 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4ceee-e659-4740-90c9-151cda2c4190 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:05.013151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-eeb5b13d-a236-419f-b38f-0036a9a81e76 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 00:32:05.013151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:05.013151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:05.013151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:05.013151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:05.013151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:05.013151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:05.013151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:05.013151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:05.013151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:05.013151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:05.013151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:05.013151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:32:05.013151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:32:05.013151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:32:05.013151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:32:05.014079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:05.014079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:05.014079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:32:05.014079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:05.014079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:32:05.014079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:05.014079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:05.014079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:05.014079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:05.014079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:05.014079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:05.014079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:05.014079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:05.014079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:05.014079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:05.014079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:05.014079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:05.014079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:05.015018 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:05.015018 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:05.015018 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:32:05.015018 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:32:05.015018 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:32:05.015018 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:32:05.015018 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:32:05.015018 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:32:05.015018 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 00:32:05.015018 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:05.024894 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 393/758] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Sep 15 00:32:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:05.030609 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5b13d-a236-419f-b38f-0036a9a81e76 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:05.049440 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:05.137520 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:05.192359 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5b13d-a236-419f-b38f-0036a9a81e76 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:05.222497 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4ceee-e659-4740-90c9-151cda2c4190 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:05.248211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82391c7-197d-496d-a9cd-28df14348859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:05.248828 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82391c7-197d-496d-a9cd-28df14348859 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:05.249123 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82391c7-197d-496d-a9cd-28df14348859 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:05.249405 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82391c7-197d-496d-a9cd-28df14348859 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:05.251311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82391c7-197d-496d-a9cd-28df14348859 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:05.251446 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82391c7-197d-496d-a9cd-28df14348859 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:05.252797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82391c7-197d-496d-a9cd-28df14348859 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:05.287584 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 394/759] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Sep 15 00:32:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:05.294266 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82391c7-197d-496d-a9cd-28df14348859 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:05.297340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f376d86-f965-47f3-bd8e-ec4b9621e770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:05.297951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f376d86-f965-47f3-bd8e-ec4b9621e770 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:05.298231 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f376d86-f965-47f3-bd8e-ec4b9621e770 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:05.298500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f376d86-f965-47f3-bd8e-ec4b9621e770 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:05.299196 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f376d86-f965-47f3-bd8e-ec4b9621e770 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:05.299500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f376d86-f965-47f3-bd8e-ec4b9621e770 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:05.300921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f376d86-f965-47f3-bd8e-ec4b9621e770 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:05.330119 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 366/760] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:32:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:05.334471 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f376d86-f965-47f3-bd8e-ec4b9621e770 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:05.423345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:05.462884 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82391c7-197d-496d-a9cd-28df14348859 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:05.528233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c01eb2-d53c-44d4-abf3-74590c75c6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:05.528866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c01eb2-d53c-44d4-abf3-74590c75c6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:05.529260 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c01eb2-d53c-44d4-abf3-74590c75c6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:05.529537 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c01eb2-d53c-44d4-abf3-74590c75c6e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:05.537850 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f376d86-f965-47f3-bd8e-ec4b9621e770 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:05.540629 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c01eb2-d53c-44d4-abf3-74590c75c6e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:05.542113 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c01eb2-d53c-44d4-abf3-74590c75c6e0 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:05.556780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-e2c01eb2-d53c-44d4-abf3-74590c75c6e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:05.556780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:05.556780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:05.556780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:05.556780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:05.556780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:05.556780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:05.556780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:05.556780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:05.556780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:05.556780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:05.556780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:05.556780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:05.556780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:05.556780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:05.556780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:05.557986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:05.557986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:05.557986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:05.557986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:05.557986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:05.557986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:05.557986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:05.557986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:05.557986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:05.557986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:05.557986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:05.557986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:05.557986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:05.557986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:05.557986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:05.557986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:05.557986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:05.559030 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:05.559030 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:05.559030 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:05.559030 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 395/761] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:05.559308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1540224-e310-484b-a11a-d1ab2a416e52 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:05.559587 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1540224-e310-484b-a11a-d1ab2a416e52 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:05.559860 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1540224-e310-484b-a11a-d1ab2a416e52 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:05.565657 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 396/762] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:05.569705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1540224-e310-484b-a11a-d1ab2a416e52 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:05.571025 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:05.592115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185a0ea-f9ff-492a-887f-c2933a126d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:05.593403 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185a0ea-f9ff-492a-887f-c2933a126d25 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:05.593889 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185a0ea-f9ff-492a-887f-c2933a126d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:05.594541 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185a0ea-f9ff-492a-887f-c2933a126d25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:05.595983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185a0ea-f9ff-492a-887f-c2933a126d25 None admin] RBAC: Adding query filter params (role.id=e5b76a8345d542c2a899f8dbdd95290d, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=ed49a596f15542a29ce331bae4640274) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:05.596569 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185a0ea-f9ff-492a-887f-c2933a126d25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:05.598838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185a0ea-f9ff-492a-887f-c2933a126d25 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:05.613866 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 367/763] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:32:05 2022] GET /identity/v3/role_assignments?user.id=ed49a596f15542a29ce331bae4640274&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=e5b76a8345d542c2a899f8dbdd95290d => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:05.616945 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94aafe-ba96-490f-8599-f60ba4e063fc None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:05.617127 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94aafe-ba96-490f-8599-f60ba4e063fc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:05.617330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94aafe-ba96-490f-8599-f60ba4e063fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:05.775336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1540224-e310-484b-a11a-d1ab2a416e52 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:05.800319 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:05.811664 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-da94aafe-ba96-490f-8599-f60ba4e063fc None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:05.813833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-da94aafe-ba96-490f-8599-f60ba4e063fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:05.854417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537620a-0393-49b7-be8e-56e52a2dc102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:05.855044 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537620a-0393-49b7-be8e-56e52a2dc102 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:05.855324 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537620a-0393-49b7-be8e-56e52a2dc102 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:05.855591 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537620a-0393-49b7-be8e-56e52a2dc102 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:05.856241 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537620a-0393-49b7-be8e-56e52a2dc102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:05.856546 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537620a-0393-49b7-be8e-56e52a2dc102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:05.857921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537620a-0393-49b7-be8e-56e52a2dc102 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:05.886224 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 397/764] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:05.891926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537620a-0393-49b7-be8e-56e52a2dc102 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:05.916789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 368/765] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:06.041199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537620a-0393-49b7-be8e-56e52a2dc102 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:06.089135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413adfa0-0cec-4dca-aec2-b2fc7c1a02f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:06.090171 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413adfa0-0cec-4dca-aec2-b2fc7c1a02f6 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:06.090670 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413adfa0-0cec-4dca-aec2-b2fc7c1a02f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:06.091146 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413adfa0-0cec-4dca-aec2-b2fc7c1a02f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:06.102200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413adfa0-0cec-4dca-aec2-b2fc7c1a02f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:06.104074 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413adfa0-0cec-4dca-aec2-b2fc7c1a02f6 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:06.121882 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-413adfa0-0cec-4dca-aec2-b2fc7c1a02f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:06.121882 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:06.121882 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:06.121882 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:06.121882 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:06.121882 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:06.121882 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:06.121882 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:06.121882 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:06.121882 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:06.121882 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:06.121882 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:06.121882 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:32:06.121882 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:32:06.121882 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:32:06.122865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:32:06.122865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:06.122865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:06.122865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:06.122865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:06.122865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:06.122865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:06.122865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:06.122865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:06.122865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:06.122865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:06.122865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:06.122865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:06.122865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:06.122865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:06.122865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:06.122865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:06.123788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:32:06.123788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:32:06.123788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:32:06.123788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:32:06.123788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:32:06.123788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:32:06.123788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:06.123788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:06.126190 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 398/766] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:32:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:06.132747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94aafe-ba96-490f-8599-f60ba4e063fc None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:06.242653 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce33a3-6a3b-4b65-8cef-f10da9e8cdaa None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:06.243285 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce33a3-6a3b-4b65-8cef-f10da9e8cdaa None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:06.243763 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce33a3-6a3b-4b65-8cef-f10da9e8cdaa None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:06.245330 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 399/767] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:32:06.250400 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaeff9f-15fd-4789-a8af-8b4dc87a5b60 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:06.250686 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaeff9f-15fd-4789-a8af-8b4dc87a5b60 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:06.250945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaeff9f-15fd-4789-a8af-8b4dc87a5b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:06.270799 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94aafe-ba96-490f-8599-f60ba4e063fc None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:06.277622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-deaeff9f-15fd-4789-a8af-8b4dc87a5b60 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:06.278830 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-deaeff9f-15fd-4789-a8af-8b4dc87a5b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:06.302715 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:06.321473 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:06.330705 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a5e10-4803-4c79-aa4d-837998884617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:06.331461 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a5e10-4803-4c79-aa4d-837998884617 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:06.331837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a5e10-4803-4c79-aa4d-837998884617 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:06.332203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a5e10-4803-4c79-aa4d-837998884617 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:06.332999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a5e10-4803-4c79-aa4d-837998884617 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:06.333432 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a5e10-4803-4c79-aa4d-837998884617 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:06.335949 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a5e10-4803-4c79-aa4d-837998884617 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:06.351993 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 369/768] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:32:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:06.353253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a5e10-4803-4c79-aa4d-837998884617 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:06.379950 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 400/769] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 00:32:06.384635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaeff9f-15fd-4789-a8af-8b4dc87a5b60 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:06.499641 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaeff9f-15fd-4789-a8af-8b4dc87a5b60 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:06.500591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a5e10-4803-4c79-aa4d-837998884617 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:06.540735 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f54539-dd98-4e83-8033-df112b07be26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:06.541588 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f54539-dd98-4e83-8033-df112b07be26 None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:06.541817 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f54539-dd98-4e83-8033-df112b07be26 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:06.542097 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f54539-dd98-4e83-8033-df112b07be26 None admin] PATH_INFO: `/v3/projects/f25792dd210b42c4a3491096a735f909/users/bfcfcf8061f24231858b9b0205a8abaa/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:06.544047 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f54539-dd98-4e83-8033-df112b07be26 None admin] RBAC: Authorizing `identity:create_grant(project_id=f25792dd210b42c4a3491096a735f909, user_id=bfcfcf8061f24231858b9b0205a8abaa, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:06.545564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f54539-dd98-4e83-8033-df112b07be26 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:06.547235 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86e505-4bb9-412d-9d70-5645d5b08f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:06.548335 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86e505-4bb9-412d-9d70-5645d5b08f0a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:06.549222 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86e505-4bb9-412d-9d70-5645d5b08f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:06.549990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86e505-4bb9-412d-9d70-5645d5b08f0a None admin] PATH_INFO: `/v3/services/network` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:06.550688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86e505-4bb9-412d-9d70-5645d5b08f0a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:06.552254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86e505-4bb9-412d-9d70-5645d5b08f0a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:06.563227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 401/770] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:32:06 2022] PUT /identity/v3/projects/f25792dd210b42c4a3491096a735f909/users/bfcfcf8061f24231858b9b0205a8abaa/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:32:06.563474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-ca86e505-4bb9-412d-9d70-5645d5b08f0a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 00:32:06.563474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:06.563474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:32:06.563474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:32:06.563474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:32:06.563474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:32:06.563474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:32:06.563474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:06.563474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 00:32:06.563474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:06.563474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:06.563474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:06.563474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:06.563474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:06.563474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:06.563474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:06.563474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:06.564414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:06.564414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:06.564414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:06.564414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:06.564414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:06.564414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:06.564414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:32:06.564414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:32:06.564414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:32:06.564414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:32:06.564414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:06.564414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:06.564414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:06.564414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:06.564414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:06.564414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:06.565649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:06.565649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:06.565649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:06.565649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:06.565649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:06.565649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:06.565649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:06.565649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:06.565649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:06.565649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:06.565649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:32:06.565649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:06.565649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 00:32:06.565649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:06.568149 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1829b1f-dc98-4644-8a4b-420de160ef80 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:06.568670 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1829b1f-dc98-4644-8a4b-420de160ef80 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:06.569253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1829b1f-dc98-4644-8a4b-420de160ef80 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:06.570319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 370/771] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:32:06 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:06.571311 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86e505-4bb9-412d-9d70-5645d5b08f0a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:06.572381 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 402/772] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:06.579627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1dc0e-359a-4d66-9091-fe69bfffe6d5 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:06.579627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1dc0e-359a-4d66-9091-fe69bfffe6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:06.579627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1dc0e-359a-4d66-9091-fe69bfffe6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:06.623519 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:06.626221 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-dcf1dc0e-359a-4d66-9091-fe69bfffe6d5 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:06.627432 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-dcf1dc0e-359a-4d66-9091-fe69bfffe6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:06.667544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:06.704522 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86e505-4bb9-412d-9d70-5645d5b08f0a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:06.734623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 403/773] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:06.735761 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1dc0e-359a-4d66-9091-fe69bfffe6d5 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:06.759031 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1ab66-7e82-4805-9ef5-443fefdb2390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:06.759705 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1ab66-7e82-4805-9ef5-443fefdb2390 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:06.760040 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1ab66-7e82-4805-9ef5-443fefdb2390 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:06.760319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1ab66-7e82-4805-9ef5-443fefdb2390 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:06.760970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1ab66-7e82-4805-9ef5-443fefdb2390 None admin] RBAC: Adding query filter params (name=network) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:06.761296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1ab66-7e82-4805-9ef5-443fefdb2390 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:06.767660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1ab66-7e82-4805-9ef5-443fefdb2390 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:06.777830 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 371/774] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 15 00:32:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:06.785180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1ab66-7e82-4805-9ef5-443fefdb2390 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:06.872103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1dc0e-359a-4d66-9091-fe69bfffe6d5 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:06.914545 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a6367-5415-471e-a43d-1ca20f98500f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:06.915559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a6367-5415-471e-a43d-1ca20f98500f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:06.916061 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a6367-5415-471e-a43d-1ca20f98500f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:06.916556 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a6367-5415-471e-a43d-1ca20f98500f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:06.926893 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1ab66-7e82-4805-9ef5-443fefdb2390 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:06.928310 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a6367-5415-471e-a43d-1ca20f98500f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:32:06.933981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-ed2a6367-5415-471e-a43d-1ca20f98500f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:32:06.933981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:06.933981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:06.933981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:06.933981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:06.933981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:06.933981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:06.933981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:06.933981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:06.933981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:06.933981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:06.933981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:06.933981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:32:06.933981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:32:06.933981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:32:06.933981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:32:06.934905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:32:06.934905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:32:06.934905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:32:06.934905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:32:06.934905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:06.934905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:06.934905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:06.934905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:06.934905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:06.934905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:06.934905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:06.934905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:06.934905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:06.934905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:06.934905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:06.934905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:06.935743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:06.935743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:06.935743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:06.935743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:06.935743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:32:06.935743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:32:06.935743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:32:06.935743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:32:06.935743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:32:06.935743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:32:06.935743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:32:06.935743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:06.938317 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 404/775] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:32:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:06.939019 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:06.943967 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a6367-5415-471e-a43d-1ca20f98500f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:06.961139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:07.033357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5468c8c-421f-41dd-b299-8ccd2994d43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:07.034394 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5468c8c-421f-41dd-b299-8ccd2994d43e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:07.035152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5468c8c-421f-41dd-b299-8ccd2994d43e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:07.035390 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5468c8c-421f-41dd-b299-8ccd2994d43e None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:07.036470 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5468c8c-421f-41dd-b299-8ccd2994d43e None admin] RBAC: Adding query filter params (type=network) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:07.036716 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5468c8c-421f-41dd-b299-8ccd2994d43e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:07.038746 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5468c8c-421f-41dd-b299-8ccd2994d43e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:07.056727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a6367-5415-471e-a43d-1ca20f98500f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:07.057059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 372/776] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 15 00:32:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:07.062658 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5468c8c-421f-41dd-b299-8ccd2994d43e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:07.118386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075df399-b6eb-4c37-a682-fdd9912543fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:07.119005 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075df399-b6eb-4c37-a682-fdd9912543fc None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:07.119291 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075df399-b6eb-4c37-a682-fdd9912543fc None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:07.119556 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075df399-b6eb-4c37-a682-fdd9912543fc None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:07.120225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075df399-b6eb-4c37-a682-fdd9912543fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:07.120529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075df399-b6eb-4c37-a682-fdd9912543fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:07.121993 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075df399-b6eb-4c37-a682-fdd9912543fc None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:07.136249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 405/777] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:32:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:07.137112 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075df399-b6eb-4c37-a682-fdd9912543fc None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:07.205948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5468c8c-421f-41dd-b299-8ccd2994d43e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:07.230515 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:07.244437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9789c-bbb5-4d88-8299-ff980d966d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:07.245050 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9789c-bbb5-4d88-8299-ff980d966d2a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:07.245372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9789c-bbb5-4d88-8299-ff980d966d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:07.245645 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9789c-bbb5-4d88-8299-ff980d966d2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:07.246416 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9789c-bbb5-4d88-8299-ff980d966d2a None admin] RBAC: Adding query filter params (interface=public, service_id=d760dd9d05684b638145fa73352edd85, region_id=RegionOne) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:07.246727 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9789c-bbb5-4d88-8299-ff980d966d2a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:07.248173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9789c-bbb5-4d88-8299-ff980d966d2a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:07.258282 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 373/778] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Sep 15 00:32:07 2022] GET /identity/v3/endpoints?service_id=d760dd9d05684b638145fa73352edd85&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:07.259283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9789c-bbb5-4d88-8299-ff980d966d2a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:07.265447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075df399-b6eb-4c37-a682-fdd9912543fc None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:07.291940 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:07.309826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490f594-512a-4a99-9468-1fe2234d2acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:07.310779 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490f594-512a-4a99-9468-1fe2234d2acf None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:07.311217 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490f594-512a-4a99-9468-1fe2234d2acf None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:07.311637 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490f594-512a-4a99-9468-1fe2234d2acf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:07.312539 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490f594-512a-4a99-9468-1fe2234d2acf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:07.314359 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490f594-512a-4a99-9468-1fe2234d2acf None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:07.328247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-7490f594-512a-4a99-9468-1fe2234d2acf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 00:32:07.328247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:07.328247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:32:07.328247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:32:07.328247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:32:07.328247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:32:07.328247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:32:07.328247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:07.328247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 00:32:07.328247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:07.328247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:07.328247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:07.328247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:07.328247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:07.328247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:07.328247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:07.328247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:07.329532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:07.329532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:07.329532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:07.329532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:07.329532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:07.329532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:07.329532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:32:07.329532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:32:07.329532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:32:07.329532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:32:07.329532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:07.329532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:07.329532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:07.329532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:07.329532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:07.329532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:07.330558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:07.330558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:07.330558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:07.330558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:07.330558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:07.330558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:07.330558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:07.330558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:07.330558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:07.330558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:07.330558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:32:07.330558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:07.330558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 00:32:07.330558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:07.333573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 406/779] 10.222.0.52 () {56 vars in 1129 bytes} [Thu Sep 15 00:32:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:07.334505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490f594-512a-4a99-9468-1fe2234d2acf None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:07.373325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9789c-bbb5-4d88-8299-ff980d966d2a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:07.412366 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9a364-2bd0-462f-ba09-87c20df2bf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:07.413112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9a364-2bd0-462f-ba09-87c20df2bf11 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:07.413526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9a364-2bd0-462f-ba09-87c20df2bf11 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:07.413924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9a364-2bd0-462f-ba09-87c20df2bf11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:07.424722 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9a364-2bd0-462f-ba09-87c20df2bf11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:07.426384 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9a364-2bd0-462f-ba09-87c20df2bf11 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:07.442051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-b9c9a364-2bd0-462f-ba09-87c20df2bf11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:07.442051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:07.442051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:07.442051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:07.442051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:07.442051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:07.442051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:07.442051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:07.442051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:07.442051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:07.442051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:07.442051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:07.442051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:07.442051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:07.442051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:07.442051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:07.443253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:07.443253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:07.443253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:07.443253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:07.443253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:07.443253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:07.443253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:07.443253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:07.443253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:07.443253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:07.443253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:07.443253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:07.443253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:07.443253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:07.443253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:07.443253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:07.443253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:07.444925 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:07.444925 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:07.444925 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:07.450697 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 374/780] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:07.451767 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9a364-2bd0-462f-ba09-87c20df2bf11 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:07.462192 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490f594-512a-4a99-9468-1fe2234d2acf None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:07.501237 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8916435-e1c2-4d7f-b0e2-f483a9a4f6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:07.502495 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8916435-e1c2-4d7f-b0e2-f483a9a4f6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:07.502928 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8916435-e1c2-4d7f-b0e2-f483a9a4f6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:07.503602 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8916435-e1c2-4d7f-b0e2-f483a9a4f6b3 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:07.504358 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8916435-e1c2-4d7f-b0e2-f483a9a4f6b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:07.505971 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8916435-e1c2-4d7f-b0e2-f483a9a4f6b3 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:07.512435 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 407/781] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Sep 15 00:32:07 2022] GET /identity/v3/services => generated 772 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:07.513795 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8916435-e1c2-4d7f-b0e2-f483a9a4f6b3 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:07.517027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:07.545631 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:07.565606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9a364-2bd0-462f-ba09-87c20df2bf11 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:07.605034 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e4dad-7cc0-47f4-bc31-6e948f525aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:07.605892 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e4dad-7cc0-47f4-bc31-6e948f525aac None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:07.607363 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e4dad-7cc0-47f4-bc31-6e948f525aac None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:07.607363 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e4dad-7cc0-47f4-bc31-6e948f525aac None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:07.607676 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e4dad-7cc0-47f4-bc31-6e948f525aac None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:07.608113 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e4dad-7cc0-47f4-bc31-6e948f525aac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:07.610501 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e4dad-7cc0-47f4-bc31-6e948f525aac None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:07.619883 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 375/782] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Sep 15 00:32:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:07.628391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e4dad-7cc0-47f4-bc31-6e948f525aac None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:07.672743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8916435-e1c2-4d7f-b0e2-f483a9a4f6b3 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:07.749518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78a4c1-3ec6-4fd2-ab71-24fef2f515c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:07.750135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78a4c1-3ec6-4fd2-ab71-24fef2f515c3 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:07.750417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78a4c1-3ec6-4fd2-ab71-24fef2f515c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:07.750689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78a4c1-3ec6-4fd2-ab71-24fef2f515c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:07.751335 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78a4c1-3ec6-4fd2-ab71-24fef2f515c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:07.751638 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78a4c1-3ec6-4fd2-ab71-24fef2f515c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:07.752994 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78a4c1-3ec6-4fd2-ab71-24fef2f515c3 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:07.774812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 408/783] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:07.776699 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78a4c1-3ec6-4fd2-ab71-24fef2f515c3 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:07.830955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e4dad-7cc0-47f4-bc31-6e948f525aac None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:07.849594 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:07.876153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd74ad1-2b1c-422f-b28c-a4187599abae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:07.877149 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd74ad1-2b1c-422f-b28c-a4187599abae None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:07.877651 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd74ad1-2b1c-422f-b28c-a4187599abae None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:07.878116 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd74ad1-2b1c-422f-b28c-a4187599abae None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:07.878951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd74ad1-2b1c-422f-b28c-a4187599abae None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:07.879445 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd74ad1-2b1c-422f-b28c-a4187599abae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:07.881007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd74ad1-2b1c-422f-b28c-a4187599abae None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:07.887393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 376/784] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Sep 15 00:32:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:07.892954 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd74ad1-2b1c-422f-b28c-a4187599abae None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:07.898060 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78a4c1-3ec6-4fd2-ab71-24fef2f515c3 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:07.914547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:07.965229 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af728999-0919-411b-b31c-e76ad23d60c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:07.965789 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af728999-0919-411b-b31c-e76ad23d60c0 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:07.966070 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af728999-0919-411b-b31c-e76ad23d60c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:07.966342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af728999-0919-411b-b31c-e76ad23d60c0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:07.979766 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af728999-0919-411b-b31c-e76ad23d60c0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:07.985334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af728999-0919-411b-b31c-e76ad23d60c0 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:08.010675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-af728999-0919-411b-b31c-e76ad23d60c0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 00:32:08.010675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:08.010675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:08.010675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:08.010675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:08.010675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:08.010675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:08.010675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:08.010675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:08.010675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:08.010675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:08.010675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:08.010675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:32:08.010675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:32:08.010675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:32:08.010675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:32:08.011659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:08.011659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:08.011659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:32:08.011659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:08.011659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:32:08.011659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:08.011659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:08.011659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:08.011659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:08.011659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:08.011659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:08.011659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:08.011659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:08.011659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:08.011659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:08.011659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:08.011659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:08.011659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:08.012583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:08.012583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:08.012583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:32:08.012583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:32:08.012583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:32:08.012583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:32:08.012583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:32:08.012583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:32:08.012583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 00:32:08.012583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:08.015166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 409/785] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:32:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:08.021352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af728999-0919-411b-b31c-e76ad23d60c0 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:08.067989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd74ad1-2b1c-422f-b28c-a4187599abae None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:08.138495 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe64ae-2598-4fa6-9749-8b3f920e4795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:08.139462 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe64ae-2598-4fa6-9749-8b3f920e4795 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:08.139967 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe64ae-2598-4fa6-9749-8b3f920e4795 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:08.140430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe64ae-2598-4fa6-9749-8b3f920e4795 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:08.141342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe64ae-2598-4fa6-9749-8b3f920e4795 None admin] RBAC: Adding query filter params (interface=public, service_id=9792832ac80c4db0a68d87bd37664512, region_id=RegionOne) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:08.142075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe64ae-2598-4fa6-9749-8b3f920e4795 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:08.143636 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe64ae-2598-4fa6-9749-8b3f920e4795 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:08.152856 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 377/786] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Sep 15 00:32:07 2022] GET /identity/v3/endpoints?service_id=9792832ac80c4db0a68d87bd37664512&interface=public®ion_id=RegionOne => generated 194 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:08.154399 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c735c7-0538-460c-989c-9aa96f0f2ac2 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:08.154928 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c735c7-0538-460c-989c-9aa96f0f2ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:08.155392 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c735c7-0538-460c-989c-9aa96f0f2ac2 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:08.156995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 378/787] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:08.158328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c735c7-0538-460c-989c-9aa96f0f2ac2 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:08.208408 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af728999-0919-411b-b31c-e76ad23d60c0 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:08.233006 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:08.240467 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:08.249343 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85256b66-2720-4104-8741-312544cf90c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:08.250077 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85256b66-2720-4104-8741-312544cf90c9 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:08.250449 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85256b66-2720-4104-8741-312544cf90c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:08.250813 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85256b66-2720-4104-8741-312544cf90c9 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:08.251637 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85256b66-2720-4104-8741-312544cf90c9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:08.252047 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85256b66-2720-4104-8741-312544cf90c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:08.253588 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85256b66-2720-4104-8741-312544cf90c9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:08.270863 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c735c7-0538-460c-989c-9aa96f0f2ac2 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:08.273746 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 410/788] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Sep 15 00:32:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:08.275103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc2030-03c5-440d-b812-cd3a756b2524 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:08.275451 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc2030-03c5-440d-b812-cd3a756b2524 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:08.275812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc2030-03c5-440d-b812-cd3a756b2524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:08.293869 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-68bc2030-03c5-440d-b812-cd3a756b2524 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:08.295270 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-68bc2030-03c5-440d-b812-cd3a756b2524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:08.313794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299ec49-0436-45df-9f35-ae0d6eb7f6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:08.314731 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299ec49-0436-45df-9f35-ae0d6eb7f6ff None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:08.315417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299ec49-0436-45df-9f35-ae0d6eb7f6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:08.316264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299ec49-0436-45df-9f35-ae0d6eb7f6ff None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:08.317152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299ec49-0436-45df-9f35-ae0d6eb7f6ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:08.319815 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299ec49-0436-45df-9f35-ae0d6eb7f6ff None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:08.336584 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 379/789] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Sep 15 00:32:08 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:08.336584 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299ec49-0436-45df-9f35-ae0d6eb7f6ff None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:08.418630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 411/790] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:08.508364 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299ec49-0436-45df-9f35-ae0d6eb7f6ff None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:08.560243 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ae999-37c2-4df8-84cb-9e31132cb626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:08.560888 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ae999-37c2-4df8-84cb-9e31132cb626 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:08.561190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ae999-37c2-4df8-84cb-9e31132cb626 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:08.561460 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ae999-37c2-4df8-84cb-9e31132cb626 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:08.576164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:08.578203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ae999-37c2-4df8-84cb-9e31132cb626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:08.580022 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ae999-37c2-4df8-84cb-9e31132cb626 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:08.595763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-993ae999-37c2-4df8-84cb-9e31132cb626 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:08.595763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:08.595763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:08.595763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:08.595763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:08.595763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:08.595763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:08.595763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:08.595763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:08.595763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:08.595763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:08.595763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:08.595763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:08.595763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:08.595763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:08.595763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:08.596789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:08.596789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:08.596789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:08.596789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:08.596789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:08.596789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:08.596789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:08.596789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:08.596789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:08.596789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:08.596789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:08.596789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:08.596789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:08.596789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:08.596789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:08.596789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:08.596789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:08.597726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:08.597726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:08.597726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:08.597726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 380/791] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:08.606214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc2030-03c5-440d-b812-cd3a756b2524 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:08.730275 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc2030-03c5-440d-b812-cd3a756b2524 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:08.742151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:08.742310 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ae999-37c2-4df8-84cb-9e31132cb626 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:08.773888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23e6f1-9095-4fdf-8733-2626e76b5557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:08.774830 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23e6f1-9095-4fdf-8733-2626e76b5557 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:08.775314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23e6f1-9095-4fdf-8733-2626e76b5557 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:08.775804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23e6f1-9095-4fdf-8733-2626e76b5557 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:08.776803 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23e6f1-9095-4fdf-8733-2626e76b5557 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:08.777126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23e6f1-9095-4fdf-8733-2626e76b5557 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:08.778488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23e6f1-9095-4fdf-8733-2626e76b5557 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:08.791692 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 412/792] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:08.798168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23e6f1-9095-4fdf-8733-2626e76b5557 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:08.891902 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ae999-37c2-4df8-84cb-9e31132cb626 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:08.951351 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfbaab-ed85-499a-aaf3-e4f1ace0bac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:08.951981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfbaab-ed85-499a-aaf3-e4f1ace0bac4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:08.952257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfbaab-ed85-499a-aaf3-e4f1ace0bac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:08.952529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfbaab-ed85-499a-aaf3-e4f1ace0bac4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:08.964540 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfbaab-ed85-499a-aaf3-e4f1ace0bac4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:32:08.970219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-15bfbaab-ed85-499a-aaf3-e4f1ace0bac4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:32:08.970219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:08.970219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:08.970219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:08.970219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:08.970219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:08.970219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:08.970219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:08.970219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:08.970219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:08.970219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:08.970219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:08.970219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:32:08.970219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:32:08.970219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:32:08.970219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:32:08.971161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:32:08.971161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:32:08.971161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:32:08.971161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:32:08.971161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:08.971161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:08.971161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:08.971161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:08.971161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:08.971161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:08.971161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:08.971161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:08.971161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:08.971161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:08.971161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:08.971161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:08.971997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:08.971997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:08.971997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:08.971997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:08.971997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:32:08.971997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:32:08.971997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:32:08.971997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:32:08.971997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:32:08.971997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:32:08.971997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:32:08.971997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:08.971997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 381/793] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:32:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:08.977905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfbaab-ed85-499a-aaf3-e4f1ace0bac4 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:08.983806 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23e6f1-9095-4fdf-8733-2626e76b5557 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:09.025642 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9b2b4-b9f2-4e41-a25c-1b907d4f4a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:09.026345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9b2b4-b9f2-4e41-a25c-1b907d4f4a6e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:09.026739 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9b2b4-b9f2-4e41-a25c-1b907d4f4a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:09.027017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9b2b4-b9f2-4e41-a25c-1b907d4f4a6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:09.034503 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9b2b4-b9f2-4e41-a25c-1b907d4f4a6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:09.036206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9b2b4-b9f2-4e41-a25c-1b907d4f4a6e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:09.049337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-5db9b2b4-b9f2-4e41-a25c-1b907d4f4a6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:09.049337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:09.049337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:09.049337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:09.049337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:09.049337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:09.049337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:09.049337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:09.049337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:09.049337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:09.049337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:09.049337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:09.049337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:32:09.049337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:32:09.049337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:32:09.050300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:32:09.050300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:09.050300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:09.050300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:09.050300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:09.050300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:09.050300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:09.050300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:09.050300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:09.050300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:09.050300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:09.050300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:09.050300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:09.050300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:09.050300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:09.050300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:09.050300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:09.051172 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:32:09.051172 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:32:09.051172 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:32:09.051172 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:32:09.051172 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:32:09.051172 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:32:09.051172 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:09.051172 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:09.051172 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 413/794] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:32:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:09.068872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9b2b4-b9f2-4e41-a25c-1b907d4f4a6e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:09.073988 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:09.117802 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:09.187992 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfbaab-ed85-499a-aaf3-e4f1ace0bac4 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:09.196576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9b2b4-b9f2-4e41-a25c-1b907d4f4a6e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:09.237167 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51be68-13b6-4159-9489-f866739de118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:09.238120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51be68-13b6-4159-9489-f866739de118 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:09.238817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51be68-13b6-4159-9489-f866739de118 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:09.239291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51be68-13b6-4159-9489-f866739de118 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:09.240000 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e58729-802b-49a9-baff-5f47214f5737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:09.240385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51be68-13b6-4159-9489-f866739de118 None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:09.240599 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e58729-802b-49a9-baff-5f47214f5737 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:09.240917 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e58729-802b-49a9-baff-5f47214f5737 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:09.241716 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e58729-802b-49a9-baff-5f47214f5737 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:09.242065 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51be68-13b6-4159-9489-f866739de118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:09.242488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e58729-802b-49a9-baff-5f47214f5737 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:09.242747 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e58729-802b-49a9-baff-5f47214f5737 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:09.244158 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e58729-802b-49a9-baff-5f47214f5737 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:09.244458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51be68-13b6-4159-9489-f866739de118 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:09.259408 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 382/795] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 15 00:32:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:09.260979 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8c403-5a4a-47a2-b3eb-1b05204753fa None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:09.261483 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 414/796] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:32:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:09.261753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8c403-5a4a-47a2-b3eb-1b05204753fa None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:09.262399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e58729-802b-49a9-baff-5f47214f5737 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:09.262640 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8c403-5a4a-47a2-b3eb-1b05204753fa None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:09.264432 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 383/797] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:09.269403 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8c403-5a4a-47a2-b3eb-1b05204753fa None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:09.374497 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:09.386691 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e58729-802b-49a9-baff-5f47214f5737 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:09.392117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8c403-5a4a-47a2-b3eb-1b05204753fa None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:09.407318 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:09.429574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea37398-03f6-4140-8186-6075b9b0d960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:09.430291 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea37398-03f6-4140-8186-6075b9b0d960 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:09.430572 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea37398-03f6-4140-8186-6075b9b0d960 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:09.430843 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea37398-03f6-4140-8186-6075b9b0d960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:09.431340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d7eb5-f046-40f3-982a-ad833bc564b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:09.432201 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d7eb5-f046-40f3-982a-ad833bc564b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:09.432685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d7eb5-f046-40f3-982a-ad833bc564b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:09.433197 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d7eb5-f046-40f3-982a-ad833bc564b3 None admin] PATH_INFO: `/v3/projects/f25792dd210b42c4a3491096a735f909/users/5fb248b85aba45b39132d0f92ede0b68/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:09.435459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d7eb5-f046-40f3-982a-ad833bc564b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f25792dd210b42c4a3491096a735f909, user_id=5fb248b85aba45b39132d0f92ede0b68, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:09.437155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d7eb5-f046-40f3-982a-ad833bc564b3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:09.442238 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea37398-03f6-4140-8186-6075b9b0d960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:09.443665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea37398-03f6-4140-8186-6075b9b0d960 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:09.453386 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 384/798] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:32:09 2022] PUT /identity/v3/projects/f25792dd210b42c4a3491096a735f909/users/5fb248b85aba45b39132d0f92ede0b68/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:32:09.455078 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316579f7-c45c-4171-8e33-3862ce0e9c9f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:09.455610 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316579f7-c45c-4171-8e33-3862ce0e9c9f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:09.456079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316579f7-c45c-4171-8e33-3862ce0e9c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:09.460999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-aea37398-03f6-4140-8186-6075b9b0d960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:09.460999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:09.460999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:09.460999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:09.460999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:09.460999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:09.460999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:09.460999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:09.460999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:09.460999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:09.460999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:09.460999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:09.460999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:09.460999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:09.460999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:09.460999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:09.462071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:09.462071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:09.462071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:09.462071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:09.462071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:09.462071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:09.462071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:09.462071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:09.462071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:09.462071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:09.462071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:09.462071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:09.462071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:09.462071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:09.462071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:09.462071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:09.462071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:09.463063 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:09.463063 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:09.463063 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:09.463063 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 415/799] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:09.469558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea37398-03f6-4140-8186-6075b9b0d960 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:09.484167 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-316579f7-c45c-4171-8e33-3862ce0e9c9f None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:09.485929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-316579f7-c45c-4171-8e33-3862ce0e9c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:09.605040 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 385/800] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:09.677114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea37398-03f6-4140-8186-6075b9b0d960 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:09.715538 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f5b43-537a-469b-bfd2-3f683f1082c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:09.716527 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f5b43-537a-469b-bfd2-3f683f1082c0 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:09.717027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f5b43-537a-469b-bfd2-3f683f1082c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:09.717536 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f5b43-537a-469b-bfd2-3f683f1082c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:09.718385 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f5b43-537a-469b-bfd2-3f683f1082c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:09.718886 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f5b43-537a-469b-bfd2-3f683f1082c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:09.720451 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f5b43-537a-469b-bfd2-3f683f1082c0 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:09.845221 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 416/801] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:09.854173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316579f7-c45c-4171-8e33-3862ce0e9c9f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:09.933712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f5b43-537a-469b-bfd2-3f683f1082c0 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:09.936497 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:09.984904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316579f7-c45c-4171-8e33-3862ce0e9c9f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:09.987372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:10.067007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a4d36-7b92-4a32-87a0-5083708b6c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:10.068015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a4d36-7b92-4a32-87a0-5083708b6c65 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:10.068502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a4d36-7b92-4a32-87a0-5083708b6c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:10.069012 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a4d36-7b92-4a32-87a0-5083708b6c65 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:10.082276 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a4d36-7b92-4a32-87a0-5083708b6c65 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:10.083749 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a4d36-7b92-4a32-87a0-5083708b6c65 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:10.103320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f5b43-537a-469b-bfd2-3f683f1082c0 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:10.108265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-852a4d36-7b92-4a32-87a0-5083708b6c65 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 00:32:10.108265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:10.108265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:10.108265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:10.108265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:10.108265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:10.108265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:10.108265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:10.108265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:10.108265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:10.108265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:10.108265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:10.108265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:32:10.108265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:32:10.108265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:32:10.108265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:32:10.109521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:10.109521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:10.109521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:32:10.109521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:10.109521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:32:10.109521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:10.109521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:10.109521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:10.109521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:10.109521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:10.109521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:10.109521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:10.109521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:10.109521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:10.109521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:10.109521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:10.109521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:10.109521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:10.111050 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:10.111050 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:10.111050 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:32:10.111050 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:32:10.111050 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:32:10.111050 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:32:10.111050 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:32:10.111050 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:32:10.111050 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 00:32:10.111050 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:10.111050 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 386/802] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Sep 15 00:32:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:10.117250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a4d36-7b92-4a32-87a0-5083708b6c65 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:10.147191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571eb0a4-0df0-413b-8155-7ff0f35770bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:10.148271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571eb0a4-0df0-413b-8155-7ff0f35770bb None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:10.148783 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571eb0a4-0df0-413b-8155-7ff0f35770bb None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:10.149306 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571eb0a4-0df0-413b-8155-7ff0f35770bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:10.161846 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571eb0a4-0df0-413b-8155-7ff0f35770bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:32:10.168485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-571eb0a4-0df0-413b-8155-7ff0f35770bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:32:10.168485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:10.168485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:10.168485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:10.168485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:10.168485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:10.168485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:10.168485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:10.168485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:10.168485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:10.168485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:10.168485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:10.168485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:32:10.168485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:32:10.168485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:32:10.168485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:32:10.169465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:32:10.169465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:32:10.169465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:32:10.169465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:32:10.169465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:10.169465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:10.169465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:10.169465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:10.169465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:10.169465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:10.169465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:10.169465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:10.169465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:10.169465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:10.169465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:10.169465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:10.170308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:10.170308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:10.170308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:10.170308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:10.170308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:32:10.170308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:32:10.170308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:32:10.170308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:32:10.170308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:32:10.170308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:32:10.170308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:32:10.170308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:10.179324 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 417/803] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:32:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:10.181695 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d6f67-5d5e-4564-b875-3786f8e60b99 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:10.182511 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d6f67-5d5e-4564-b875-3786f8e60b99 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:10.183278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d6f67-5d5e-4564-b875-3786f8e60b99 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:10.185409 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 418/804] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:10.186321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d6f67-5d5e-4564-b875-3786f8e60b99 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:10.254030 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a4d36-7b92-4a32-87a0-5083708b6c65 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:10.261991 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:10.299128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78759323-a3b1-48ec-a45e-ff49139f614c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:10.299786 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78759323-a3b1-48ec-a45e-ff49139f614c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:10.300066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78759323-a3b1-48ec-a45e-ff49139f614c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:10.300332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78759323-a3b1-48ec-a45e-ff49139f614c None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:10.301316 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78759323-a3b1-48ec-a45e-ff49139f614c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:10.301625 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78759323-a3b1-48ec-a45e-ff49139f614c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:10.303768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78759323-a3b1-48ec-a45e-ff49139f614c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:10.309577 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d6f67-5d5e-4564-b875-3786f8e60b99 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:10.331721 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 387/805] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Sep 15 00:32:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:10.331721 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3d5d1-0654-49ce-be1f-3e8422be621d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:10.331721 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3d5d1-0654-49ce-be1f-3e8422be621d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:10.331721 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3d5d1-0654-49ce-be1f-3e8422be621d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:10.356158 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3ae3d5d1-0654-49ce-be1f-3e8422be621d None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:10.357582 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3ae3d5d1-0654-49ce-be1f-3e8422be621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:10.366922 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fbaf4-c0ca-4796-96db-2aef00bb1f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:10.367806 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fbaf4-c0ca-4796-96db-2aef00bb1f60 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:10.368287 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fbaf4-c0ca-4796-96db-2aef00bb1f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:10.368859 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fbaf4-c0ca-4796-96db-2aef00bb1f60 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:10.369759 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fbaf4-c0ca-4796-96db-2aef00bb1f60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:10.370394 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fbaf4-c0ca-4796-96db-2aef00bb1f60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:10.371945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fbaf4-c0ca-4796-96db-2aef00bb1f60 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:10.376475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:10.383395 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 419/806] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:32:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:10.384459 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fbaf4-c0ca-4796-96db-2aef00bb1f60 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:10.445329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 388/807] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:10.445329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3d5d1-0654-49ce-be1f-3e8422be621d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:10.548944 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fbaf4-c0ca-4796-96db-2aef00bb1f60 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:10.560145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3d5d1-0654-49ce-be1f-3e8422be621d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:10.592660 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:10.605260 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d502d1-73c0-41b1-814c-db6c50db1558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:10.605896 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d502d1-73c0-41b1-814c-db6c50db1558 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:10.606176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d502d1-73c0-41b1-814c-db6c50db1558 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:10.606603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d502d1-73c0-41b1-814c-db6c50db1558 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:10.618567 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d502d1-73c0-41b1-814c-db6c50db1558 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:10.620012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d502d1-73c0-41b1-814c-db6c50db1558 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:10.625724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e026785-fc49-4d20-9413-90f34232a885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:10.626366 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e026785-fc49-4d20-9413-90f34232a885 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:10.626643 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e026785-fc49-4d20-9413-90f34232a885 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:10.626914 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e026785-fc49-4d20-9413-90f34232a885 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:10.637203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-c3d502d1-73c0-41b1-814c-db6c50db1558 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:10.637203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:10.637203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:10.637203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:10.637203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:10.637203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:10.637203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:10.637203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:10.637203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:10.637203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:10.637203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:10.637203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:10.637203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:10.637203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:10.637203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:10.637203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:10.638138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:10.638138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:10.638138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:10.638138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:10.638138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:10.638138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:10.638138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:10.638138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:10.638138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:10.638138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:10.638138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:10.638138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:10.638138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:10.638138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:10.638138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:10.638138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:10.638138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:10.639020 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:10.639020 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:10.639020 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:10.642991 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 420/808] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:10.644260 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d502d1-73c0-41b1-814c-db6c50db1558 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:10.665939 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e026785-fc49-4d20-9413-90f34232a885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:10.667418 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e026785-fc49-4d20-9413-90f34232a885 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:10.708313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-5e026785-fc49-4d20-9413-90f34232a885 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:10.708313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:10.708313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:10.708313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:10.708313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:10.708313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:10.708313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:10.708313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:10.708313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:10.708313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:10.708313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:10.708313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:10.708313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:10.708313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:10.708313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:10.708313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:10.709305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:10.709305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:10.709305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:10.709305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:10.709305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:10.709305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:10.709305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:10.709305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:10.709305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:10.709305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:10.709305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:10.709305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:10.709305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:10.709305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:10.709305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:10.709305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:10.709305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:10.710305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:10.710305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:10.710305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:10.710305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 389/809] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:10.716300 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e026785-fc49-4d20-9413-90f34232a885 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:10.726856 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:10.775416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d502d1-73c0-41b1-814c-db6c50db1558 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:10.828362 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46945a-2003-491b-a749-aa290b80e260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:10.828969 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46945a-2003-491b-a749-aa290b80e260 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:10.829294 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46945a-2003-491b-a749-aa290b80e260 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:10.829569 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46945a-2003-491b-a749-aa290b80e260 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:10.830210 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46945a-2003-491b-a749-aa290b80e260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:10.830513 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46945a-2003-491b-a749-aa290b80e260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:10.832374 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46945a-2003-491b-a749-aa290b80e260 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:10.849166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 421/810] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:10.850856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46945a-2003-491b-a749-aa290b80e260 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:10.878786 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e026785-fc49-4d20-9413-90f34232a885 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:10.888694 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:10.925234 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434c41d-07dc-4ba9-b2f6-017f95bb95ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:10.925884 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434c41d-07dc-4ba9-b2f6-017f95bb95ca None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:10.926158 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434c41d-07dc-4ba9-b2f6-017f95bb95ca None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:10.926418 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434c41d-07dc-4ba9-b2f6-017f95bb95ca None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:10.927083 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434c41d-07dc-4ba9-b2f6-017f95bb95ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:10.927384 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434c41d-07dc-4ba9-b2f6-017f95bb95ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:10.929507 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434c41d-07dc-4ba9-b2f6-017f95bb95ca None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:10.956763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 390/811] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:10.958649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434c41d-07dc-4ba9-b2f6-017f95bb95ca None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:10.970396 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46945a-2003-491b-a749-aa290b80e260 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:11.012227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e320f-c230-4b1f-acae-64b37c4d5a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:11.013634 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e320f-c230-4b1f-acae-64b37c4d5a1e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:11.013634 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e320f-c230-4b1f-acae-64b37c4d5a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:11.013634 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e320f-c230-4b1f-acae-64b37c4d5a1e None admin] PATH_INFO: `/v3/services/network` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:11.014017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e320f-c230-4b1f-acae-64b37c4d5a1e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:11.015369 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e320f-c230-4b1f-acae-64b37c4d5a1e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:11.025564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-388e320f-c230-4b1f-acae-64b37c4d5a1e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 00:32:11.025564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:11.025564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:32:11.025564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:32:11.025564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:32:11.025564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:32:11.025564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:32:11.025564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:11.025564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 00:32:11.025564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:11.025564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:11.025564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:11.025564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:11.025564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:11.025564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:11.025564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:11.025564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:11.026656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:11.026656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:11.026656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:11.026656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:11.026656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:11.026656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:11.026656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:32:11.026656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:32:11.026656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:32:11.026656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:32:11.026656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:11.026656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:11.026656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:11.026656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:11.026656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:11.026656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:11.027501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:11.027501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:11.027501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:11.027501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:11.027501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:11.027501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:11.027501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:11.027501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:11.027501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:11.027501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:11.027501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:32:11.027501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:11.027501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 00:32:11.027501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:11.031550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 422/812] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:32:10 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:11.032555 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e320f-c230-4b1f-acae-64b37c4d5a1e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:11.053904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:11.097552 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434c41d-07dc-4ba9-b2f6-017f95bb95ca None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:11.137129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd24cc-bfb3-415e-a225-d8e8e1bfc0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:11.137997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd24cc-bfb3-415e-a225-d8e8e1bfc0aa None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:11.138274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd24cc-bfb3-415e-a225-d8e8e1bfc0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:11.138539 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd24cc-bfb3-415e-a225-d8e8e1bfc0aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:11.142822 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:11.145367 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd24cc-bfb3-415e-a225-d8e8e1bfc0aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:11.145892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e320f-c230-4b1f-acae-64b37c4d5a1e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:11.146824 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd24cc-bfb3-415e-a225-d8e8e1bfc0aa None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:11.158103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-65bd24cc-bfb3-415e-a225-d8e8e1bfc0aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:11.158103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:11.158103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:11.158103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:11.158103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:11.158103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:11.158103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:11.158103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:11.158103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:11.158103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:11.158103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:11.158103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:11.158103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:32:11.158103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:32:11.158103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:32:11.159049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:32:11.159049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:11.159049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:11.159049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:11.159049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:11.159049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:11.159049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:11.159049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:11.159049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:11.159049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:11.159049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:11.159049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:11.159049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:11.159049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:11.159049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:11.159049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:11.159049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:11.160553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:32:11.160553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:32:11.160553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:32:11.160553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:32:11.160553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:32:11.160553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:32:11.160553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:11.160553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:11.160553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 391/813] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:32:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:11.160553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd24cc-bfb3-415e-a225-d8e8e1bfc0aa None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:11.189330 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34746510-aaa9-4cd6-b34e-8c3bec962e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:11.190231 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34746510-aaa9-4cd6-b34e-8c3bec962e22 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:11.190511 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34746510-aaa9-4cd6-b34e-8c3bec962e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:11.190781 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34746510-aaa9-4cd6-b34e-8c3bec962e22 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:11.199215 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34746510-aaa9-4cd6-b34e-8c3bec962e22 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:11.200632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34746510-aaa9-4cd6-b34e-8c3bec962e22 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:11.213703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-34746510-aaa9-4cd6-b34e-8c3bec962e22 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 00:32:11.213703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:11.213703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:11.213703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:11.213703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:11.213703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:11.213703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:11.213703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:11.213703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:11.213703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:11.213703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:11.213703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:11.213703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:32:11.213703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:32:11.213703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:32:11.213703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:32:11.219348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:11.219348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:11.219348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:32:11.219348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:11.219348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:32:11.219348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:11.219348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:11.219348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:11.219348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:11.219348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:11.219348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:11.219348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:11.219348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:11.219348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:11.219348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:11.219348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:11.219348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:11.219348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:11.220540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:11.220540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:11.220540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:32:11.220540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:32:11.220540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:32:11.220540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:32:11.220540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:32:11.220540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:32:11.220540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 00:32:11.220540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:11.220540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 423/814] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Sep 15 00:32:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:11.220540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f1a51-816e-4c59-97f0-c61c2c49a90a None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:11.220540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f1a51-816e-4c59-97f0-c61c2c49a90a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:11.221591 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f1a51-816e-4c59-97f0-c61c2c49a90a None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:11.221591 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 424/815] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:11.221591 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f1a51-816e-4c59-97f0-c61c2c49a90a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:11.268887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd24cc-bfb3-415e-a225-d8e8e1bfc0aa None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:11.292402 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:11.305256 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff970c9f-7237-4e69-9aca-c904be1946f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:11.306049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff970c9f-7237-4e69-9aca-c904be1946f2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:11.306325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff970c9f-7237-4e69-9aca-c904be1946f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:11.306593 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff970c9f-7237-4e69-9aca-c904be1946f2 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:11.307210 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff970c9f-7237-4e69-9aca-c904be1946f2 None admin] RBAC: Adding query filter params (name=network) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:11.307508 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff970c9f-7237-4e69-9aca-c904be1946f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:11.308866 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff970c9f-7237-4e69-9aca-c904be1946f2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:11.313290 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 392/816] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 15 00:32:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:11.314042 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff970c9f-7237-4e69-9aca-c904be1946f2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:11.336191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f1a51-816e-4c59-97f0-c61c2c49a90a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:11.380075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ffa47-2829-4216-870c-4dfd52adb1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:11.380671 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ffa47-2829-4216-870c-4dfd52adb1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:11.381066 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ffa47-2829-4216-870c-4dfd52adb1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:11.381370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ffa47-2829-4216-870c-4dfd52adb1b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:11.382159 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ffa47-2829-4216-870c-4dfd52adb1b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:11.382462 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ffa47-2829-4216-870c-4dfd52adb1b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:11.383928 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ffa47-2829-4216-870c-4dfd52adb1b0 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:11.401121 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 425/817] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:32:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:11.401121 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3b93b-fd0c-4853-ad13-e2769706487a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:11.401121 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3b93b-fd0c-4853-ad13-e2769706487a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:11.401121 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3b93b-fd0c-4853-ad13-e2769706487a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:11.417703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-cfc3b93b-fd0c-4853-ad13-e2769706487a None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:11.418983 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cfc3b93b-fd0c-4853-ad13-e2769706487a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:11.427498 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff970c9f-7237-4e69-9aca-c904be1946f2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:11.434210 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:11.461858 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e07f9-4ec2-4b59-ba61-2bae27c3e896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:11.462459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e07f9-4ec2-4b59-ba61-2bae27c3e896 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:11.462735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e07f9-4ec2-4b59-ba61-2bae27c3e896 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:11.463001 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e07f9-4ec2-4b59-ba61-2bae27c3e896 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:11.463770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e07f9-4ec2-4b59-ba61-2bae27c3e896 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:11.464018 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e07f9-4ec2-4b59-ba61-2bae27c3e896 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:11.465462 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e07f9-4ec2-4b59-ba61-2bae27c3e896 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:11.483759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 393/818] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Sep 15 00:32:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:11.486517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e07f9-4ec2-4b59-ba61-2bae27c3e896 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:11.493679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 426/819] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:11.494552 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3b93b-fd0c-4853-ad13-e2769706487a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:11.541344 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:11.596625 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e07f9-4ec2-4b59-ba61-2bae27c3e896 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:11.617989 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3b93b-fd0c-4853-ad13-e2769706487a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:11.634453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118242f-9968-4e3c-ba81-5194bda7b4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:11.635757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118242f-9968-4e3c-ba81-5194bda7b4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:11.636509 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118242f-9968-4e3c-ba81-5194bda7b4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:11.637021 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118242f-9968-4e3c-ba81-5194bda7b4e9 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:11.638546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118242f-9968-4e3c-ba81-5194bda7b4e9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:11.639358 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118242f-9968-4e3c-ba81-5194bda7b4e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:11.641018 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118242f-9968-4e3c-ba81-5194bda7b4e9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:11.647445 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 394/820] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 15 00:32:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:11.648536 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118242f-9968-4e3c-ba81-5194bda7b4e9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:11.668853 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7c510-1bff-4842-ab39-6f89b44c2eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:11.669610 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7c510-1bff-4842-ab39-6f89b44c2eeb None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:11.669830 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7c510-1bff-4842-ab39-6f89b44c2eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:11.670107 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7c510-1bff-4842-ab39-6f89b44c2eeb None admin] PATH_INFO: `/v3/projects/f25792dd210b42c4a3491096a735f909/users/ed49a596f15542a29ce331bae4640274/roles/e5b76a8345d542c2a899f8dbdd95290d` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:11.689145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7c510-1bff-4842-ab39-6f89b44c2eeb None admin] RBAC: Authorizing `identity:create_grant(project_id=f25792dd210b42c4a3491096a735f909, user_id=ed49a596f15542a29ce331bae4640274, role_id=e5b76a8345d542c2a899f8dbdd95290d)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:11.691507 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7c510-1bff-4842-ab39-6f89b44c2eeb None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:11.705263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:11.717251 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 427/821] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:32:11 2022] PUT /identity/v3/projects/f25792dd210b42c4a3491096a735f909/users/ed49a596f15542a29ce331bae4640274/roles/e5b76a8345d542c2a899f8dbdd95290d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:32:11.718616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7c510-1bff-4842-ab39-6f89b44c2eeb None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:11.799603 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118242f-9968-4e3c-ba81-5194bda7b4e9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:11.813591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:11.840970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29497d06-16c9-4c4b-af8a-f475f1bf7c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:11.842330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29497d06-16c9-4c4b-af8a-f475f1bf7c63 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:11.842855 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29497d06-16c9-4c4b-af8a-f475f1bf7c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:11.843401 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29497d06-16c9-4c4b-af8a-f475f1bf7c63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:11.873267 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7c510-1bff-4842-ab39-6f89b44c2eeb None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:11.916840 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20162fc-c540-43bb-aecd-9db1bbe2da9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:11.917488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20162fc-c540-43bb-aecd-9db1bbe2da9c None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:11.917764 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20162fc-c540-43bb-aecd-9db1bbe2da9c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:11.918032 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20162fc-c540-43bb-aecd-9db1bbe2da9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:11.918704 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20162fc-c540-43bb-aecd-9db1bbe2da9c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:11.920661 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20162fc-c540-43bb-aecd-9db1bbe2da9c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:11.924973 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29497d06-16c9-4c4b-af8a-f475f1bf7c63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:11.926860 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29497d06-16c9-4c4b-af8a-f475f1bf7c63 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:11.948228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 428/822] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:32:11 2022] POST /identity/v3/endpoints => generated 337 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:32:11.948228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20162fc-c540-43bb-aecd-9db1bbe2da9c None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:12.027242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:12.063426 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 395/823] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:32:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 00:32:12.070386 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29497d06-16c9-4c4b-af8a-f475f1bf7c63 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:12.083519 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:12.106699 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20162fc-c540-43bb-aecd-9db1bbe2da9c None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:12.152868 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d639ab-a0c0-46fe-8d04-4fc9585149d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:12.154328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d639ab-a0c0-46fe-8d04-4fc9585149d5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:12.154807 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d639ab-a0c0-46fe-8d04-4fc9585149d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:12.155222 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d639ab-a0c0-46fe-8d04-4fc9585149d5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:12.155989 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d639ab-a0c0-46fe-8d04-4fc9585149d5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:12.157537 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d639ab-a0c0-46fe-8d04-4fc9585149d5 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:12.169111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-c3d639ab-a0c0-46fe-8d04-4fc9585149d5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 00:32:12.169111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:12.169111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:32:12.169111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:32:12.169111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:32:12.169111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:32:12.169111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:32:12.169111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:12.169111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 00:32:12.169111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:12.169111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:12.169111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:12.169111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:12.169111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:12.169111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:12.169111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:12.169111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:12.170352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:12.170352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:12.170352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:12.170352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:12.170352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:12.170352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:12.170352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:32:12.170352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:32:12.170352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:32:12.170352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:32:12.170352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:12.170352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:12.170352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:12.170352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:12.170352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:12.170352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:12.171328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:12.171328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:12.171328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:12.171328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:12.171328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:12.171328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:12.171328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:12.171328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:12.171328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:12.171328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:12.171328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:32:12.171328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:12.171328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 00:32:12.171328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:12.173647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 429/824] 10.222.0.52 () {56 vars in 1129 bytes} [Thu Sep 15 00:32:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:12.175189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b5287-db29-4fba-af46-f6247d8f66dc None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:12.175624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b5287-db29-4fba-af46-f6247d8f66dc None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:12.176034 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b5287-db29-4fba-af46-f6247d8f66dc None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:12.177874 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 430/825] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:12.186470 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb5a87-4ef7-4d90-ac26-b67c22862472 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:12.186862 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb5a87-4ef7-4d90-ac26-b67c22862472 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:12.187193 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb5a87-4ef7-4d90-ac26-b67c22862472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:12.201408 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29497d06-16c9-4c4b-af8a-f475f1bf7c63 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:12.211386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-70cb5a87-4ef7-4d90-ac26-b67c22862472 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:12.212557 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-70cb5a87-4ef7-4d90-ac26-b67c22862472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:12.257112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d9d0e-737c-44e1-a98e-04f685f9c171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:12.257785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d9d0e-737c-44e1-a98e-04f685f9c171 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:12.258064 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d9d0e-737c-44e1-a98e-04f685f9c171 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:12.258336 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d9d0e-737c-44e1-a98e-04f685f9c171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:12.275438 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d9d0e-737c-44e1-a98e-04f685f9c171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:12.276990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d9d0e-737c-44e1-a98e-04f685f9c171 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:12.292446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-337d9d0e-737c-44e1-a98e-04f685f9c171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:12.292446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:12.292446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:12.292446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:12.292446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:12.292446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:12.292446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:12.292446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:12.292446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:12.292446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:12.292446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:12.292446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:12.292446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:12.292446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:12.292446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:12.292446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:12.293695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:12.293695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:12.293695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:12.293695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:12.293695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:12.293695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:12.293695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:12.293695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:12.293695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:12.293695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:12.293695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:12.293695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:12.293695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:12.293695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:12.293695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:12.293695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:12.293695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:12.294775 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:12.294775 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:12.294775 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:12.298985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 396/826] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:12.299817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d9d0e-737c-44e1-a98e-04f685f9c171 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:12.301215 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 431/827] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:12.302235 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb5a87-4ef7-4d90-ac26-b67c22862472 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:12.359683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:12.399444 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:12.427864 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb5a87-4ef7-4d90-ac26-b67c22862472 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:12.443421 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d9d0e-737c-44e1-a98e-04f685f9c171 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:12.471926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b1fcb-6f9c-44f6-bfc8-eff3449aa77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:12.473079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b1fcb-6f9c-44f6-bfc8-eff3449aa77a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:12.473499 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b1fcb-6f9c-44f6-bfc8-eff3449aa77a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:12.474094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b1fcb-6f9c-44f6-bfc8-eff3449aa77a None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:12.474809 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b1fcb-6f9c-44f6-bfc8-eff3449aa77a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:12.475264 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b1fcb-6f9c-44f6-bfc8-eff3449aa77a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:12.476859 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b1fcb-6f9c-44f6-bfc8-eff3449aa77a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:12.481362 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058bf12-3974-4210-9f49-a051b2d8dbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:12.482190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058bf12-3974-4210-9f49-a051b2d8dbb7 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:12.482640 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058bf12-3974-4210-9f49-a051b2d8dbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:12.483086 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058bf12-3974-4210-9f49-a051b2d8dbb7 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:12.484265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058bf12-3974-4210-9f49-a051b2d8dbb7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:12.484738 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058bf12-3974-4210-9f49-a051b2d8dbb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:12.486427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058bf12-3974-4210-9f49-a051b2d8dbb7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:12.492066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 397/828] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Sep 15 00:32:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:12.496570 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 432/829] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:12.497551 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058bf12-3974-4210-9f49-a051b2d8dbb7 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:12.498396 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b1fcb-6f9c-44f6-bfc8-eff3449aa77a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:12.606597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058bf12-3974-4210-9f49-a051b2d8dbb7 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:12.619205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b1fcb-6f9c-44f6-bfc8-eff3449aa77a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:12.628776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:12.634498 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:12.644189 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baae9ec-c6c6-463e-ae9f-0abc73883c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:12.644793 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baae9ec-c6c6-463e-ae9f-0abc73883c63 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:12.645075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baae9ec-c6c6-463e-ae9f-0abc73883c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:12.645389 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baae9ec-c6c6-463e-ae9f-0abc73883c63 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:12.646031 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baae9ec-c6c6-463e-ae9f-0abc73883c63 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:12.646332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baae9ec-c6c6-463e-ae9f-0abc73883c63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:12.647726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baae9ec-c6c6-463e-ae9f-0abc73883c63 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:12.653321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 398/830] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Sep 15 00:32:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:12.654391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baae9ec-c6c6-463e-ae9f-0abc73883c63 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:12.661795 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7b3de-35ca-4e9c-a868-6e2a1eeda08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:12.662733 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7b3de-35ca-4e9c-a868-6e2a1eeda08f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:12.663189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7b3de-35ca-4e9c-a868-6e2a1eeda08f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:12.663631 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7b3de-35ca-4e9c-a868-6e2a1eeda08f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:12.671803 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7b3de-35ca-4e9c-a868-6e2a1eeda08f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:12.673419 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7b3de-35ca-4e9c-a868-6e2a1eeda08f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:12.685321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-5fc7b3de-35ca-4e9c-a868-6e2a1eeda08f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:12.685321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:12.685321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:12.685321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:12.685321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:12.685321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:12.685321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:12.685321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:12.685321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:12.685321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:12.685321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:12.685321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:12.685321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:32:12.685321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:32:12.685321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:32:12.686271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:32:12.686271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:12.686271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:12.686271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:12.686271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:12.686271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:12.686271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:12.686271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:12.686271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:12.686271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:12.686271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:12.686271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:12.686271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:12.686271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:12.686271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:12.686271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:12.686271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:12.687160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:32:12.687160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:32:12.687160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:32:12.687160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:32:12.687160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:32:12.687160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:32:12.687160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:12.687160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:12.689208 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 433/831] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:32:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:12.690148 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7b3de-35ca-4e9c-a868-6e2a1eeda08f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:12.771018 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baae9ec-c6c6-463e-ae9f-0abc73883c63 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:12.800778 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7b3de-35ca-4e9c-a868-6e2a1eeda08f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:12.807162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda6510-22a2-4673-8cc2-ae5cb8349cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:12.807838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda6510-22a2-4673-8cc2-ae5cb8349cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:12.808119 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda6510-22a2-4673-8cc2-ae5cb8349cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:12.808791 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda6510-22a2-4673-8cc2-ae5cb8349cb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:12.820179 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda6510-22a2-4673-8cc2-ae5cb8349cb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:32:12.825430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-ddda6510-22a2-4673-8cc2-ae5cb8349cb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:32:12.825430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:12.825430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:12.825430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:12.825430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:12.825430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:12.825430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:12.825430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:12.825430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:12.825430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:12.825430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:12.825430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:12.825430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:32:12.825430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:32:12.825430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:32:12.825430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:32:12.826331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:32:12.826331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:32:12.826331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:32:12.826331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:32:12.826331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:12.826331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:12.826331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:12.826331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:12.826331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:12.826331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:12.826331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:12.826331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:12.826331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:12.826331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:12.826331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:12.826331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:12.827157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:12.827157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:12.827157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:12.827157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:12.827157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:32:12.827157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:32:12.827157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:32:12.827157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:32:12.827157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:32:12.827157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:32:12.827157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:32:12.827157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:12.827157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 399/832] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:32:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:12.827832 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda6510-22a2-4673-8cc2-ae5cb8349cb9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:12.842646 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728b81b-b0c8-4bc5-94d6-f17126657592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:12.843247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728b81b-b0c8-4bc5-94d6-f17126657592 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:12.843526 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728b81b-b0c8-4bc5-94d6-f17126657592 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:12.843807 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728b81b-b0c8-4bc5-94d6-f17126657592 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:12.844462 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728b81b-b0c8-4bc5-94d6-f17126657592 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:12.845856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728b81b-b0c8-4bc5-94d6-f17126657592 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:12.866896 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 434/833] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:32:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:32:12.867630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728b81b-b0c8-4bc5-94d6-f17126657592 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:12.889871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:12.906201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:12.967066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda6510-22a2-4673-8cc2-ae5cb8349cb9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:13.012782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728b81b-b0c8-4bc5-94d6-f17126657592 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:13.018173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7972a2-e2f9-4bb4-8c8a-12bc73e338d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:13.018951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7972a2-e2f9-4bb4-8c8a-12bc73e338d8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:13.019322 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7972a2-e2f9-4bb4-8c8a-12bc73e338d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:13.019717 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7972a2-e2f9-4bb4-8c8a-12bc73e338d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:13.020525 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7972a2-e2f9-4bb4-8c8a-12bc73e338d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:13.020936 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7972a2-e2f9-4bb4-8c8a-12bc73e338d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:13.024339 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7972a2-e2f9-4bb4-8c8a-12bc73e338d8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:13.047075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 400/834] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:32:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:13.048976 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7972a2-e2f9-4bb4-8c8a-12bc73e338d8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:13.063380 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a747a-a9be-4485-a5dd-d61d2d8f8eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:13.065285 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a747a-a9be-4485-a5dd-d61d2d8f8eff None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:13.065570 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a747a-a9be-4485-a5dd-d61d2d8f8eff None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:13.065854 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a747a-a9be-4485-a5dd-d61d2d8f8eff None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:13.066804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a747a-a9be-4485-a5dd-d61d2d8f8eff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:13.067110 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a747a-a9be-4485-a5dd-d61d2d8f8eff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:13.068656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a747a-a9be-4485-a5dd-d61d2d8f8eff None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:13.079569 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 435/835] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:32:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:13.085910 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a747a-a9be-4485-a5dd-d61d2d8f8eff None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:13.179590 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:13.191671 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7972a2-e2f9-4bb4-8c8a-12bc73e338d8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:13.203465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a747a-a9be-4485-a5dd-d61d2d8f8eff None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:13.206986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:13.239606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171f1fc-0ff2-4961-bd71-98e10906035e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:13.241245 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171f1fc-0ff2-4961-bd71-98e10906035e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:13.242059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171f1fc-0ff2-4961-bd71-98e10906035e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:13.242779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171f1fc-0ff2-4961-bd71-98e10906035e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:13.243709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171f1fc-0ff2-4961-bd71-98e10906035e None admin] RBAC: Adding query filter params (role.id=0ee2daa9cb3c41fb901603e3d8caf784, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=bfcfcf8061f24231858b9b0205a8abaa) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:13.244159 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171f1fc-0ff2-4961-bd71-98e10906035e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:13.245938 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171f1fc-0ff2-4961-bd71-98e10906035e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:13.246862 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf76b1-88f2-497d-925b-a508f2aa3b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:13.247560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf76b1-88f2-497d-925b-a508f2aa3b13 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:13.247912 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf76b1-88f2-497d-925b-a508f2aa3b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:13.248518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf76b1-88f2-497d-925b-a508f2aa3b13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:13.257930 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 401/836] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:32:13 2022] GET /identity/v3/role_assignments?user.id=bfcfcf8061f24231858b9b0205a8abaa&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=0ee2daa9cb3c41fb901603e3d8caf784 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:13.269328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf76b1-88f2-497d-925b-a508f2aa3b13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:13.270810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf76b1-88f2-497d-925b-a508f2aa3b13 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:13.288206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-ebaf76b1-88f2-497d-925b-a508f2aa3b13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:13.288206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:13.288206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:13.288206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:13.288206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:13.288206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:13.288206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:13.288206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:13.288206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:13.288206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:13.288206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:13.288206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:13.288206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:13.288206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:13.288206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:13.288206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:13.289438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:13.289438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:13.289438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:13.289438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:13.289438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:13.289438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:13.289438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:13.289438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:13.289438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:13.289438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:13.289438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:13.289438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:13.289438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:13.289438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:13.289438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:13.289438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:13.289438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:13.290390 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:13.290390 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:13.290390 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:13.290390 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 436/837] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:13.295215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171f1fc-0ff2-4961-bd71-98e10906035e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:13.411564 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171f1fc-0ff2-4961-bd71-98e10906035e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:13.450721 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e7801-e75c-499b-935a-d7d086ec28f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:13.451248 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e7801-e75c-499b-935a-d7d086ec28f5 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:13.451524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e7801-e75c-499b-935a-d7d086ec28f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:13.451795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e7801-e75c-499b-935a-d7d086ec28f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:13.452537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e7801-e75c-499b-935a-d7d086ec28f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:13.452842 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e7801-e75c-499b-935a-d7d086ec28f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:13.454242 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e7801-e75c-499b-935a-d7d086ec28f5 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:13.467200 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 402/838] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:13.472424 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf76b1-88f2-497d-925b-a508f2aa3b13 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:13.579374 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf76b1-88f2-497d-925b-a508f2aa3b13 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:13.609724 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:13.616363 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e6526-484d-4fb6-8d45-f8d72e2a6dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:13.617030 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e6526-484d-4fb6-8d45-f8d72e2a6dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:13.617736 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e6526-484d-4fb6-8d45-f8d72e2a6dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:13.618381 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e6526-484d-4fb6-8d45-f8d72e2a6dd4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:13.626849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e6526-484d-4fb6-8d45-f8d72e2a6dd4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:13.628275 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e6526-484d-4fb6-8d45-f8d72e2a6dd4 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:13.640133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-b34e6526-484d-4fb6-8d45-f8d72e2a6dd4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 00:32:13.640133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:13.640133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:13.640133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:13.640133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:13.640133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:13.640133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:13.640133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:13.640133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:13.640133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:13.640133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:13.640133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:13.640133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:32:13.640133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:32:13.640133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:32:13.640133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:32:13.641117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:13.641117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:13.641117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:32:13.641117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:13.641117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:32:13.641117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:13.641117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:13.641117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:13.641117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:13.641117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:13.641117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:13.641117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:13.641117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:13.641117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:13.641117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:13.641117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:13.641117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:13.641117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:13.642072 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:13.642072 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:13.642072 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:32:13.642072 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:32:13.642072 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:32:13.642072 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:32:13.642072 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:32:13.642072 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:32:13.642072 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 00:32:13.642072 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:13.642072 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 437/839] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:32:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:13.648995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e7801-e75c-499b-935a-d7d086ec28f5 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:13.685491 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:13.759100 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e7801-e75c-499b-935a-d7d086ec28f5 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:13.794352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fad89-45b7-4f87-bfee-e916a55e1bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:13.794959 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fad89-45b7-4f87-bfee-e916a55e1bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:13.795234 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fad89-45b7-4f87-bfee-e916a55e1bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:13.795507 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fad89-45b7-4f87-bfee-e916a55e1bf2 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:13.796231 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fad89-45b7-4f87-bfee-e916a55e1bf2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:13.796533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fad89-45b7-4f87-bfee-e916a55e1bf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:13.797986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fad89-45b7-4f87-bfee-e916a55e1bf2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:13.816660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 403/840] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Sep 15 00:32:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:13.826140 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e6526-484d-4fb6-8d45-f8d72e2a6dd4 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:13.933739 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e6526-484d-4fb6-8d45-f8d72e2a6dd4 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:13.974361 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7341758-b615-4780-8248-c34de2c120d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:13.975927 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7341758-b615-4780-8248-c34de2c120d9 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:13.976411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7341758-b615-4780-8248-c34de2c120d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:13.976880 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7341758-b615-4780-8248-c34de2c120d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:14.039237 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:14.049775 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7341758-b615-4780-8248-c34de2c120d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:14.051469 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7341758-b615-4780-8248-c34de2c120d9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:14.066737 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355daab-e158-4806-a7ab-805e109a1d10 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:14.067336 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355daab-e158-4806-a7ab-805e109a1d10 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:14.067950 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355daab-e158-4806-a7ab-805e109a1d10 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:14.073115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 404/841] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:14.075287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c4cf7-e4d5-4d8e-add3-f5bb8b9aa207 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:14.075798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c4cf7-e4d5-4d8e-add3-f5bb8b9aa207 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:14.076265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c4cf7-e4d5-4d8e-add3-f5bb8b9aa207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:14.095441 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c97c4cf7-e4d5-4d8e-add3-f5bb8b9aa207 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:14.096969 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c97c4cf7-e4d5-4d8e-add3-f5bb8b9aa207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:14.172321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 438/842] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:32:13 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 00:32:14.173387 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7341758-b615-4780-8248-c34de2c120d9 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:14.181118 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 405/843] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 00:32:14.274024 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:14.282993 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7341758-b615-4780-8248-c34de2c120d9 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:14.320394 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a595c-07f5-4c68-9c8d-a1a29fa0f56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:14.321112 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a595c-07f5-4c68-9c8d-a1a29fa0f56b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:14.321731 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a595c-07f5-4c68-9c8d-a1a29fa0f56b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:14.322008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a595c-07f5-4c68-9c8d-a1a29fa0f56b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:14.332655 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a595c-07f5-4c68-9c8d-a1a29fa0f56b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:14.334153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a595c-07f5-4c68-9c8d-a1a29fa0f56b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:14.349717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-345a595c-07f5-4c68-9c8d-a1a29fa0f56b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:14.349717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:14.349717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:14.349717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:14.349717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:14.349717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:14.349717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:14.349717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:14.349717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:14.349717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:14.349717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:14.349717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:14.349717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:14.349717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:14.349717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:14.349717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:14.351227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:14.351227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:14.351227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:14.351227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:14.351227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:14.351227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:14.351227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:14.351227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:14.351227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:14.351227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:14.351227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:14.351227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:14.351227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:14.351227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:14.351227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:14.351227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:14.351227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:14.352131 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:14.352131 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:14.352131 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:14.352131 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 439/844] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:14.357462 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c4cf7-e4d5-4d8e-add3-f5bb8b9aa207 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:14.382340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:14.463857 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c4cf7-e4d5-4d8e-add3-f5bb8b9aa207 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:14.476533 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a595c-07f5-4c68-9c8d-a1a29fa0f56b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:14.498979 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9f0a0-0c52-4a40-ba08-52ecad91097e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:14.499871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9f0a0-0c52-4a40-ba08-52ecad91097e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:14.500372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9f0a0-0c52-4a40-ba08-52ecad91097e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:14.500848 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9f0a0-0c52-4a40-ba08-52ecad91097e None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:14.501712 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9f0a0-0c52-4a40-ba08-52ecad91097e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:14.502206 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9f0a0-0c52-4a40-ba08-52ecad91097e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:14.503776 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9f0a0-0c52-4a40-ba08-52ecad91097e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:14.516181 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 406/845] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:14.521374 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9f0a0-0c52-4a40-ba08-52ecad91097e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:14.596575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a595c-07f5-4c68-9c8d-a1a29fa0f56b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:14.604774 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:14.623869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9f0a0-0c52-4a40-ba08-52ecad91097e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:14.635737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3f9d0-0fb6-40af-9fa1-ad32998d5bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:14.636437 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3f9d0-0fb6-40af-9fa1-ad32998d5bef None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:14.636643 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3f9d0-0fb6-40af-9fa1-ad32998d5bef None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:14.636968 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3f9d0-0fb6-40af-9fa1-ad32998d5bef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:14.648939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3f9d0-0fb6-40af-9fa1-ad32998d5bef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:32:14.654890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-a9c3f9d0-0fb6-40af-9fa1-ad32998d5bef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:32:14.654890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:14.654890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:14.654890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:14.654890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:14.654890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:14.654890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:14.654890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:14.654890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:14.654890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:14.654890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:14.654890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:14.654890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:32:14.654890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:32:14.654890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:32:14.654890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:32:14.655996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:32:14.655996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:32:14.655996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:32:14.655996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:32:14.655996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:14.655996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:14.655996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:14.655996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:14.655996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:14.655996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:14.655996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:14.655996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:14.655996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:14.655996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:14.655996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:14.655996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:14.657031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:14.657031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:14.657031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:14.657031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:14.657031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:32:14.657031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:32:14.657031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:32:14.657031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:32:14.657031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:32:14.657031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:32:14.657031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:32:14.657031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:14.661174 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 440/846] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:32:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:14.664940 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3f9d0-0fb6-40af-9fa1-ad32998d5bef None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:14.666296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6348c-4ee3-4422-a989-795134599725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:14.667148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6348c-4ee3-4422-a989-795134599725 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:14.667595 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6348c-4ee3-4422-a989-795134599725 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:14.668029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6348c-4ee3-4422-a989-795134599725 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:14.669391 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:14.675817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6348c-4ee3-4422-a989-795134599725 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:14.677579 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6348c-4ee3-4422-a989-795134599725 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:14.689669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-67b6348c-4ee3-4422-a989-795134599725 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:14.689669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:14.689669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:14.689669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:14.689669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:14.689669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:14.689669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:14.689669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:14.689669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:14.689669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:14.689669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:14.689669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:14.689669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:32:14.689669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:32:14.689669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:32:14.690622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:32:14.690622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:14.690622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:14.690622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:14.690622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:14.690622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:14.690622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:14.690622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:14.690622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:14.690622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:14.690622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:14.690622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:14.690622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:14.690622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:14.690622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:14.690622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:14.690622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:14.691500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:32:14.691500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:32:14.691500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:32:14.691500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:32:14.691500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:32:14.691500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:32:14.691500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:14.691500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:14.694367 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 407/847] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:32:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:14.699681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6348c-4ee3-4422-a989-795134599725 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:14.783338 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3f9d0-0fb6-40af-9fa1-ad32998d5bef None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:14.801793 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6348c-4ee3-4422-a989-795134599725 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:14.821687 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580dd1a-0d1f-4ce1-ae67-22f82d7b06e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:14.822322 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580dd1a-0d1f-4ce1-ae67-22f82d7b06e4 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:14.822640 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580dd1a-0d1f-4ce1-ae67-22f82d7b06e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:14.822953 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580dd1a-0d1f-4ce1-ae67-22f82d7b06e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:14.823623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580dd1a-0d1f-4ce1-ae67-22f82d7b06e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:14.823925 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580dd1a-0d1f-4ce1-ae67-22f82d7b06e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:14.825648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580dd1a-0d1f-4ce1-ae67-22f82d7b06e4 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:14.837299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 441/848] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 15 00:32:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:14.840864 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580dd1a-0d1f-4ce1-ae67-22f82d7b06e4 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:14.844632 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0078219-84a7-4021-ab5b-b631730ca26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:14.845267 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0078219-84a7-4021-ab5b-b631730ca26e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:14.845543 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0078219-84a7-4021-ab5b-b631730ca26e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:14.845809 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0078219-84a7-4021-ab5b-b631730ca26e None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:14.846988 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0078219-84a7-4021-ab5b-b631730ca26e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:14.846988 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0078219-84a7-4021-ab5b-b631730ca26e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:14.848203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0078219-84a7-4021-ab5b-b631730ca26e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:14.866350 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 408/849] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:32:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:14.867408 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0078219-84a7-4021-ab5b-b631730ca26e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:14.870957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:14.926618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:14.968152 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580dd1a-0d1f-4ce1-ae67-22f82d7b06e4 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:14.982779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0078219-84a7-4021-ab5b-b631730ca26e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:15.007955 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6755fb-ab5b-45e2-b9e2-186055f901ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:15.009139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6755fb-ab5b-45e2-b9e2-186055f901ca None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:15.009637 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6755fb-ab5b-45e2-b9e2-186055f901ca None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:15.010110 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6755fb-ab5b-45e2-b9e2-186055f901ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:15.020069 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515ae32-43c9-472f-a3a9-8d2ba58866e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:15.020667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515ae32-43c9-472f-a3a9-8d2ba58866e2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:15.020996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515ae32-43c9-472f-a3a9-8d2ba58866e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:15.021299 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515ae32-43c9-472f-a3a9-8d2ba58866e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:15.022133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515ae32-43c9-472f-a3a9-8d2ba58866e2 None admin] RBAC: Adding query filter params (role.id=0ee2daa9cb3c41fb901603e3d8caf784, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=5fb248b85aba45b39132d0f92ede0b68) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:15.022442 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515ae32-43c9-472f-a3a9-8d2ba58866e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:15.023922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515ae32-43c9-472f-a3a9-8d2ba58866e2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:15.029318 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6755fb-ab5b-45e2-b9e2-186055f901ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:15.037113 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 409/850] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:32:14 2022] GET /identity/v3/role_assignments?user.id=5fb248b85aba45b39132d0f92ede0b68&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=0ee2daa9cb3c41fb901603e3d8caf784 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:15.038140 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6755fb-ab5b-45e2-b9e2-186055f901ca None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:15.059017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-5b6755fb-ab5b-45e2-b9e2-186055f901ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:15.059017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:15.059017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:15.059017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:15.059017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:15.059017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:15.059017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:15.059017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:15.059017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:15.059017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:15.059017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:15.059017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:15.059017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:15.059017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:15.059017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:15.059017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:15.060040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:15.060040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:15.060040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:15.060040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:15.060040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:15.060040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:15.060040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:15.060040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:15.060040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:15.060040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:15.060040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:15.060040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:15.060040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:15.060040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:15.060040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:15.060040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:15.060040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:15.060928 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:15.060928 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:15.060928 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:15.060928 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 442/851] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:15.086804 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515ae32-43c9-472f-a3a9-8d2ba58866e2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:15.164448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:15.204347 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515ae32-43c9-472f-a3a9-8d2ba58866e2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:15.212833 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa852d9-5d26-4e1d-81f8-b115f88a03cd None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:15.213193 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa852d9-5d26-4e1d-81f8-b115f88a03cd None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:15.213425 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa852d9-5d26-4e1d-81f8-b115f88a03cd None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:15.216254 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 443/852] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:32:15.220793 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554a0a1-6103-4c2b-afb9-6f88d41d98f0 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:15.221195 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554a0a1-6103-4c2b-afb9-6f88d41d98f0 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:15.221687 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554a0a1-6103-4c2b-afb9-6f88d41d98f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:15.251278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-7554a0a1-6103-4c2b-afb9-6f88d41d98f0 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:15.253646 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e51ef-489b-4bcb-bd58-5dc14b80e76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:15.254047 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7554a0a1-6103-4c2b-afb9-6f88d41d98f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:15.254439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e51ef-489b-4bcb-bd58-5dc14b80e76c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:15.254908 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e51ef-489b-4bcb-bd58-5dc14b80e76c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:15.255385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e51ef-489b-4bcb-bd58-5dc14b80e76c None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:15.256745 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e51ef-489b-4bcb-bd58-5dc14b80e76c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:15.257061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e51ef-489b-4bcb-bd58-5dc14b80e76c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:15.258790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e51ef-489b-4bcb-bd58-5dc14b80e76c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:15.273631 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 410/853] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:15.283218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e51ef-489b-4bcb-bd58-5dc14b80e76c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:15.344642 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 444/854] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 00:32:15.406361 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e51ef-489b-4bcb-bd58-5dc14b80e76c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:15.437799 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:15.449337 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29402f2-b5be-4cb7-96bd-6f24089d18a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:15.450343 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29402f2-b5be-4cb7-96bd-6f24089d18a1 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:15.451056 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29402f2-b5be-4cb7-96bd-6f24089d18a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:15.451752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29402f2-b5be-4cb7-96bd-6f24089d18a1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:15.460335 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29402f2-b5be-4cb7-96bd-6f24089d18a1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:15.462032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29402f2-b5be-4cb7-96bd-6f24089d18a1 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:15.479338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-a29402f2-b5be-4cb7-96bd-6f24089d18a1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 00:32:15.479338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:15.479338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:15.479338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:15.479338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:15.479338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:15.479338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:15.479338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:15.479338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:15.479338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:15.479338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:15.479338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:15.479338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:32:15.479338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:32:15.479338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:32:15.479338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:32:15.480810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:15.480810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:15.480810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:32:15.480810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:15.480810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:32:15.480810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:15.480810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:15.480810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:15.480810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:15.480810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:15.480810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:15.480810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:15.480810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:15.480810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:15.480810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:15.480810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:15.480810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:15.480810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:15.481876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:15.481876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:15.481876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:32:15.481876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:32:15.481876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:32:15.481876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:32:15.481876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:32:15.481876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:32:15.481876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 00:32:15.481876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:15.481876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 411/855] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Sep 15 00:32:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:15.488985 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554a0a1-6103-4c2b-afb9-6f88d41d98f0 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:15.552992 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:15.612119 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554a0a1-6103-4c2b-afb9-6f88d41d98f0 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:15.633733 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a601d8-0845-42cf-9c47-ff69bfb4c78d None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:15.634674 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a601d8-0845-42cf-9c47-ff69bfb4c78d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:15.635169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a601d8-0845-42cf-9c47-ff69bfb4c78d None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:15.636995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 412/856] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:32:15.639581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a601d8-0845-42cf-9c47-ff69bfb4c78d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:15.656515 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12e1f5-106d-48e1-8360-eea959c46c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:15.657170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12e1f5-106d-48e1-8360-eea959c46c81 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:15.657452 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12e1f5-106d-48e1-8360-eea959c46c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:15.657720 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12e1f5-106d-48e1-8360-eea959c46c81 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:15.658462 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12e1f5-106d-48e1-8360-eea959c46c81 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:15.658860 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12e1f5-106d-48e1-8360-eea959c46c81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:15.660396 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12e1f5-106d-48e1-8360-eea959c46c81 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:15.685250 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 445/857] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Sep 15 00:32:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:15.685250 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d9360-c95b-4e92-8b23-b303ae065ce5 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:15.685250 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d9360-c95b-4e92-8b23-b303ae065ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:15.685250 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d9360-c95b-4e92-8b23-b303ae065ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:15.704725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-bd8d9360-c95b-4e92-8b23-b303ae065ce5 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:15.705945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-bd8d9360-c95b-4e92-8b23-b303ae065ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:15.754959 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a601d8-0845-42cf-9c47-ff69bfb4c78d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:15.781117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 446/858] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:15.781117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d9360-c95b-4e92-8b23-b303ae065ce5 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:15.797396 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259dea5-1878-4a99-b27a-48813f125649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:15.798401 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259dea5-1878-4a99-b27a-48813f125649 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:15.799042 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259dea5-1878-4a99-b27a-48813f125649 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:15.799526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259dea5-1878-4a99-b27a-48813f125649 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:15.800364 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259dea5-1878-4a99-b27a-48813f125649 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:15.802239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259dea5-1878-4a99-b27a-48813f125649 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:15.812759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-5259dea5-1878-4a99-b27a-48813f125649 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 00:32:15.812759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:15.812759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:32:15.812759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:32:15.812759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:32:15.812759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:32:15.812759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:32:15.812759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:15.812759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 00:32:15.812759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:15.812759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:15.812759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:15.812759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:15.812759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:15.812759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:15.812759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:15.812759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:15.813873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:15.813873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:15.813873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:15.813873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:15.813873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:15.813873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:15.813873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:32:15.813873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:32:15.813873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:32:15.813873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:32:15.813873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:15.813873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:15.813873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:15.813873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:15.813873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:15.813873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:15.814739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:15.814739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:15.814739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:15.814739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:15.814739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:15.814739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:15.814739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:15.814739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:15.814739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:15.814739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:15.814739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:32:15.814739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:15.814739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 00:32:15.814739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:15.817561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 413/859] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 15 00:32:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:15.823846 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259dea5-1878-4a99-b27a-48813f125649 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:15.828085 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:15.884073 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:15.911311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d9360-c95b-4e92-8b23-b303ae065ce5 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:15.937966 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259dea5-1878-4a99-b27a-48813f125649 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:15.953679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f10845-9055-4a42-ac1d-bb78f446833c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:15.954662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f10845-9055-4a42-ac1d-bb78f446833c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:15.955263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f10845-9055-4a42-ac1d-bb78f446833c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:15.955745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f10845-9055-4a42-ac1d-bb78f446833c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:15.972262 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f9462-7c8c-42b6-9ebf-0a9e4f2b06c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:15.972857 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f9462-7c8c-42b6-9ebf-0a9e4f2b06c6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:15.973172 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f9462-7c8c-42b6-9ebf-0a9e4f2b06c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:15.973446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f9462-7c8c-42b6-9ebf-0a9e4f2b06c6 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:15.974130 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f9462-7c8c-42b6-9ebf-0a9e4f2b06c6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:15.974519 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f9462-7c8c-42b6-9ebf-0a9e4f2b06c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:15.976469 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f9462-7c8c-42b6-9ebf-0a9e4f2b06c6 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:15.985834 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 414/860] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 15 00:32:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:15.987736 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f9462-7c8c-42b6-9ebf-0a9e4f2b06c6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:16.042356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f10845-9055-4a42-ac1d-bb78f446833c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:16.044212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f10845-9055-4a42-ac1d-bb78f446833c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:16.084524 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:16.110221 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f9462-7c8c-42b6-9ebf-0a9e4f2b06c6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:16.123966 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:16.144138 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c5d2f-2279-4a94-9edf-822145dfb5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:16.144740 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c5d2f-2279-4a94-9edf-822145dfb5c9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:16.145024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c5d2f-2279-4a94-9edf-822145dfb5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:16.145329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c5d2f-2279-4a94-9edf-822145dfb5c9 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:16.145953 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c5d2f-2279-4a94-9edf-822145dfb5c9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:16.146255 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c5d2f-2279-4a94-9edf-822145dfb5c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:16.147705 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c5d2f-2279-4a94-9edf-822145dfb5c9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:16.152009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 415/861] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 15 00:32:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:16.152775 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c5d2f-2279-4a94-9edf-822145dfb5c9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:16.169367 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 447/862] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:32:15 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 00:32:16.170634 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f10845-9055-4a42-ac1d-bb78f446833c None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:16.291398 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f10845-9055-4a42-ac1d-bb78f446833c None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:16.302778 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c5d2f-2279-4a94-9edf-822145dfb5c9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:16.333677 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d84f8-0d2d-475a-abcf-d2865873845d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:16.334997 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d84f8-0d2d-475a-abcf-d2865873845d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:16.335370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d84f8-0d2d-475a-abcf-d2865873845d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:16.335708 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d84f8-0d2d-475a-abcf-d2865873845d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:16.347076 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:16.352052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d84f8-0d2d-475a-abcf-d2865873845d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:16.353842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d84f8-0d2d-475a-abcf-d2865873845d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:16.362742 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4b1a0-9229-48cc-a411-faa920551386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:16.364020 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4b1a0-9229-48cc-a411-faa920551386 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:16.364509 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4b1a0-9229-48cc-a411-faa920551386 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:16.365380 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4b1a0-9229-48cc-a411-faa920551386 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:16.366705 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4b1a0-9229-48cc-a411-faa920551386 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:16.368405 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4b1a0-9229-48cc-a411-faa920551386 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:16.372635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-252d84f8-0d2d-475a-abcf-d2865873845d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:16.372635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:16.372635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:16.372635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:16.372635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:16.372635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:16.372635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:16.372635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:16.372635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:16.372635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:16.372635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:16.372635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:16.372635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:16.372635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:16.372635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:16.372635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:16.373627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:16.373627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:16.373627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:16.373627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:16.373627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:16.373627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:16.373627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:16.373627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:16.373627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:16.373627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:16.373627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:16.373627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:16.373627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:16.373627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:16.373627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:16.373627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:16.373627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:16.374515 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:16.374515 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:16.374515 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:16.374515 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 448/863] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:16.379239 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d84f8-0d2d-475a-abcf-d2865873845d None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:16.381947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-3bd4b1a0-9229-48cc-a411-faa920551386 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 00:32:16.381947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:16.381947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:32:16.381947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:32:16.381947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:32:16.381947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:32:16.381947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:32:16.381947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:16.381947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 00:32:16.381947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:16.381947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:16.381947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:16.381947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:16.381947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:16.381947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:16.381947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:16.382899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:16.382899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:16.382899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:16.382899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:16.382899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:16.382899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:16.382899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:16.382899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:32:16.382899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:32:16.382899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:32:16.382899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:32:16.382899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:16.382899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:16.382899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:16.382899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:16.382899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:16.382899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:16.383781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:16.383781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:16.383781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:16.383781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:16.383781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:16.383781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:16.383781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:16.383781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:16.383781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:16.383781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:16.383781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:32:16.383781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:16.383781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 00:32:16.383781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:16.384498 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 416/864] 10.222.0.52 () {56 vars in 1132 bytes} [Thu Sep 15 00:32:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:16.394716 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4b1a0-9229-48cc-a411-faa920551386 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:16.457185 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:16.498318 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d84f8-0d2d-475a-abcf-d2865873845d None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:16.536274 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fae14d-b323-4020-88c2-f031c9bab1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:16.536887 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fae14d-b323-4020-88c2-f031c9bab1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:16.537221 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fae14d-b323-4020-88c2-f031c9bab1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:16.537525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fae14d-b323-4020-88c2-f031c9bab1c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:16.538168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fae14d-b323-4020-88c2-f031c9bab1c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:16.538474 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fae14d-b323-4020-88c2-f031c9bab1c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:16.539197 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4b1a0-9229-48cc-a411-faa920551386 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:16.539834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fae14d-b323-4020-88c2-f031c9bab1c6 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:16.553906 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 449/865] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:16.559610 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fae14d-b323-4020-88c2-f031c9bab1c6 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:16.584283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b5cd8-3fad-4fdd-a96a-b26fb42669d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:16.584923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b5cd8-3fad-4fdd-a96a-b26fb42669d0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:16.585212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b5cd8-3fad-4fdd-a96a-b26fb42669d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:16.585487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b5cd8-3fad-4fdd-a96a-b26fb42669d0 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:16.586122 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b5cd8-3fad-4fdd-a96a-b26fb42669d0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:16.586426 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b5cd8-3fad-4fdd-a96a-b26fb42669d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:16.587792 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b5cd8-3fad-4fdd-a96a-b26fb42669d0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:16.596798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 417/866] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Sep 15 00:32:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:16.597802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b5cd8-3fad-4fdd-a96a-b26fb42669d0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:16.624006 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:16.686140 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fae14d-b323-4020-88c2-f031c9bab1c6 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:16.701607 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b5cd8-3fad-4fdd-a96a-b26fb42669d0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:16.709007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:16.731917 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a73d7-dd58-4e8c-87e9-936bfb7f2414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:16.732641 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a73d7-dd58-4e8c-87e9-936bfb7f2414 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:16.732923 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a73d7-dd58-4e8c-87e9-936bfb7f2414 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:16.733225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a73d7-dd58-4e8c-87e9-936bfb7f2414 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:16.740417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49160ef0-e11e-49e1-b934-0b49bc2ee914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:16.741153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a73d7-dd58-4e8c-87e9-936bfb7f2414 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:16.741605 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49160ef0-e11e-49e1-b934-0b49bc2ee914 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:16.741881 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49160ef0-e11e-49e1-b934-0b49bc2ee914 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:16.742154 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49160ef0-e11e-49e1-b934-0b49bc2ee914 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:16.742547 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a73d7-dd58-4e8c-87e9-936bfb7f2414 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:16.742780 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49160ef0-e11e-49e1-b934-0b49bc2ee914 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:16.743087 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49160ef0-e11e-49e1-b934-0b49bc2ee914 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:16.744551 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49160ef0-e11e-49e1-b934-0b49bc2ee914 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:16.749688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 418/867] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Sep 15 00:32:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:16.754792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-318a73d7-dd58-4e8c-87e9-936bfb7f2414 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:16.754792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:16.754792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:16.754792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:16.754792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:16.754792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:16.754792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:16.754792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:16.754792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:16.754792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:16.754792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:16.754792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:16.754792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:32:16.754792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:32:16.754792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:32:16.755767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:32:16.755767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:16.755767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:16.755767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:16.755767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:16.755767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:16.755767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:16.755767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:16.755767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:16.755767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:16.755767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:16.755767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:16.755767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:16.755767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:16.755767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:16.755767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:16.755767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:16.756721 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:32:16.756721 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:32:16.756721 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:32:16.756721 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:32:16.756721 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:32:16.756721 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:32:16.756721 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:16.756721 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:16.756721 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 450/868] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:32:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:16.763800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49160ef0-e11e-49e1-b934-0b49bc2ee914 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:16.879293 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49160ef0-e11e-49e1-b934-0b49bc2ee914 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:16.925236 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b59cb-9cf0-474d-b25a-261c4c93e691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:16.925236 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b59cb-9cf0-474d-b25a-261c4c93e691 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:16.925236 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b59cb-9cf0-474d-b25a-261c4c93e691 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:16.925877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b59cb-9cf0-474d-b25a-261c4c93e691 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:16.926026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b59cb-9cf0-474d-b25a-261c4c93e691 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:16.926286 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b59cb-9cf0-474d-b25a-261c4c93e691 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:16.928806 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b59cb-9cf0-474d-b25a-261c4c93e691 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:16.941199 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 419/869] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:32:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:16.949598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a73d7-dd58-4e8c-87e9-936bfb7f2414 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:17.060676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a73d7-dd58-4e8c-87e9-936bfb7f2414 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:17.070175 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:17.096320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61994ab-65bc-4d09-950a-e59a04c0408e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:17.096980 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61994ab-65bc-4d09-950a-e59a04c0408e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:17.097289 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61994ab-65bc-4d09-950a-e59a04c0408e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:17.097561 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61994ab-65bc-4d09-950a-e59a04c0408e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:17.098371 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61994ab-65bc-4d09-950a-e59a04c0408e None admin] RBAC: Adding query filter params (role.id=e5b76a8345d542c2a899f8dbdd95290d, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=ed49a596f15542a29ce331bae4640274) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:17.098684 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61994ab-65bc-4d09-950a-e59a04c0408e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:17.100657 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61994ab-65bc-4d09-950a-e59a04c0408e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:17.107180 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 451/870] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:32:16 2022] GET /identity/v3/role_assignments?user.id=ed49a596f15542a29ce331bae4640274&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=e5b76a8345d542c2a899f8dbdd95290d => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:17.395547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ee45e-6ff3-4e63-a3ef-3d62f97de8e7 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:17.395845 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ee45e-6ff3-4e63-a3ef-3d62f97de8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:17.396090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ee45e-6ff3-4e63-a3ef-3d62f97de8e7 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:17.398295 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 420/871] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:17.403679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882622f-a2e9-4cda-ba72-fe59d5b5c2c7 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:17.404108 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882622f-a2e9-4cda-ba72-fe59d5b5c2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:17.404205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882622f-a2e9-4cda-ba72-fe59d5b5c2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:17.422148 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f882622f-a2e9-4cda-ba72-fe59d5b5c2c7 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:17.423301 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f882622f-a2e9-4cda-ba72-fe59d5b5c2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:17.491510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 452/872] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:17.757936 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ee45e-6ff3-4e63-a3ef-3d62f97de8e7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:17.789438 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:17.861677 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ee45e-6ff3-4e63-a3ef-3d62f97de8e7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:17.897362 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58f718-127f-4065-b863-0320165faf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:17.897992 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58f718-127f-4065-b863-0320165faf4d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:17.898265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58f718-127f-4065-b863-0320165faf4d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:17.898550 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58f718-127f-4065-b863-0320165faf4d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:17.899108 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58f718-127f-4065-b863-0320165faf4d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:17.900463 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58f718-127f-4065-b863-0320165faf4d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:17.909725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-bb58f718-127f-4065-b863-0320165faf4d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 00:32:17.909725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:17.909725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:32:17.909725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:32:17.909725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:32:17.909725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:32:17.909725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:32:17.909725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:17.909725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 00:32:17.909725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:17.909725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:17.909725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:17.909725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:17.909725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:17.909725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:17.909725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:17.909725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:17.910707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:17.910707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:17.910707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:17.910707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:17.910707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:17.910707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:17.910707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:32:17.910707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:32:17.910707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:32:17.910707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:32:17.910707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:17.910707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:17.910707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:17.910707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:17.910707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:17.910707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:17.911929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:17.911929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:17.911929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:17.911929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:17.911929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:17.911929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:17.911929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:17.911929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:17.911929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:17.911929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:17.911929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:32:17.911929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:17.911929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 00:32:17.911929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:17.911929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 421/873] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Sep 15 00:32:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:17.917112 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882622f-a2e9-4cda-ba72-fe59d5b5c2c7 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:18.016662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882622f-a2e9-4cda-ba72-fe59d5b5c2c7 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:18.018111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:18.054631 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431991fa-a6ff-4512-bbf7-4d55bf1c87f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:18.055245 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431991fa-a6ff-4512-bbf7-4d55bf1c87f3 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:18.055522 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431991fa-a6ff-4512-bbf7-4d55bf1c87f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:18.055789 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431991fa-a6ff-4512-bbf7-4d55bf1c87f3 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:18.056419 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431991fa-a6ff-4512-bbf7-4d55bf1c87f3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:18.056717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431991fa-a6ff-4512-bbf7-4d55bf1c87f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:18.058109 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431991fa-a6ff-4512-bbf7-4d55bf1c87f3 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:18.063497 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 453/874] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Sep 15 00:32:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:18.070098 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58f718-127f-4065-b863-0320165faf4d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:18.177310 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:18.185796 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58f718-127f-4065-b863-0320165faf4d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:18.220425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202c7ab-eec1-4e30-9eda-0976174024c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:18.221028 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202c7ab-eec1-4e30-9eda-0976174024c3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:18.221338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202c7ab-eec1-4e30-9eda-0976174024c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:18.221609 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202c7ab-eec1-4e30-9eda-0976174024c3 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:18.222230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202c7ab-eec1-4e30-9eda-0976174024c3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:18.222533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202c7ab-eec1-4e30-9eda-0976174024c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:18.223952 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202c7ab-eec1-4e30-9eda-0976174024c3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:18.229274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 422/875] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Sep 15 00:32:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:18.543669 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a37d0-c172-4121-b68d-081dfaffe6ca None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:18.544208 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a37d0-c172-4121-b68d-081dfaffe6ca None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:18.544208 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a37d0-c172-4121-b68d-081dfaffe6ca None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:18.545856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 454/876] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:18.551075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec43774-864f-435c-946d-2348716c4591 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:18.551365 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec43774-864f-435c-946d-2348716c4591 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:18.551638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec43774-864f-435c-946d-2348716c4591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:18.569693 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2ec43774-864f-435c-946d-2348716c4591 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:18.570870 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2ec43774-864f-435c-946d-2348716c4591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:18.644291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 423/877] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:18.907234 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a37d0-c172-4121-b68d-081dfaffe6ca None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:19.019417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a37d0-c172-4121-b68d-081dfaffe6ca None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:19.056407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc252d0c-86fa-4647-9f5f-ed46d814ad9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:19.057011 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc252d0c-86fa-4647-9f5f-ed46d814ad9e None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:19.057323 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc252d0c-86fa-4647-9f5f-ed46d814ad9e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:19.057602 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc252d0c-86fa-4647-9f5f-ed46d814ad9e None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:19.058265 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc252d0c-86fa-4647-9f5f-ed46d814ad9e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:19.059676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc252d0c-86fa-4647-9f5f-ed46d814ad9e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:19.073912 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d29c0-e898-44ed-9552-246983a283ce None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:19.074411 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d29c0-e898-44ed-9552-246983a283ce None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:19.074499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d29c0-e898-44ed-9552-246983a283ce None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:19.076025 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 424/878] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:19.080944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d76fc-07b4-473d-9235-04d9d2c85ae8 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:19.081258 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d76fc-07b4-473d-9235-04d9d2c85ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:19.081535 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d76fc-07b4-473d-9235-04d9d2c85ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:19.084263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 455/879] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 15 00:32:18 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:32:19.101651 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-828d76fc-07b4-473d-9235-04d9d2c85ae8 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:19.102977 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-828d76fc-07b4-473d-9235-04d9d2c85ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:19.188262 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 425/880] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:19 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:19.405055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aae68-2508-4cae-b1c9-44ce6dfa1eb2 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:19.405407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aae68-2508-4cae-b1c9-44ce6dfa1eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:19.405638 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aae68-2508-4cae-b1c9-44ce6dfa1eb2 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:19.407211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 456/881] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:19.412927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defae9d6-8aa7-4093-8bcf-b3b5da661c4f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:19.413262 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defae9d6-8aa7-4093-8bcf-b3b5da661c4f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:19.413539 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defae9d6-8aa7-4093-8bcf-b3b5da661c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:19.432791 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-defae9d6-8aa7-4093-8bcf-b3b5da661c4f None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:19.433985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-defae9d6-8aa7-4093-8bcf-b3b5da661c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:19.447778 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:19.458702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712aae68-2508-4cae-b1c9-44ce6dfa1eb2 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:19.490598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:19.513118 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 426/882] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:19 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:19.577410 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712aae68-2508-4cae-b1c9-44ce6dfa1eb2 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:19.614255 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea39fc-2631-49e1-9b5d-7c6ffb747ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:19.614862 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea39fc-2631-49e1-9b5d-7c6ffb747ef1 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:19.615141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea39fc-2631-49e1-9b5d-7c6ffb747ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:19.615445 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea39fc-2631-49e1-9b5d-7c6ffb747ef1 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:19.616098 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea39fc-2631-49e1-9b5d-7c6ffb747ef1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:19.617476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea39fc-2631-49e1-9b5d-7c6ffb747ef1 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:19.636589 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 457/883] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 15 00:32:19 2022] POST /identity/v3/services => generated 269 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:32:19.803836 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defae9d6-8aa7-4093-8bcf-b3b5da661c4f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:19.909917 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defae9d6-8aa7-4093-8bcf-b3b5da661c4f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:19.951936 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06534a4-c24d-4aeb-9128-12148cbd7bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:19.952569 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06534a4-c24d-4aeb-9128-12148cbd7bec None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:19.952846 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06534a4-c24d-4aeb-9128-12148cbd7bec None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:19.953144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06534a4-c24d-4aeb-9128-12148cbd7bec None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:19.961829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:19.965867 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06534a4-c24d-4aeb-9128-12148cbd7bec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:32:19.970849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-e06534a4-c24d-4aeb-9128-12148cbd7bec None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 00:32:19.970849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:19.970849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:19.970849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:19.970849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:19.970849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:19.970849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:19.970849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:19.970849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:19.970849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:19.970849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:19.970849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:19.970849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:32:19.970849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:32:19.970849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:32:19.970849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:32:19.971777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:32:19.971777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:32:19.971777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:32:19.971777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:32:19.971777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:19.971777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:19.971777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:19.971777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:19.971777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:19.971777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:19.971777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:19.971777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:19.971777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:19.971777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:19.971777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:19.971777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:19.972623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:19.972623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:19.972623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:19.972623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:19.972623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:32:19.972623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:32:19.972623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:32:19.972623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:32:19.972623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:32:19.972623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:32:19.972623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 00:32:19.972623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:19.973300 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 427/884] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Sep 15 00:32:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:19.978719 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea39fc-2631-49e1-9b5d-7c6ffb747ef1 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:20.073266 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:20.090219 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea39fc-2631-49e1-9b5d-7c6ffb747ef1 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:20.126403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701b80d-1268-42cf-ac8a-646b39fd1d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:20.127065 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701b80d-1268-42cf-ac8a-646b39fd1d5e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:20.127348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701b80d-1268-42cf-ac8a-646b39fd1d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:20.127621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701b80d-1268-42cf-ac8a-646b39fd1d5e None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:20.128283 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701b80d-1268-42cf-ac8a-646b39fd1d5e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:20.128583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701b80d-1268-42cf-ac8a-646b39fd1d5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:20.129967 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701b80d-1268-42cf-ac8a-646b39fd1d5e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:20.142977 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 458/885] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Sep 15 00:32:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:20.146160 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06534a4-c24d-4aeb-9128-12148cbd7bec None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:20.257054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06534a4-c24d-4aeb-9128-12148cbd7bec None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:20.293276 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4633f25-1e46-417d-b66c-28fc6cec0dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:20.294217 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4633f25-1e46-417d-b66c-28fc6cec0dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:20.294711 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4633f25-1e46-417d-b66c-28fc6cec0dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:20.295187 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4633f25-1e46-417d-b66c-28fc6cec0dc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:20.306307 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4633f25-1e46-417d-b66c-28fc6cec0dc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:20.308045 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4633f25-1e46-417d-b66c-28fc6cec0dc0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:20.331735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-c4633f25-1e46-417d-b66c-28fc6cec0dc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:20.331735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:20.331735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:20.331735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:20.331735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:20.331735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:20.331735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:20.331735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:20.331735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:20.331735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:20.331735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:20.331735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:20.331735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:20.331735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:20.331735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:20.331735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:20.332725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:20.332725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:20.332725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:20.332725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:20.332725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:20.332725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:20.332725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:20.332725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:20.332725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:20.332725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:20.332725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:20.332725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:20.332725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:20.332725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:20.332725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:20.332725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:20.332725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:20.333760 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:20.333760 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:20.333760 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:20.347566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 428/886] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:20.349184 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701b80d-1268-42cf-ac8a-646b39fd1d5e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:20.439443 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a51cb-f865-4cc7-b9f1-464b3ddc7948 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:20.439790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a51cb-f865-4cc7-b9f1-464b3ddc7948 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:20.439985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a51cb-f865-4cc7-b9f1-464b3ddc7948 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:20.441760 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 429/887] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:32:20.449800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f883f-a4fe-4f7d-9d0d-b340e7ccab12 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:20.450384 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f883f-a4fe-4f7d-9d0d-b340e7ccab12 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:20.450860 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f883f-a4fe-4f7d-9d0d-b340e7ccab12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:20.458225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701b80d-1268-42cf-ac8a-646b39fd1d5e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:20.469891 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-974f883f-a4fe-4f7d-9d0d-b340e7ccab12 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:20.471413 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-974f883f-a4fe-4f7d-9d0d-b340e7ccab12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:20.503201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5b943-7b34-4d40-b1ef-90b99d7cc9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:20.503932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5b943-7b34-4d40-b1ef-90b99d7cc9fe None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:20.504330 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5b943-7b34-4d40-b1ef-90b99d7cc9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:20.504695 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5b943-7b34-4d40-b1ef-90b99d7cc9fe None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:20.505573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5b943-7b34-4d40-b1ef-90b99d7cc9fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:20.508143 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5b943-7b34-4d40-b1ef-90b99d7cc9fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:20.509695 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5b943-7b34-4d40-b1ef-90b99d7cc9fe None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:20.529729 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 459/888] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:20.529922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:20.531938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5b943-7b34-4d40-b1ef-90b99d7cc9fe None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:20.549148 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:20.569276 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 430/889] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 00:32:20.645569 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5b943-7b34-4d40-b1ef-90b99d7cc9fe None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:20.682782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc240c-3144-46c7-ac2b-a82dd9ac1eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:20.683414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc240c-3144-46c7-ac2b-a82dd9ac1eab None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:20.683690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc240c-3144-46c7-ac2b-a82dd9ac1eab None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:20.683957 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc240c-3144-46c7-ac2b-a82dd9ac1eab None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:20.691781 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc240c-3144-46c7-ac2b-a82dd9ac1eab None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:20.693289 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc240c-3144-46c7-ac2b-a82dd9ac1eab None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:20.705008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-15cc240c-3144-46c7-ac2b-a82dd9ac1eab None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 00:32:20.705008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:20.705008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:20.705008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:20.705008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:20.705008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:20.705008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:20.705008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:20.705008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:20.705008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:20.705008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:20.705008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:20.705008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:32:20.705008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:32:20.705008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:32:20.705008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:32:20.705984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:20.705984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:20.705984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:32:20.705984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:20.705984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:32:20.705984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:20.705984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:20.705984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:20.705984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:20.705984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:20.705984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:20.705984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:20.705984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:20.705984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:20.705984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:20.705984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:20.705984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:20.705984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:20.707089 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:20.707089 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:20.707089 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:32:20.707089 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:32:20.707089 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:32:20.707089 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:32:20.707089 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:32:20.707089 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:32:20.707089 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 00:32:20.707089 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:20.707089 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 460/890] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Sep 15 00:32:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:20.718175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f883f-a4fe-4f7d-9d0d-b340e7ccab12 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:20.819999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f883f-a4fe-4f7d-9d0d-b340e7ccab12 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:20.855537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f23217-1728-45ae-aa9c-3e782b128a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:20.856447 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f23217-1728-45ae-aa9c-3e782b128a33 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:20.856948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f23217-1728-45ae-aa9c-3e782b128a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:20.857441 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f23217-1728-45ae-aa9c-3e782b128a33 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:20.858396 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f23217-1728-45ae-aa9c-3e782b128a33 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:20.859156 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f23217-1728-45ae-aa9c-3e782b128a33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:20.860805 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f23217-1728-45ae-aa9c-3e782b128a33 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:20.872127 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc240c-3144-46c7-ac2b-a82dd9ac1eab None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:20.884225 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 431/891] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Sep 15 00:32:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:20.885754 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f23217-1728-45ae-aa9c-3e782b128a33 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:20.940293 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:20.954604 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:21.001286 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc240c-3144-46c7-ac2b-a82dd9ac1eab None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:21.017519 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f23217-1728-45ae-aa9c-3e782b128a33 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:21.044005 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0a376-e487-4a43-929b-dbc80ac2257c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:21.045224 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0a376-e487-4a43-929b-dbc80ac2257c None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:21.045606 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0a376-e487-4a43-929b-dbc80ac2257c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:21.045989 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0a376-e487-4a43-929b-dbc80ac2257c None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:21.047027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0a376-e487-4a43-929b-dbc80ac2257c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:21.048716 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0a376-e487-4a43-929b-dbc80ac2257c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:21.056879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441c525-1899-48eb-a640-256dd2ef90ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:21.057564 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441c525-1899-48eb-a640-256dd2ef90ec None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:21.057850 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441c525-1899-48eb-a640-256dd2ef90ec None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:21.058121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441c525-1899-48eb-a640-256dd2ef90ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:21.077399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 461/892] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 15 00:32:20 2022] POST /identity/v3/services => generated 241 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:32:21.141209 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441c525-1899-48eb-a640-256dd2ef90ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:21.142723 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441c525-1899-48eb-a640-256dd2ef90ec None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:21.189155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:21.261670 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 432/893] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:32:20 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 00:32:21.264023 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0a376-e487-4a43-929b-dbc80ac2257c None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:21.383966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0a376-e487-4a43-929b-dbc80ac2257c None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:21.407966 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec876357-dc86-4f4a-a315-53cdf2049038 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:21.408258 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec876357-dc86-4f4a-a315-53cdf2049038 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:21.408535 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec876357-dc86-4f4a-a315-53cdf2049038 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:21.409598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:21.410169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 433/894] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:32:21.415765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97652901-b6c3-45c7-8e13-093c8a57a648 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:21.416048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97652901-b6c3-45c7-8e13-093c8a57a648 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:21.416324 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97652901-b6c3-45c7-8e13-093c8a57a648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:21.423565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a784f5-fe1c-4f5e-b408-9d60355f8d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:21.424199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a784f5-fe1c-4f5e-b408-9d60355f8d8a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:21.424479 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a784f5-fe1c-4f5e-b408-9d60355f8d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:21.424748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a784f5-fe1c-4f5e-b408-9d60355f8d8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:21.435991 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-97652901-b6c3-45c7-8e13-093c8a57a648 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:21.436728 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a784f5-fe1c-4f5e-b408-9d60355f8d8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:21.437753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-97652901-b6c3-45c7-8e13-093c8a57a648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:21.438244 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a784f5-fe1c-4f5e-b408-9d60355f8d8a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:21.455455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-46a784f5-fe1c-4f5e-b408-9d60355f8d8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:21.455455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:21.455455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:21.455455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:21.455455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:21.455455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:21.455455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:21.455455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:21.455455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:21.455455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:21.455455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:21.455455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:21.455455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:21.455455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:21.455455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:21.455455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:21.456595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:21.456595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:21.456595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:21.456595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:21.456595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:21.456595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:21.456595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:21.456595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:21.456595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:21.456595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:21.456595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:21.456595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:21.456595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:21.456595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:21.456595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:21.456595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:21.456595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:21.457678 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:21.457678 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:21.457678 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:21.459940 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 462/895] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:21.466514 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a784f5-fe1c-4f5e-b408-9d60355f8d8a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:21.522713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 434/896] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 00:32:21.579522 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a784f5-fe1c-4f5e-b408-9d60355f8d8a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:21.614689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6a8db-01cc-4107-a19f-39ead4eab11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:21.615314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6a8db-01cc-4107-a19f-39ead4eab11c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:21.615644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6a8db-01cc-4107-a19f-39ead4eab11c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:21.615918 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6a8db-01cc-4107-a19f-39ead4eab11c None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:21.616556 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6a8db-01cc-4107-a19f-39ead4eab11c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:21.616854 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6a8db-01cc-4107-a19f-39ead4eab11c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:21.618282 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6a8db-01cc-4107-a19f-39ead4eab11c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:21.630712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 463/897] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:21.636446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97652901-b6c3-45c7-8e13-093c8a57a648 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:21.711367 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:21.748258 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97652901-b6c3-45c7-8e13-093c8a57a648 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:21.783958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7b6e0-7eb2-49ac-b49e-d6d306f6f265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:21.784502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7b6e0-7eb2-49ac-b49e-d6d306f6f265 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:21.784779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7b6e0-7eb2-49ac-b49e-d6d306f6f265 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:21.785049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7b6e0-7eb2-49ac-b49e-d6d306f6f265 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:21.792428 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6a8db-01cc-4107-a19f-39ead4eab11c None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:21.794027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7b6e0-7eb2-49ac-b49e-d6d306f6f265 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:21.795770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7b6e0-7eb2-49ac-b49e-d6d306f6f265 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:21.816184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-bde7b6e0-7eb2-49ac-b49e-d6d306f6f265 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:21.816184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:21.816184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:21.816184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:21.816184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:21.816184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:21.816184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:21.816184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:21.816184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:21.816184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:21.816184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:21.816184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:21.816184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:32:21.816184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:32:21.816184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:32:21.817150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:32:21.817150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:21.817150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:21.817150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:21.817150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:21.817150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:21.817150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:21.817150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:21.817150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:21.817150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:21.817150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:21.817150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:21.817150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:21.817150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:21.817150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:21.817150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:21.817150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:21.818664 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:32:21.818664 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:32:21.818664 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:32:21.818664 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:32:21.818664 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:32:21.818664 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:32:21.818664 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:21.818664 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:21.818664 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 435/898] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:32:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:21.825029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7b6e0-7eb2-49ac-b49e-d6d306f6f265 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:21.837912 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:21.919072 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6a8db-01cc-4107-a19f-39ead4eab11c None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:21.949730 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7b6e0-7eb2-49ac-b49e-d6d306f6f265 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:21.959019 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1eefc-d81f-452c-b5ba-f95c4e1d275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:21.959659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1eefc-d81f-452c-b5ba-f95c4e1d275c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:21.959930 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1eefc-d81f-452c-b5ba-f95c4e1d275c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:21.960197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1eefc-d81f-452c-b5ba-f95c4e1d275c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:21.960781 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1eefc-d81f-452c-b5ba-f95c4e1d275c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:21.962386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1eefc-d81f-452c-b5ba-f95c4e1d275c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:21.972482 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-a9f1eefc-d81f-452c-b5ba-f95c4e1d275c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 00:32:21.972482 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:21.972482 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:32:21.972482 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:32:21.972482 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:32:21.972482 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:32:21.972482 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:32:21.972482 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:21.972482 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 00:32:21.972482 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:21.972482 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:21.972482 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:21.972482 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:21.972482 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:21.972482 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:21.972482 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:21.972482 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:21.973559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:21.973559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:21.973559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:21.973559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:21.973559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:21.973559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:21.973559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:32:21.973559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:32:21.973559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:32:21.973559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:32:21.973559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:21.973559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:21.973559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:21.973559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:21.973559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:21.973559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:21.974389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:21.974389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:21.974389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:21.974389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:21.974389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:21.974389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:21.974389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:21.974389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:21.974389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:21.974389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:21.974389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:32:21.974389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:21.974389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 00:32:21.974389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:21.979271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 464/899] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 15 00:32:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:21.980149 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1eefc-d81f-452c-b5ba-f95c4e1d275c None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:21.999310 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:22.001485 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f55c5-77b6-4afb-9279-20d4eb5ed33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:22.002467 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f55c5-77b6-4afb-9279-20d4eb5ed33a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:22.002879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f55c5-77b6-4afb-9279-20d4eb5ed33a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:22.003265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f55c5-77b6-4afb-9279-20d4eb5ed33a None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:22.004441 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f55c5-77b6-4afb-9279-20d4eb5ed33a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:22.004898 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f55c5-77b6-4afb-9279-20d4eb5ed33a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:22.006552 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f55c5-77b6-4afb-9279-20d4eb5ed33a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:22.023530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 436/900] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:32:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:22.024983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0474f44-b1bf-464e-bcff-08e5cb36f5ed None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:22.025726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0474f44-b1bf-464e-bcff-08e5cb36f5ed None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:22.026134 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0474f44-b1bf-464e-bcff-08e5cb36f5ed None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:22.027722 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 437/901] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:22.029755 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0474f44-b1bf-464e-bcff-08e5cb36f5ed None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:22.097872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:22.102033 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1eefc-d81f-452c-b5ba-f95c4e1d275c None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:22.139935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa95bc-eb0d-4a82-9bc5-c881e729192d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:22.140557 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa95bc-eb0d-4a82-9bc5-c881e729192d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:22.140910 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa95bc-eb0d-4a82-9bc5-c881e729192d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:22.141132 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa95bc-eb0d-4a82-9bc5-c881e729192d None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:22.141889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa95bc-eb0d-4a82-9bc5-c881e729192d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:22.142103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa95bc-eb0d-4a82-9bc5-c881e729192d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:22.143598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa95bc-eb0d-4a82-9bc5-c881e729192d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:22.153310 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0474f44-b1bf-464e-bcff-08e5cb36f5ed None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:22.153483 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 465/902] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 15 00:32:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:22.153483 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd7f76-518e-47e0-951f-78fc21ec4ea6 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:22.153483 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd7f76-518e-47e0-951f-78fc21ec4ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:22.153483 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd7f76-518e-47e0-951f-78fc21ec4ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:22.170534 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-34bd7f76-518e-47e0-951f-78fc21ec4ea6 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:22.171802 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-34bd7f76-518e-47e0-951f-78fc21ec4ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:22.189827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a8afe-9b0b-4e91-86a8-6c8e2194c436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:22.190431 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a8afe-9b0b-4e91-86a8-6c8e2194c436 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:22.190713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a8afe-9b0b-4e91-86a8-6c8e2194c436 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:22.190986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a8afe-9b0b-4e91-86a8-6c8e2194c436 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:22.191703 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a8afe-9b0b-4e91-86a8-6c8e2194c436 None admin] RBAC: Adding query filter params (role.id=775f8b8679a94a5887e259c092f17088, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=ed49a596f15542a29ce331bae4640274) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:22.192012 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a8afe-9b0b-4e91-86a8-6c8e2194c436 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:22.193502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a8afe-9b0b-4e91-86a8-6c8e2194c436 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:22.209504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 438/903] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:32:22 2022] GET /identity/v3/role_assignments?user.id=ed49a596f15542a29ce331bae4640274&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=775f8b8679a94a5887e259c092f17088 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:22.209504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a8afe-9b0b-4e91-86a8-6c8e2194c436 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:22.265079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 466/904] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:22.291225 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:22.349182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a8afe-9b0b-4e91-86a8-6c8e2194c436 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:22.383929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e061b-d127-4c62-94e6-cd647a43cae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:22.384543 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e061b-d127-4c62-94e6-cd647a43cae9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:22.384817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e061b-d127-4c62-94e6-cd647a43cae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:22.385115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e061b-d127-4c62-94e6-cd647a43cae9 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:22.385748 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e061b-d127-4c62-94e6-cd647a43cae9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:22.386108 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e061b-d127-4c62-94e6-cd647a43cae9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:22.387535 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e061b-d127-4c62-94e6-cd647a43cae9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:22.393156 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 439/905] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 15 00:32:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:22.399582 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd7f76-518e-47e0-951f-78fc21ec4ea6 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:22.505324 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:22.512370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd7f76-518e-47e0-951f-78fc21ec4ea6 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:22.552837 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5994ac-86e1-4ec2-a6bc-ed42199f98b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:22.553821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5994ac-86e1-4ec2-a6bc-ed42199f98b4 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:22.554282 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5994ac-86e1-4ec2-a6bc-ed42199f98b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:22.554731 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5994ac-86e1-4ec2-a6bc-ed42199f98b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:22.555629 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5994ac-86e1-4ec2-a6bc-ed42199f98b4 None admin] RBAC: Adding query filter params (interface=public, service_id=b95def9b43ba49e6ae93e7cdd99deaef, region_id=RegionOne) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:22.556136 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5994ac-86e1-4ec2-a6bc-ed42199f98b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:22.557699 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5994ac-86e1-4ec2-a6bc-ed42199f98b4 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:22.562870 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e061b-d127-4c62-94e6-cd647a43cae9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:22.567421 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 467/906] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Sep 15 00:32:22 2022] GET /identity/v3/endpoints?service_id=b95def9b43ba49e6ae93e7cdd99deaef&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:22.574885 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5994ac-86e1-4ec2-a6bc-ed42199f98b4 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:22.696068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5994ac-86e1-4ec2-a6bc-ed42199f98b4 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:22.703793 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e061b-d127-4c62-94e6-cd647a43cae9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:22.727735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:22.733168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a9847-1837-4bbd-8619-0828bd987192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:22.734158 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a9847-1837-4bbd-8619-0828bd987192 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:22.734561 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a9847-1837-4bbd-8619-0828bd987192 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:22.734930 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a9847-1837-4bbd-8619-0828bd987192 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:22.735628 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a9847-1837-4bbd-8619-0828bd987192 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:22.737074 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a9847-1837-4bbd-8619-0828bd987192 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:22.747761 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd1c5b-4312-4930-be0d-10003ab687bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:22.748748 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd1c5b-4312-4930-be0d-10003ab687bd None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:22.749167 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 468/907] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Sep 15 00:32:22 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:32:22.749513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd1c5b-4312-4930-be0d-10003ab687bd None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:22.749997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd1c5b-4312-4930-be0d-10003ab687bd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:22.750813 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd1c5b-4312-4930-be0d-10003ab687bd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:22.752447 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd1c5b-4312-4930-be0d-10003ab687bd None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:22.763278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-8fbd1c5b-4312-4930-be0d-10003ab687bd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 00:32:22.763278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:22.763278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:32:22.763278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:32:22.763278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:32:22.763278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:32:22.763278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:32:22.763278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:22.763278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 00:32:22.763278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:22.763278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:22.763278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:22.763278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:22.763278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:22.763278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:22.763278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:22.764269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:22.764269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:22.764269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:22.764269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:22.764269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:22.764269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:22.764269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:22.764269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:32:22.764269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:32:22.764269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:32:22.764269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:32:22.764269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:22.764269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:22.764269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:22.764269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:22.764269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:22.764269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:22.765182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:22.765182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:22.765182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:22.765182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:22.765182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:22.765182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:22.765182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:22.765182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:22.765182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:22.765182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:22.765182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:32:22.765182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:22.765182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 00:32:22.765182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:22.768111 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 440/908] 10.222.0.52 () {56 vars in 1132 bytes} [Thu Sep 15 00:32:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:22.775032 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a9847-1837-4bbd-8619-0828bd987192 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:22.804075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:22.892967 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a9847-1837-4bbd-8619-0828bd987192 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:22.934964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d3040-90ae-4a68-97c0-11e8ad745d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:22.935568 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d3040-90ae-4a68-97c0-11e8ad745d7a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:22.935845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d3040-90ae-4a68-97c0-11e8ad745d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:22.936112 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d3040-90ae-4a68-97c0-11e8ad745d7a None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:22.936733 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d3040-90ae-4a68-97c0-11e8ad745d7a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:22.937041 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d3040-90ae-4a68-97c0-11e8ad745d7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:22.938411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d3040-90ae-4a68-97c0-11e8ad745d7a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:22.943529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 469/909] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Sep 15 00:32:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:22.949574 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd1c5b-4312-4930-be0d-10003ab687bd None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:23.056215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd1c5b-4312-4930-be0d-10003ab687bd None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:23.091507 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c20e8-9d5c-4b0f-9965-9950134ce6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:23.092092 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c20e8-9d5c-4b0f-9965-9950134ce6dc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:23.092363 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c20e8-9d5c-4b0f-9965-9950134ce6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:23.092630 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c20e8-9d5c-4b0f-9965-9950134ce6dc None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:23.093292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c20e8-9d5c-4b0f-9965-9950134ce6dc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:23.093595 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c20e8-9d5c-4b0f-9965-9950134ce6dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:23.094958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c20e8-9d5c-4b0f-9965-9950134ce6dc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:23.100345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 441/910] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Sep 15 00:32:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:23.110142 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d3040-90ae-4a68-97c0-11e8ad745d7a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:23.205237 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:23.222022 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d3040-90ae-4a68-97c0-11e8ad745d7a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:23.258587 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813e4e3-2f00-4005-82c3-bf36af652db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:23.259186 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813e4e3-2f00-4005-82c3-bf36af652db5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:23.259462 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813e4e3-2f00-4005-82c3-bf36af652db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:23.259731 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813e4e3-2f00-4005-82c3-bf36af652db5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:23.260423 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813e4e3-2f00-4005-82c3-bf36af652db5 None admin] RBAC: Adding query filter params (interface=public, service_id=e5dd5cc49c0b480694a1591a5be5c045, region_id=RegionOne) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:23.260724 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813e4e3-2f00-4005-82c3-bf36af652db5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:23.262097 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813e4e3-2f00-4005-82c3-bf36af652db5 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:23.267535 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 470/911] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Sep 15 00:32:23 2022] GET /identity/v3/endpoints?service_id=e5dd5cc49c0b480694a1591a5be5c045&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:23.273191 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c20e8-9d5c-4b0f-9965-9950134ce6dc None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:23.335630 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:23.397572 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c20e8-9d5c-4b0f-9965-9950134ce6dc None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:23.424263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a5766-e952-4094-a172-049719947f95 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:23.424884 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a5766-e952-4094-a172-049719947f95 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:23.425410 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a5766-e952-4094-a172-049719947f95 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:23.427282 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 471/912] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:32:23.432829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557ff13-7087-47c9-a684-cc1b18572731 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:23.433150 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557ff13-7087-47c9-a684-cc1b18572731 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:23.433408 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557ff13-7087-47c9-a684-cc1b18572731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:23.439556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f947d2b-2474-483a-a701-2875f8da04e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:23.440155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f947d2b-2474-483a-a701-2875f8da04e2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:23.440435 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f947d2b-2474-483a-a701-2875f8da04e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:23.440703 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f947d2b-2474-483a-a701-2875f8da04e2 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:23.443608 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f947d2b-2474-483a-a701-2875f8da04e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:23.443608 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f947d2b-2474-483a-a701-2875f8da04e2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:23.449318 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 442/913] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Sep 15 00:32:23 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:32:23.457202 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-a557ff13-7087-47c9-a684-cc1b18572731 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:23.457202 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a557ff13-7087-47c9-a684-cc1b18572731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:23.537253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 472/914] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 00:32:23.807035 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f947d2b-2474-483a-a701-2875f8da04e2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:23.910684 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f947d2b-2474-483a-a701-2875f8da04e2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:23.921647 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:23.945868 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3422ba9-e0f5-436d-a981-1f04ffe46a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:23.946569 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3422ba9-e0f5-436d-a981-1f04ffe46a7a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:23.946895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3422ba9-e0f5-436d-a981-1f04ffe46a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:23.947178 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3422ba9-e0f5-436d-a981-1f04ffe46a7a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:23.947764 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3422ba9-e0f5-436d-a981-1f04ffe46a7a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:23.949307 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3422ba9-e0f5-436d-a981-1f04ffe46a7a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:23.958372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-e3422ba9-e0f5-436d-a981-1f04ffe46a7a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 00:32:23.958372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:23.958372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:32:23.958372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:32:23.958372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:32:23.958372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:32:23.958372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:32:23.958372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:23.958372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 00:32:23.958372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:23.958372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:23.958372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:23.958372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:23.958372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:23.958372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:23.958372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:23.958372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:23.959944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:23.959944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:23.959944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:23.959944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:23.959944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:23.959944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:23.959944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:32:23.959944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:32:23.959944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:32:23.959944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:32:23.959944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:23.959944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:23.959944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:23.959944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:23.959944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:23.959944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:23.960985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:23.960985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:23.960985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:23.960985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:23.960985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:23.960985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:23.960985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:23.960985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:23.960985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:23.960985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:23.960985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:32:23.960985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:23.960985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 00:32:23.960985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:23.960985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 443/915] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Sep 15 00:32:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:23.968247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557ff13-7087-47c9-a684-cc1b18572731 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:24.052642 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:24.072824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557ff13-7087-47c9-a684-cc1b18572731 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:24.110641 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f17cd-a1fb-41b4-b629-f2c5c27d2643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:24.111629 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f17cd-a1fb-41b4-b629-f2c5c27d2643 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:24.112117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f17cd-a1fb-41b4-b629-f2c5c27d2643 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:24.112592 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f17cd-a1fb-41b4-b629-f2c5c27d2643 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:24.113442 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f17cd-a1fb-41b4-b629-f2c5c27d2643 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:24.113940 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f17cd-a1fb-41b4-b629-f2c5c27d2643 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:24.115535 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f17cd-a1fb-41b4-b629-f2c5c27d2643 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:24.125200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 473/916] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Sep 15 00:32:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:24.127289 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3422ba9-e0f5-436d-a981-1f04ffe46a7a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:24.230726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3422ba9-e0f5-436d-a981-1f04ffe46a7a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:24.266541 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3859ce-d397-478b-b481-749e32ffe9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:24.267500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3859ce-d397-478b-b481-749e32ffe9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:24.267972 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3859ce-d397-478b-b481-749e32ffe9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:24.268459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3859ce-d397-478b-b481-749e32ffe9b6 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:24.269344 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3859ce-d397-478b-b481-749e32ffe9b6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:24.269839 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3859ce-d397-478b-b481-749e32ffe9b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:24.272003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3859ce-d397-478b-b481-749e32ffe9b6 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:24.281233 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 444/917] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Sep 15 00:32:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:24.284337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f17cd-a1fb-41b4-b629-f2c5c27d2643 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:24.404558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f17cd-a1fb-41b4-b629-f2c5c27d2643 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:24.442528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c508fad-3b6e-450e-a6f2-fa7334216133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:24.443592 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c508fad-3b6e-450e-a6f2-fa7334216133 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:24.444096 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c508fad-3b6e-450e-a6f2-fa7334216133 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:24.444574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c508fad-3b6e-450e-a6f2-fa7334216133 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:24.445497 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c508fad-3b6e-450e-a6f2-fa7334216133 None admin] RBAC: Adding query filter params (interface=public, service_id=dc0c7e280a5d4be380638158b722f010, region_id=RegionOne) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:24.446037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c508fad-3b6e-450e-a6f2-fa7334216133 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:24.447631 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c508fad-3b6e-450e-a6f2-fa7334216133 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:24.453430 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 474/918] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Sep 15 00:32:24 2022] GET /identity/v3/endpoints?service_id=dc0c7e280a5d4be380638158b722f010&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:24.462196 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3859ce-d397-478b-b481-749e32ffe9b6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:24.500425 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7145a-4b2b-4426-9b0b-0c015400047c None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:24.500731 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7145a-4b2b-4426-9b0b-0c015400047c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:24.500977 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7145a-4b2b-4426-9b0b-0c015400047c None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:24.502575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 475/919] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:24.504202 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:24.508013 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923167cb-44f3-4cb4-9f97-29da80fef08f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:24.508550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923167cb-44f3-4cb4-9f97-29da80fef08f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:24.509069 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923167cb-44f3-4cb4-9f97-29da80fef08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:24.530385 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-923167cb-44f3-4cb4-9f97-29da80fef08f None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:24.531699 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-923167cb-44f3-4cb4-9f97-29da80fef08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:24.534013 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:24.576259 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3859ce-d397-478b-b481-749e32ffe9b6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:24.615695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927eb3f-242c-4e8a-89c5-30fed1266371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:24.616273 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927eb3f-242c-4e8a-89c5-30fed1266371 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:24.616552 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927eb3f-242c-4e8a-89c5-30fed1266371 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:24.616867 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927eb3f-242c-4e8a-89c5-30fed1266371 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:24.617504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927eb3f-242c-4e8a-89c5-30fed1266371 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:24.619688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927eb3f-242c-4e8a-89c5-30fed1266371 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:24.625001 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 476/920] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:24.629812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 445/921] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Sep 15 00:32:24 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:32:24.898110 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923167cb-44f3-4cb4-9f97-29da80fef08f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:25.004855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923167cb-44f3-4cb4-9f97-29da80fef08f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:25.039983 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4622d8-9c2c-409d-8cbc-2681965d01b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:25.040616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4622d8-9c2c-409d-8cbc-2681965d01b1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:25.040892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4622d8-9c2c-409d-8cbc-2681965d01b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:25.041186 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4622d8-9c2c-409d-8cbc-2681965d01b1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:25.046803 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a6752-7f56-49c7-b425-91c0dd331d52 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:25.047092 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a6752-7f56-49c7-b425-91c0dd331d52 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:25.047363 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a6752-7f56-49c7-b425-91c0dd331d52 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:25.048423 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:25.048908 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 446/922] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:25.052353 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4622d8-9c2c-409d-8cbc-2681965d01b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:32:25.054634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d5c76-a255-4d72-a871-a6fea4d22a80 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:25.054977 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d5c76-a255-4d72-a871-a6fea4d22a80 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:25.055252 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d5c76-a255-4d72-a871-a6fea4d22a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:25.058249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-cb4622d8-9c2c-409d-8cbc-2681965d01b1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 00:32:25.058249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:25.058249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:25.058249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:25.058249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:25.058249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:25.058249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:25.058249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:25.058249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:25.058249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:25.058249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:25.058249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:25.058249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:32:25.058249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:32:25.058249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:32:25.058249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:32:25.059189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:32:25.059189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:32:25.059189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:32:25.059189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:32:25.059189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:25.059189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:25.059189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:25.059189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:25.059189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:25.059189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:25.059189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:25.059189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:25.059189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:25.059189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:25.059189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:25.059189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:25.060037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:25.060037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:25.060037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:25.060037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:25.060037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:32:25.060037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:32:25.060037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:32:25.060037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:32:25.060037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:32:25.060037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:32:25.060037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 00:32:25.060037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:25.060037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 477/923] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Sep 15 00:32:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:25.065161 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4622d8-9c2c-409d-8cbc-2681965d01b1 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:25.077204 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b57d5c76-a255-4d72-a871-a6fea4d22a80 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:25.079010 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b57d5c76-a255-4d72-a871-a6fea4d22a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:25.171562 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 447/924] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 00:32:25.181478 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4622d8-9c2c-409d-8cbc-2681965d01b1 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:25.216706 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380da26e-a703-4dee-a7a4-6feb5fac905c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:25.217682 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380da26e-a703-4dee-a7a4-6feb5fac905c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:25.218207 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380da26e-a703-4dee-a7a4-6feb5fac905c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:25.218724 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380da26e-a703-4dee-a7a4-6feb5fac905c None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:25.219583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380da26e-a703-4dee-a7a4-6feb5fac905c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:25.220083 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380da26e-a703-4dee-a7a4-6feb5fac905c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:25.221717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380da26e-a703-4dee-a7a4-6feb5fac905c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:25.231029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 478/925] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Sep 15 00:32:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:25.239058 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d5c76-a255-4d72-a871-a6fea4d22a80 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:25.268835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:25.340566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d5c76-a255-4d72-a871-a6fea4d22a80 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:25.376176 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c0e3a-07e6-48b4-ae0d-53489c6648af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:25.376810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c0e3a-07e6-48b4-ae0d-53489c6648af None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:25.377099 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c0e3a-07e6-48b4-ae0d-53489c6648af None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:25.377376 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c0e3a-07e6-48b4-ae0d-53489c6648af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:25.388885 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c0e3a-07e6-48b4-ae0d-53489c6648af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:25.390378 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c0e3a-07e6-48b4-ae0d-53489c6648af None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:25.405570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-d97c0e3a-07e6-48b4-ae0d-53489c6648af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:25.405570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:25.405570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:25.405570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:25.405570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:25.405570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:25.405570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:25.405570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:25.405570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:25.405570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:25.405570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:25.405570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:25.405570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:25.405570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:25.405570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:25.405570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:25.406530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:25.406530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:25.406530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:25.406530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:25.406530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:25.406530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:25.406530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:25.406530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:25.406530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:25.406530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:25.406530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:25.406530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:25.406530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:25.406530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:25.406530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:25.406530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:25.406530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:25.407434 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:25.407434 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:25.407434 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:25.407434 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 448/926] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:25.412615 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380da26e-a703-4dee-a7a4-6feb5fac905c None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:25.466227 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c0e3a-07e6-48b4-ae0d-53489c6648af None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:25.475584 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:25.518622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380da26e-a703-4dee-a7a4-6feb5fac905c None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:25.557117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03122b3c-ae83-4ab2-a2ca-2bb98ac08651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:25.558125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03122b3c-ae83-4ab2-a2ca-2bb98ac08651 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:25.558798 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03122b3c-ae83-4ab2-a2ca-2bb98ac08651 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:25.559284 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03122b3c-ae83-4ab2-a2ca-2bb98ac08651 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:25.560131 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03122b3c-ae83-4ab2-a2ca-2bb98ac08651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:25.560635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03122b3c-ae83-4ab2-a2ca-2bb98ac08651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:25.562318 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03122b3c-ae83-4ab2-a2ca-2bb98ac08651 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:25.562970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:25.576739 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 479/927] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:25.581985 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03122b3c-ae83-4ab2-a2ca-2bb98ac08651 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:25.588784 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c0e3a-07e6-48b4-ae0d-53489c6648af None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:25.627804 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb76eb-d96b-438f-bd13-d3a3cf22d894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:25.628613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb76eb-d96b-438f-bd13-d3a3cf22d894 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:25.629117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb76eb-d96b-438f-bd13-d3a3cf22d894 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:25.629313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb76eb-d96b-438f-bd13-d3a3cf22d894 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:25.629847 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb76eb-d96b-438f-bd13-d3a3cf22d894 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:25.631786 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb76eb-d96b-438f-bd13-d3a3cf22d894 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:25.641762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-ddfb76eb-d96b-438f-bd13-d3a3cf22d894 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 00:32:25.641762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:25.641762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:32:25.641762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:32:25.641762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:32:25.641762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:32:25.641762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:32:25.641762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:25.641762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 00:32:25.641762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:25.641762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:25.641762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:25.641762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:25.641762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:25.641762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:25.641762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:25.641762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:25.642838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:25.642838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:25.642838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:25.642838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:25.642838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:25.642838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:25.642838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:32:25.642838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:32:25.642838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:32:25.642838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:32:25.642838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:25.642838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:25.642838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:25.642838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:25.642838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:25.642838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:25.643696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:25.643696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:25.643696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:25.643696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:25.643696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:25.643696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:25.643696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:25.643696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:25.643696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:25.643696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:25.643696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:32:25.643696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:25.643696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 00:32:25.643696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:25.648281 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 449/928] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 15 00:32:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:25.650145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb76eb-d96b-438f-bd13-d3a3cf22d894 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:25.700801 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03122b3c-ae83-4ab2-a2ca-2bb98ac08651 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:25.722036 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:25.737893 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a49dd-d3f1-4798-bf24-053c6748b46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:25.738650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a49dd-d3f1-4798-bf24-053c6748b46f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:25.739029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a49dd-d3f1-4798-bf24-053c6748b46f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:25.739397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a49dd-d3f1-4798-bf24-053c6748b46f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:25.747705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a49dd-d3f1-4798-bf24-053c6748b46f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:25.749288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a49dd-d3f1-4798-bf24-053c6748b46f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:25.761464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-e42a49dd-d3f1-4798-bf24-053c6748b46f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 00:32:25.761464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:25.761464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:25.761464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:25.761464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:25.761464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:25.761464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:25.761464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:25.761464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:25.761464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:25.761464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:25.761464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:25.761464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:32:25.761464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:32:25.761464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:32:25.761464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:32:25.762476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:25.762476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:25.762476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:32:25.762476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:25.762476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:32:25.762476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:25.762476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:25.762476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:25.762476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:25.762476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:25.762476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:25.762476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:25.762476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:25.762476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:25.762476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:25.762476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:25.762476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:25.762476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:25.763403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:25.763403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:25.763403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:32:25.763403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:32:25.763403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:32:25.763403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:32:25.763403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:32:25.763403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:32:25.763403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 00:32:25.763403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:25.765117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 480/929] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Sep 15 00:32:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:25.769476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a49dd-d3f1-4798-bf24-053c6748b46f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:25.773329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb76eb-d96b-438f-bd13-d3a3cf22d894 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:25.808559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3831fa-a605-4413-b0f7-5260e1ea2069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:25.809185 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3831fa-a605-4413-b0f7-5260e1ea2069 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:25.809518 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3831fa-a605-4413-b0f7-5260e1ea2069 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:25.809825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3831fa-a605-4413-b0f7-5260e1ea2069 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:25.810404 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3831fa-a605-4413-b0f7-5260e1ea2069 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:25.810700 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3831fa-a605-4413-b0f7-5260e1ea2069 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:25.812050 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3831fa-a605-4413-b0f7-5260e1ea2069 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:25.821466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 450/930] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 15 00:32:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:25.822737 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be22737-cbf1-4200-af59-5eebcced5477 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:25.823016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be22737-cbf1-4200-af59-5eebcced5477 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:25.823284 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be22737-cbf1-4200-af59-5eebcced5477 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:25.824520 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 451/931] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:25.825330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be22737-cbf1-4200-af59-5eebcced5477 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:25.843803 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:25.874951 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a49dd-d3f1-4798-bf24-053c6748b46f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:25.914658 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d258b78-7dab-4e31-8f5e-33d6f9a54d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:25.915271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d258b78-7dab-4e31-8f5e-33d6f9a54d29 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:25.915554 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d258b78-7dab-4e31-8f5e-33d6f9a54d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:25.915827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d258b78-7dab-4e31-8f5e-33d6f9a54d29 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:25.916562 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d258b78-7dab-4e31-8f5e-33d6f9a54d29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:25.916865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d258b78-7dab-4e31-8f5e-33d6f9a54d29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:25.918339 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d258b78-7dab-4e31-8f5e-33d6f9a54d29 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:25.937321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 481/932] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Sep 15 00:32:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:25.938542 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98980dc-7719-4e73-a137-f63217d16d92 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:25.938833 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98980dc-7719-4e73-a137-f63217d16d92 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:25.939107 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98980dc-7719-4e73-a137-f63217d16d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:25.943616 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be22737-cbf1-4200-af59-5eebcced5477 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:25.957742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-e98980dc-7719-4e73-a137-f63217d16d92 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:25.959455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e98980dc-7719-4e73-a137-f63217d16d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:25.983011 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfbbaf-0c5f-4c0f-a638-bc1379e1f2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:25.983791 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfbbaf-0c5f-4c0f-a638-bc1379e1f2d4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:25.984074 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfbbaf-0c5f-4c0f-a638-bc1379e1f2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:25.984342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfbbaf-0c5f-4c0f-a638-bc1379e1f2d4 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:25.984968 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfbbaf-0c5f-4c0f-a638-bc1379e1f2d4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:25.985301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfbbaf-0c5f-4c0f-a638-bc1379e1f2d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:25.986661 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfbbaf-0c5f-4c0f-a638-bc1379e1f2d4 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:25.991515 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 452/933] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Sep 15 00:32:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:25.992265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfbbaf-0c5f-4c0f-a638-bc1379e1f2d4 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:25.994432 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:26.034776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 482/934] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:26.036573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98980dc-7719-4e73-a137-f63217d16d92 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:26.079847 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:26.106137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfbbaf-0c5f-4c0f-a638-bc1379e1f2d4 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:26.139812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1690f-dd85-4441-b480-28876617a881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:26.140538 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1690f-dd85-4441-b480-28876617a881 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:26.140913 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1690f-dd85-4441-b480-28876617a881 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:26.141274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1690f-dd85-4441-b480-28876617a881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:26.152597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1690f-dd85-4441-b480-28876617a881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:26.154350 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1690f-dd85-4441-b480-28876617a881 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:26.169502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-fbe1690f-dd85-4441-b480-28876617a881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:26.169502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:26.169502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:26.169502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:26.169502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:26.169502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:26.169502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:26.169502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:26.169502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:26.169502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:26.169502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:26.169502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:26.169502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:26.169502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:26.169502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:26.169502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:26.170448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:26.170448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:26.170448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:26.170448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:26.170448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:26.170448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:26.170448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:26.170448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:26.170448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:26.170448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:26.170448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:26.170448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:26.170448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:26.170448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:26.170448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:26.170448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:26.170448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:26.171342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:26.171342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:26.171342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:26.171342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 453/935] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:26.178052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1690f-dd85-4441-b480-28876617a881 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:26.180296 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98980dc-7719-4e73-a137-f63217d16d92 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:26.227965 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bd84b-8866-4590-9944-4a26fe5a0c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:26.229299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bd84b-8866-4590-9944-4a26fe5a0c74 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:26.229609 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bd84b-8866-4590-9944-4a26fe5a0c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:26.229887 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bd84b-8866-4590-9944-4a26fe5a0c74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:26.230576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bd84b-8866-4590-9944-4a26fe5a0c74 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:26.231946 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bd84b-8866-4590-9944-4a26fe5a0c74 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:26.261702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 483/936] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:32:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:32:26.298647 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1690f-dd85-4441-b480-28876617a881 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:26.329816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:26.334563 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bd84b-8866-4590-9944-4a26fe5a0c74 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:26.347353 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44508a57-a5ca-44e5-bb4c-eecbc5067ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:26.348227 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44508a57-a5ca-44e5-bb4c-eecbc5067ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:26.348512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44508a57-a5ca-44e5-bb4c-eecbc5067ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:26.348784 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44508a57-a5ca-44e5-bb4c-eecbc5067ce0 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:26.350068 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44508a57-a5ca-44e5-bb4c-eecbc5067ce0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:26.350372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44508a57-a5ca-44e5-bb4c-eecbc5067ce0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:26.351788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44508a57-a5ca-44e5-bb4c-eecbc5067ce0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:26.364742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:26.367805 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 454/937] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:26.374712 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44508a57-a5ca-44e5-bb4c-eecbc5067ce0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:26.459370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bd84b-8866-4590-9944-4a26fe5a0c74 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:26.499613 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fec7b0-5318-4b33-8ad7-20f290893b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:26.500307 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fec7b0-5318-4b33-8ad7-20f290893b29 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:26.500588 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fec7b0-5318-4b33-8ad7-20f290893b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:26.500869 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fec7b0-5318-4b33-8ad7-20f290893b29 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:26.501507 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fec7b0-5318-4b33-8ad7-20f290893b29 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:26.502864 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fec7b0-5318-4b33-8ad7-20f290893b29 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:26.512300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-98fec7b0-5318-4b33-8ad7-20f290893b29 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 00:32:26.512300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:26.512300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:32:26.512300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:32:26.512300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:32:26.512300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:32:26.512300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:32:26.512300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:26.512300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 00:32:26.512300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:26.512300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:26.512300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:26.512300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:26.512300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:26.512300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:26.512300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:26.513303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:26.513303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:26.513303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:26.513303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:26.513303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:26.513303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:26.513303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:26.513303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:32:26.513303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:32:26.513303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:32:26.513303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:32:26.513303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:26.513303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:26.513303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:26.513303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:26.513303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:26.513303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:26.514737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:26.514737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:26.514737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:26.514737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:26.514737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:26.514737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:26.514737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:26.514737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:26.514737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:26.514737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:26.514737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:32:26.514737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:26.514737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 00:32:26.514737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:26.514737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 484/938] 10.222.0.52 () {56 vars in 1132 bytes} [Thu Sep 15 00:32:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:26.515590 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44508a57-a5ca-44e5-bb4c-eecbc5067ce0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:26.524410 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fec7b0-5318-4b33-8ad7-20f290893b29 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:26.560080 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40693786-478b-481b-be2f-78368721560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:26.560720 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40693786-478b-481b-be2f-78368721560f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:26.561202 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40693786-478b-481b-be2f-78368721560f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:26.561750 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40693786-478b-481b-be2f-78368721560f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:26.571047 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40693786-478b-481b-be2f-78368721560f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:26.573276 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40693786-478b-481b-be2f-78368721560f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:26.585016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-40693786-478b-481b-be2f-78368721560f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:26.585016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:26.585016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:26.585016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:26.585016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:26.585016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:26.585016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:26.585016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:26.585016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:26.585016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:26.585016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:26.585016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:26.585016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:32:26.585016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:32:26.585016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:32:26.585958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:32:26.585958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:26.585958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:26.585958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:26.585958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:26.585958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:26.585958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:26.585958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:26.585958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:26.585958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:26.585958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:26.585958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:26.585958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:26.585958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:26.585958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:26.585958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:26.585958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:26.586866 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:32:26.586866 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:32:26.586866 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:32:26.586866 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:32:26.586866 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:32:26.586866 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:32:26.586866 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:26.586866 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:26.586866 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 455/939] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:32:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:26.592334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40693786-478b-481b-be2f-78368721560f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:26.642059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:26.655264 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:26.673360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fec7b0-5318-4b33-8ad7-20f290893b29 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:26.702668 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40693786-478b-481b-be2f-78368721560f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:26.720895 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646581b-1b77-4e7d-a194-de7c8694e5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:26.721864 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646581b-1b77-4e7d-a194-de7c8694e5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:26.722332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646581b-1b77-4e7d-a194-de7c8694e5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:26.722813 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646581b-1b77-4e7d-a194-de7c8694e5e5 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:26.723710 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646581b-1b77-4e7d-a194-de7c8694e5e5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:26.724217 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646581b-1b77-4e7d-a194-de7c8694e5e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:26.726471 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646581b-1b77-4e7d-a194-de7c8694e5e5 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:26.737485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 485/940] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Sep 15 00:32:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:26.739033 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646581b-1b77-4e7d-a194-de7c8694e5e5 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:26.743475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b2273-6465-4044-b2f6-7ee194da5f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:26.744084 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b2273-6465-4044-b2f6-7ee194da5f80 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:26.744375 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b2273-6465-4044-b2f6-7ee194da5f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:26.744677 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b2273-6465-4044-b2f6-7ee194da5f80 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:26.745479 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b2273-6465-4044-b2f6-7ee194da5f80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:26.745790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b2273-6465-4044-b2f6-7ee194da5f80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:26.747273 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b2273-6465-4044-b2f6-7ee194da5f80 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:26.767978 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 456/941] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:32:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:26.768865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b2273-6465-4044-b2f6-7ee194da5f80 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:26.869893 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646581b-1b77-4e7d-a194-de7c8694e5e5 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:26.889632 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b2273-6465-4044-b2f6-7ee194da5f80 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:26.892788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:26.910398 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36daaa78-c48e-4941-8e69-23876cef4e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:26.911007 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36daaa78-c48e-4941-8e69-23876cef4e86 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:26.911288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36daaa78-c48e-4941-8e69-23876cef4e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:26.911559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36daaa78-c48e-4941-8e69-23876cef4e86 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:26.912752 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36daaa78-c48e-4941-8e69-23876cef4e86 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:26.913054 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36daaa78-c48e-4941-8e69-23876cef4e86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:26.914434 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36daaa78-c48e-4941-8e69-23876cef4e86 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:26.920240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 486/942] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Sep 15 00:32:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:26.921471 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece6ca4-ca36-4a45-85d2-fc0d39077530 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:26.921758 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece6ca4-ca36-4a45-85d2-fc0d39077530 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:26.922029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece6ca4-ca36-4a45-85d2-fc0d39077530 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:26.923397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 487/943] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:26.928121 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece6ca4-ca36-4a45-85d2-fc0d39077530 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:26.933286 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014a021-339f-4f3e-b197-d445b85f14df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:26.933938 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014a021-339f-4f3e-b197-d445b85f14df None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:26.934216 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014a021-339f-4f3e-b197-d445b85f14df None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:26.934486 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014a021-339f-4f3e-b197-d445b85f14df None admin] PATH_INFO: `/v3/projects/f25792dd210b42c4a3491096a735f909/users/ed49a596f15542a29ce331bae4640274/roles/775f8b8679a94a5887e259c092f17088` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:26.936628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014a021-339f-4f3e-b197-d445b85f14df None admin] RBAC: Authorizing `identity:create_grant(project_id=f25792dd210b42c4a3491096a735f909, user_id=ed49a596f15542a29ce331bae4640274, role_id=775f8b8679a94a5887e259c092f17088)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:26.938092 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014a021-339f-4f3e-b197-d445b85f14df None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:26.948931 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:26.953200 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 457/944] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:32:26 2022] PUT /identity/v3/projects/f25792dd210b42c4a3491096a735f909/users/ed49a596f15542a29ce331bae4640274/roles/775f8b8679a94a5887e259c092f17088 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:32:26.962424 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971acd4e-e61c-46cf-ad7d-1efab793bf56 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:26.962713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971acd4e-e61c-46cf-ad7d-1efab793bf56 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:26.962999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971acd4e-e61c-46cf-ad7d-1efab793bf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:26.990762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-971acd4e-e61c-46cf-ad7d-1efab793bf56 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:26.992592 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-971acd4e-e61c-46cf-ad7d-1efab793bf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:27.073796 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece6ca4-ca36-4a45-85d2-fc0d39077530 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:27.093518 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 458/945] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:27.117600 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656587a6-139d-4fe8-a859-ec425b321cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:27.118590 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656587a6-139d-4fe8-a859-ec425b321cb9 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:27.119112 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656587a6-139d-4fe8-a859-ec425b321cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:27.119587 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656587a6-139d-4fe8-a859-ec425b321cb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:27.120462 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656587a6-139d-4fe8-a859-ec425b321cb9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:27.122298 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656587a6-139d-4fe8-a859-ec425b321cb9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:27.149028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 488/946] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:32:26 2022] POST /identity/v3/endpoints => generated 347 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:32:27.376153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971acd4e-e61c-46cf-ad7d-1efab793bf56 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:27.473247 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:27.484257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971acd4e-e61c-46cf-ad7d-1efab793bf56 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:27.525852 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e90e76-4bdc-4ab2-aa18-0653472827d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:27.526486 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e90e76-4bdc-4ab2-aa18-0653472827d6 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:27.526768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e90e76-4bdc-4ab2-aa18-0653472827d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:27.527042 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e90e76-4bdc-4ab2-aa18-0653472827d6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:27.527621 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e90e76-4bdc-4ab2-aa18-0653472827d6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:27.528997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e90e76-4bdc-4ab2-aa18-0653472827d6 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:27.538837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-e4e90e76-4bdc-4ab2-aa18-0653472827d6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 00:32:27.538837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:27.538837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:32:27.538837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:32:27.538837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:32:27.538837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:32:27.538837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:32:27.538837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:27.538837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 00:32:27.538837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:27.538837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:27.538837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:27.538837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:27.538837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:27.538837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:27.538837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:27.538837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:27.539821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:27.539821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:27.539821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:27.539821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:27.539821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:27.539821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:27.539821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:32:27.539821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:32:27.539821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:32:27.539821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:32:27.539821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:27.539821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:27.539821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:27.539821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:27.539821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:27.539821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:27.540662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:27.540662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:27.540662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:27.540662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:27.540662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:27.540662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:27.540662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:27.540662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:27.540662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:27.540662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:27.540662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:32:27.540662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:27.540662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 00:32:27.540662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:27.540662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 459/947] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Sep 15 00:32:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:27.546214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656587a6-139d-4fe8-a859-ec425b321cb9 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:27.626865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:27.660834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656587a6-139d-4fe8-a859-ec425b321cb9 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:27.696836 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f610de-f96e-4046-bb08-3a316b4a906a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:27.697460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f610de-f96e-4046-bb08-3a316b4a906a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:27.697736 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f610de-f96e-4046-bb08-3a316b4a906a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:27.698002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f610de-f96e-4046-bb08-3a316b4a906a None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:27.698618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f610de-f96e-4046-bb08-3a316b4a906a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:27.698918 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f610de-f96e-4046-bb08-3a316b4a906a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:27.700256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f610de-f96e-4046-bb08-3a316b4a906a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:27.705477 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 489/948] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Sep 15 00:32:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:27.711073 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e90e76-4bdc-4ab2-aa18-0653472827d6 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:27.813714 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e90e76-4bdc-4ab2-aa18-0653472827d6 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:27.848086 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88546c72-c75e-4974-9c19-16112fdc995d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:27.848693 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88546c72-c75e-4974-9c19-16112fdc995d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:27.848967 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88546c72-c75e-4974-9c19-16112fdc995d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:27.849366 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88546c72-c75e-4974-9c19-16112fdc995d None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:27.850499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88546c72-c75e-4974-9c19-16112fdc995d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:27.850803 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88546c72-c75e-4974-9c19-16112fdc995d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:27.852162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88546c72-c75e-4974-9c19-16112fdc995d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:27.857336 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 460/949] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Sep 15 00:32:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:27.869201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f610de-f96e-4046-bb08-3a316b4a906a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:27.991355 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f610de-f96e-4046-bb08-3a316b4a906a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:28.026086 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15ab75-02ca-4b2f-8a42-e5946c065508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:28.026681 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15ab75-02ca-4b2f-8a42-e5946c065508 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:28.027004 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15ab75-02ca-4b2f-8a42-e5946c065508 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:28.027276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15ab75-02ca-4b2f-8a42-e5946c065508 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:28.027932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15ab75-02ca-4b2f-8a42-e5946c065508 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:28.029302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15ab75-02ca-4b2f-8a42-e5946c065508 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:28.034729 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:28.061496 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 490/950] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:32:27 2022] POST /identity/v3/endpoints => generated 349 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:32:28.623496 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b81776-82a9-47f2-bc6b-82cde84ddce2 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:28.624002 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b81776-82a9-47f2-bc6b-82cde84ddce2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:28.624002 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b81776-82a9-47f2-bc6b-82cde84ddce2 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:28.625718 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 461/951] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:28.631734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d9803-1625-4d45-bbde-2cb98bad24f2 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:28.632175 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d9803-1625-4d45-bbde-2cb98bad24f2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:28.632361 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d9803-1625-4d45-bbde-2cb98bad24f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:28.651466 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f86d9803-1625-4d45-bbde-2cb98bad24f2 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:28.652665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f86d9803-1625-4d45-bbde-2cb98bad24f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:28.737186 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 491/952] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:29.003219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b81776-82a9-47f2-bc6b-82cde84ddce2 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:29.023588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:29.113770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b81776-82a9-47f2-bc6b-82cde84ddce2 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:29.153255 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd22d3f-52a9-477e-86dd-135ccf22e723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:29.153868 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd22d3f-52a9-477e-86dd-135ccf22e723 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:29.154156 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd22d3f-52a9-477e-86dd-135ccf22e723 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:29.154434 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd22d3f-52a9-477e-86dd-135ccf22e723 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:29.155090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd22d3f-52a9-477e-86dd-135ccf22e723 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:29.156612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd22d3f-52a9-477e-86dd-135ccf22e723 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:29.159251 dv-cinder-857528-2-smb devstack@keystone.service[81615]: WARNING keystone.server.flask.common [None req-ddd22d3f-52a9-477e-86dd-135ccf22e723 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 15 00:32:29.179139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.sql.core [None req-ddd22d3f-52a9-477e-86dd-135ccf22e723 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 15 00:32:29.179139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 15 00:32:29.179139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [parameters: {'id': 'b2c94d62e2a548e0af9b972a3c5590d9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 15 00:32:29.179139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81615) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 00:32:29.187033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-ddd22d3f-52a9-477e-86dd-135ccf22e723 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b2c94d62e2a548e0af9b972a3c5590d9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b2c94d62e2a548e0af9b972a3c5590d9. Sep 15 00:32:29.187033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:29.187033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 00:32:29.187033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 00:32:29.187033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 00:32:29.187033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 00:32:29.187033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 00:32:29.187033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 00:32:29.187033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 00:32:29.187033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application conn.query(q) Sep 15 00:32:29.187033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 00:32:29.187033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 00:32:29.187033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 00:32:29.187835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result.read() Sep 15 00:32:29.187835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 00:32:29.187835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 00:32:29.187835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 00:32:29.187835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 00:32:29.187835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 00:32:29.187835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 00:32:29.187835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 00:32:29.187835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 00:32:29.187835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 15 00:32:29.187835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:29.187835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 15 00:32:29.187835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:29.187835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:29.187835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 15 00:32:29.187835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 15 00:32:29.187835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 15 00:32:29.187835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 15 00:32:29.188829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 00:32:29.188829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application next(self.gen) Sep 15 00:32:29.188829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 15 00:32:29.188829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application yield resource Sep 15 00:32:29.188829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 00:32:29.188829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application next(self.gen) Sep 15 00:32:29.188829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 15 00:32:29.188829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.session.rollback() Sep 15 00:32:29.188829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 15 00:32:29.188829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.force_reraise() Sep 15 00:32:29.188829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 15 00:32:29.188829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise self.value Sep 15 00:32:29.188829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 15 00:32:29.188829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 15 00:32:29.188829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 15 00:32:29.188829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application session.commit() Sep 15 00:32:29.188829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 15 00:32:29.189785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 15 00:32:29.189785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 15 00:32:29.189785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._prepare_impl() Sep 15 00:32:29.189785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 15 00:32:29.189785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.session.flush() Sep 15 00:32:29.189785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 15 00:32:29.189785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._flush(objects) Sep 15 00:32:29.189785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 15 00:32:29.189785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 15 00:32:29.189785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 15 00:32:29.189785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application compat.raise_( Sep 15 00:32:29.189785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 00:32:29.189785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception Sep 15 00:32:29.189785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 15 00:32:29.189785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application flush_context.execute() Sep 15 00:32:29.189785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 15 00:32:29.189785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rec.execute(self) Sep 15 00:32:29.190713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 15 00:32:29.190713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 15 00:32:29.190713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 15 00:32:29.190713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 15 00:32:29.190713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 15 00:32:29.190713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 15 00:32:29.190713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 15 00:32:29.190713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 15 00:32:29.190713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 15 00:32:29.190713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 15 00:32:29.190713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 15 00:32:29.190713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 15 00:32:29.190713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 15 00:32:29.190713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 15 00:32:29.190713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 15 00:32:29.191526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 15 00:32:29.191526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 00:32:29.191526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception Sep 15 00:32:29.191526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 00:32:29.191526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 00:32:29.191526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 00:32:29.191526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 00:32:29.191526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 00:32:29.191526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 00:32:29.191526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 00:32:29.191526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application conn.query(q) Sep 15 00:32:29.191526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 00:32:29.191526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 00:32:29.191526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 00:32:29.191526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result.read() Sep 15 00:32:29.191526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 00:32:29.191526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 00:32:29.192385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 00:32:29.192385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 00:32:29.192385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 00:32:29.192385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 00:32:29.192385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 00:32:29.192385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 00:32:29.192385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 15 00:32:29.192385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 15 00:32:29.192385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [parameters: {'id': 'b2c94d62e2a548e0af9b972a3c5590d9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 15 00:32:29.192385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 15 00:32:29.192385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:29.192385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:29.192385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:29.192385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:29.192385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 15 00:32:29.195257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 15 00:32:29.195257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 15 00:32:29.195257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 15 00:32:29.195257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 15 00:32:29.195257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:29.195257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:29.195257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:29.195257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:29.195257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:29.195257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:29.195257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:29.195257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:29.195257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:29.195257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:29.195257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:29.195257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:29.195257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:29.197423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:29.197423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 15 00:32:29.197423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 15 00:32:29.197423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:29.197423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:29.197423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 15 00:32:29.197423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 15 00:32:29.197423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b2c94d62e2a548e0af9b972a3c5590d9. Sep 15 00:32:29.197423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:29.197423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 462/953] 10.222.0.52 () {60 vars in 1140 bytes} [Thu Sep 15 00:32:29 2022] POST /identity/v3/projects => generated 262 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:29.198919 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d9803-1625-4d45-bbde-2cb98bad24f2 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:29.216251 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0f4e4-eed5-4f32-9abd-fe1214a0736d None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:29.216552 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0f4e4-eed5-4f32-9abd-fe1214a0736d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:29.216815 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0f4e4-eed5-4f32-9abd-fe1214a0736d None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:29.225129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 463/954] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:32:29.228662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f7cf8-9919-4de1-aa25-6067dba78f33 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:29.229145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f7cf8-9919-4de1-aa25-6067dba78f33 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:29.229851 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f7cf8-9919-4de1-aa25-6067dba78f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:29.256096 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e86f7cf8-9919-4de1-aa25-6067dba78f33 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:29.258461 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e86f7cf8-9919-4de1-aa25-6067dba78f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:29.317982 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d9803-1625-4d45-bbde-2cb98bad24f2 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:29.346461 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:29.361200 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 464/955] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:29.371352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f9d81-83cf-4ab2-924a-4e0438cfd6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:29.372222 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f9d81-83cf-4ab2-924a-4e0438cfd6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:29.372690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f9d81-83cf-4ab2-924a-4e0438cfd6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:29.373201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f9d81-83cf-4ab2-924a-4e0438cfd6f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:29.381376 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f9d81-83cf-4ab2-924a-4e0438cfd6f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:29.383056 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f9d81-83cf-4ab2-924a-4e0438cfd6f1 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:29.395120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-ca6f9d81-83cf-4ab2-924a-4e0438cfd6f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:29.395120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:29.395120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:29.395120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:29.395120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:29.395120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:29.395120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:29.395120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:29.395120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:29.395120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:29.395120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:29.395120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:29.395120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:32:29.395120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:32:29.395120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:32:29.396101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:32:29.396101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:29.396101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:29.396101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:29.396101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:29.396101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:29.396101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:29.396101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:29.396101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:29.396101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:29.396101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:29.396101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:29.396101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:29.396101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:29.396101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:29.396101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:29.396101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:29.397636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:32:29.397636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:32:29.397636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:32:29.397636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:32:29.397636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:32:29.397636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:32:29.397636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:29.397636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:29.404740 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 492/956] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:32:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:29.406287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f7cf8-9919-4de1-aa25-6067dba78f33 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:29.414522 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e30aa5-2258-4feb-b864-d3fdcd5b81c5 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:29.414810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e30aa5-2258-4feb-b864-d3fdcd5b81c5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:29.415090 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e30aa5-2258-4feb-b864-d3fdcd5b81c5 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:29.416654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 493/957] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:29.421013 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:29.422595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa435b-25cc-44f7-ba84-dce1c715ad92 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:29.422876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa435b-25cc-44f7-ba84-dce1c715ad92 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:29.423150 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa435b-25cc-44f7-ba84-dce1c715ad92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:29.445014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-67fa435b-25cc-44f7-ba84-dce1c715ad92 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:29.446230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-67fa435b-25cc-44f7-ba84-dce1c715ad92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:29.531586 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f7cf8-9919-4de1-aa25-6067dba78f33 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:29.533561 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 494/958] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:29.567243 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bad42-f036-453c-a6a9-5e06c896d473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:29.568668 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bad42-f036-453c-a6a9-5e06c896d473 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:29.569158 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bad42-f036-453c-a6a9-5e06c896d473 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:29.569614 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bad42-f036-453c-a6a9-5e06c896d473 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:29.570475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bad42-f036-453c-a6a9-5e06c896d473 None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:29.570958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bad42-f036-453c-a6a9-5e06c896d473 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:29.572733 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bad42-f036-453c-a6a9-5e06c896d473 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:29.597200 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 465/959] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 15 00:32:29 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:29.635253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa435b-25cc-44f7-ba84-dce1c715ad92 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:29.757876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa435b-25cc-44f7-ba84-dce1c715ad92 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:29.769408 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:29.798245 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec6d2f-e4be-4a27-a5dc-aaf7a4dd28db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:29.798840 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec6d2f-e4be-4a27-a5dc-aaf7a4dd28db None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:29.799121 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec6d2f-e4be-4a27-a5dc-aaf7a4dd28db None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:29.799394 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec6d2f-e4be-4a27-a5dc-aaf7a4dd28db None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:29.803381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bad42-f036-453c-a6a9-5e06c896d473 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:29.811956 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec6d2f-e4be-4a27-a5dc-aaf7a4dd28db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:32:29.817176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-62ec6d2f-e4be-4a27-a5dc-aaf7a4dd28db None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 00:32:29.817176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:29.817176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:29.817176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:29.817176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:29.817176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:29.817176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:29.817176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:29.817176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:29.817176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:29.817176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:29.817176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:29.817176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:32:29.817176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:32:29.817176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:32:29.817176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:32:29.818257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:32:29.818257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:32:29.818257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:32:29.818257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:32:29.818257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:29.818257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:29.818257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:29.818257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:29.818257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:29.818257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:29.818257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:29.818257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:29.818257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:29.818257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:29.818257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:29.818257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:29.819095 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:29.819095 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:29.819095 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:29.819095 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:29.819095 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:32:29.819095 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:32:29.819095 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:32:29.819095 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:32:29.819095 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:32:29.819095 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:32:29.819095 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 00:32:29.819095 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:29.819095 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 495/960] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Sep 15 00:32:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:29.824478 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec6d2f-e4be-4a27-a5dc-aaf7a4dd28db None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:29.881682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:29.938438 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bad42-f036-453c-a6a9-5e06c896d473 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:29.946081 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec6d2f-e4be-4a27-a5dc-aaf7a4dd28db None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:29.980218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e59147-bb78-4538-91dd-4488fa0c575d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:29.981028 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e59147-bb78-4538-91dd-4488fa0c575d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:29.981581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e59147-bb78-4538-91dd-4488fa0c575d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:29.981957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e59147-bb78-4538-91dd-4488fa0c575d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:29.982753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e59147-bb78-4538-91dd-4488fa0c575d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:29.985116 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e59147-bb78-4538-91dd-4488fa0c575d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:29.992248 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffda1a-97e1-46c7-b0f9-26ec2229da89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:29.993043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffda1a-97e1-46c7-b0f9-26ec2229da89 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:29.993496 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffda1a-97e1-46c7-b0f9-26ec2229da89 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:29.993917 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffda1a-97e1-46c7-b0f9-26ec2229da89 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:29.994745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffda1a-97e1-46c7-b0f9-26ec2229da89 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:29.995200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffda1a-97e1-46c7-b0f9-26ec2229da89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:29.995698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-86e59147-bb78-4538-91dd-4488fa0c575d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 00:32:29.995698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:29.995698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:32:29.995698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:32:29.995698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:32:29.995698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:32:29.995698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:32:29.995698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:29.995698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 00:32:29.995698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:29.995698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:29.995698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:29.995698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:29.995698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:29.995698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:29.995698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:29.995698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:29.997054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:29.997054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:29.997054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:29.997054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:29.997054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:29.997054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:29.997054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:32:29.997054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:32:29.997054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:32:29.997054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:32:29.997054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:29.997054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:29.997054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:29.997054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:29.997054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:29.997054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:29.998169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:29.998169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:29.998169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:29.998169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:29.998169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:29.998169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:29.998169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:29.998169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:29.998169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:29.998169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:29.998169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:32:29.998169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:29.998169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 00:32:29.998169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:30.004085 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 466/961] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:32:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:30.004232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffda1a-97e1-46c7-b0f9-26ec2229da89 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:30.005615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e59147-bb78-4538-91dd-4488fa0c575d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:30.013290 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 496/962] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Sep 15 00:32:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:30.024519 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffda1a-97e1-46c7-b0f9-26ec2229da89 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:30.062512 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:30.141949 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e59147-bb78-4538-91dd-4488fa0c575d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:30.163329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffda1a-97e1-46c7-b0f9-26ec2229da89 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:30.174387 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:30.184733 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310a94c-77ab-4b18-91a8-b800f19ec8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:30.185592 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310a94c-77ab-4b18-91a8-b800f19ec8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:30.186012 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310a94c-77ab-4b18-91a8-b800f19ec8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:30.186423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310a94c-77ab-4b18-91a8-b800f19ec8a2 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:30.187278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310a94c-77ab-4b18-91a8-b800f19ec8a2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:30.187735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310a94c-77ab-4b18-91a8-b800f19ec8a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:30.189358 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310a94c-77ab-4b18-91a8-b800f19ec8a2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:30.195754 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 467/963] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 15 00:32:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:30.200917 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310a94c-77ab-4b18-91a8-b800f19ec8a2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:30.207957 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202378c8-8c54-4a27-9c4c-5d512bb49327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:30.208681 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202378c8-8c54-4a27-9c4c-5d512bb49327 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:30.209541 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202378c8-8c54-4a27-9c4c-5d512bb49327 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:30.209818 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202378c8-8c54-4a27-9c4c-5d512bb49327 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:30.223387 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202378c8-8c54-4a27-9c4c-5d512bb49327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:30.224905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202378c8-8c54-4a27-9c4c-5d512bb49327 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:30.241705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-202378c8-8c54-4a27-9c4c-5d512bb49327 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:30.241705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:30.241705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:30.241705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:30.241705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:30.241705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:30.241705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:30.241705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:30.241705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:30.241705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:30.241705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:30.241705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:30.241705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:30.241705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:30.241705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:30.241705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:30.242776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:30.242776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:30.242776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:30.242776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:30.242776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:30.242776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:30.242776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:30.242776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:30.242776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:30.242776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:30.242776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:30.242776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:30.242776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:30.242776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:30.242776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:30.242776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:30.242776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:30.243689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:30.243689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:30.243689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:30.247405 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 497/964] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:30.248565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202378c8-8c54-4a27-9c4c-5d512bb49327 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:30.323776 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310a94c-77ab-4b18-91a8-b800f19ec8a2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:30.344244 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:30.362855 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a71408-0d74-4726-87ec-9eb82ea0cd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:30.363664 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a71408-0d74-4726-87ec-9eb82ea0cd78 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:30.363946 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a71408-0d74-4726-87ec-9eb82ea0cd78 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:30.364221 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a71408-0d74-4726-87ec-9eb82ea0cd78 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:30.364628 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202378c8-8c54-4a27-9c4c-5d512bb49327 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:30.364876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a71408-0d74-4726-87ec-9eb82ea0cd78 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:30.365214 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a71408-0d74-4726-87ec-9eb82ea0cd78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:30.366587 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a71408-0d74-4726-87ec-9eb82ea0cd78 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:30.377116 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 468/965] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 15 00:32:30 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:30.377116 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32a666-21a6-4a87-b78b-6461bf87f3bd None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:30.377116 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32a666-21a6-4a87-b78b-6461bf87f3bd None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:30.377116 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32a666-21a6-4a87-b78b-6461bf87f3bd None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:30.377116 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 469/966] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:30.379623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b22a4-4a2e-424f-963d-a2e6d536a301 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:30.379978 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b22a4-4a2e-424f-963d-a2e6d536a301 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:30.380258 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b22a4-4a2e-424f-963d-a2e6d536a301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:30.405493 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ca4b22a4-4a2e-424f-963d-a2e6d536a301 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:30.407469 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ca4b22a4-4a2e-424f-963d-a2e6d536a301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:30.410777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1eaf9b-1289-403f-b6c7-c5836a43e414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:30.411475 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1eaf9b-1289-403f-b6c7-c5836a43e414 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:30.411864 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1eaf9b-1289-403f-b6c7-c5836a43e414 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:30.412206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1eaf9b-1289-403f-b6c7-c5836a43e414 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:30.412940 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1eaf9b-1289-403f-b6c7-c5836a43e414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:30.413345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1eaf9b-1289-403f-b6c7-c5836a43e414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:30.414820 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1eaf9b-1289-403f-b6c7-c5836a43e414 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:30.429203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 498/967] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:30.442524 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1eaf9b-1289-403f-b6c7-c5836a43e414 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:30.474785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:30.505114 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 470/968] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:30.571817 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1eaf9b-1289-403f-b6c7-c5836a43e414 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:30.607382 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26938941-a341-40f9-b5a7-4508d00d3fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:30.607929 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26938941-a341-40f9-b5a7-4508d00d3fdb None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:30.608205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26938941-a341-40f9-b5a7-4508d00d3fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:30.608740 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26938941-a341-40f9-b5a7-4508d00d3fdb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:30.616654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26938941-a341-40f9-b5a7-4508d00d3fdb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:30.618103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26938941-a341-40f9-b5a7-4508d00d3fdb None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:30.630101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-26938941-a341-40f9-b5a7-4508d00d3fdb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 00:32:30.630101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:30.630101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:30.630101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:30.630101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:30.630101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:30.630101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:30.630101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:30.630101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:30.630101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:30.630101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:30.630101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:30.630101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:32:30.630101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:32:30.630101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:32:30.630101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:32:30.631698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:30.631698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:30.631698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:32:30.631698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:30.631698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:32:30.631698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:30.631698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:30.631698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:30.631698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:30.631698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:30.631698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:30.631698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:30.631698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:30.631698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:30.631698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:30.631698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:30.631698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:30.631698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:30.633040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:30.633040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:30.633040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:32:30.633040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:32:30.633040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:32:30.633040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:32:30.633040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:32:30.633040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:32:30.633040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 00:32:30.633040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:30.633040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 499/969] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Sep 15 00:32:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:30.638081 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b22a4-4a2e-424f-963d-a2e6d536a301 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:30.745694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b22a4-4a2e-424f-963d-a2e6d536a301 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:30.787453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acc948-3371-40d4-bb5c-579a102b93e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:30.788059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acc948-3371-40d4-bb5c-579a102b93e9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:30.788337 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acc948-3371-40d4-bb5c-579a102b93e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:30.788611 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acc948-3371-40d4-bb5c-579a102b93e9 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:30.789458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acc948-3371-40d4-bb5c-579a102b93e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:30.789668 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acc948-3371-40d4-bb5c-579a102b93e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:30.791097 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acc948-3371-40d4-bb5c-579a102b93e9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:30.793951 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26938941-a341-40f9-b5a7-4508d00d3fdb None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:30.797321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:30.811425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 471/970] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Sep 15 00:32:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:30.817154 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acc948-3371-40d4-bb5c-579a102b93e9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:30.867528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:30.913873 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26938941-a341-40f9-b5a7-4508d00d3fdb None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:30.932059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acc948-3371-40d4-bb5c-579a102b93e9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:30.959648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af5720-a103-40e8-8de4-db63116e2345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:30.960528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af5720-a103-40e8-8de4-db63116e2345 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:30.960814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af5720-a103-40e8-8de4-db63116e2345 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:30.961110 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af5720-a103-40e8-8de4-db63116e2345 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:30.961729 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af5720-a103-40e8-8de4-db63116e2345 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:30.963211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af5720-a103-40e8-8de4-db63116e2345 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:30.970399 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0b3e0-9ee0-4e4a-a4bf-3d1d63e93702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:30.971262 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0b3e0-9ee0-4e4a-a4bf-3d1d63e93702 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:30.971760 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0b3e0-9ee0-4e4a-a4bf-3d1d63e93702 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:30.972234 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0b3e0-9ee0-4e4a-a4bf-3d1d63e93702 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:30.973683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-21af5720-a103-40e8-8de4-db63116e2345 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 00:32:30.973683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:30.973683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:32:30.973683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:32:30.973683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:32:30.973683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:32:30.973683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:32:30.973683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:30.973683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 00:32:30.973683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:30.973683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:30.973683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:30.973683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:30.973683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:30.973683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:30.973683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:30.973683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:30.975240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:30.975240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:30.975240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:30.975240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:30.975240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:30.975240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:30.975240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:32:30.975240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:32:30.975240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:32:30.975240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:32:30.975240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:30.975240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:30.975240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:30.975240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:30.975240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:30.975240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:30.976124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:30.976124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:30.976124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:30.976124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:30.976124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:30.976124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:30.976124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:30.976124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:30.976124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:30.976124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:30.976124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:32:30.976124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:30.976124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 00:32:30.976124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:30.980270 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 500/971] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Sep 15 00:32:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:30.981140 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af5720-a103-40e8-8de4-db63116e2345 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:31.052780 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0b3e0-9ee0-4e4a-a4bf-3d1d63e93702 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:31.054572 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0b3e0-9ee0-4e4a-a4bf-3d1d63e93702 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:31.059913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:31.102228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af5720-a103-40e8-8de4-db63116e2345 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:31.116778 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:31.148936 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73df07-e9e0-4dc8-80ea-4fbde399cacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:31.149560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73df07-e9e0-4dc8-80ea-4fbde399cacd None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:31.149843 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73df07-e9e0-4dc8-80ea-4fbde399cacd None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:31.150118 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73df07-e9e0-4dc8-80ea-4fbde399cacd None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:31.150752 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73df07-e9e0-4dc8-80ea-4fbde399cacd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:31.151112 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73df07-e9e0-4dc8-80ea-4fbde399cacd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:31.153575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73df07-e9e0-4dc8-80ea-4fbde399cacd None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:31.161228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 501/972] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Sep 15 00:32:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:31.164762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73df07-e9e0-4dc8-80ea-4fbde399cacd None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:31.193965 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 472/973] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:32:30 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 00:32:31.195958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0b3e0-9ee0-4e4a-a4bf-3d1d63e93702 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:31.283170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73df07-e9e0-4dc8-80ea-4fbde399cacd None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:31.316169 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:31.331007 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905474a-e913-483c-b036-048aeb81a207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:31.331674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905474a-e913-483c-b036-048aeb81a207 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:31.331953 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905474a-e913-483c-b036-048aeb81a207 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:31.332220 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905474a-e913-483c-b036-048aeb81a207 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:31.332851 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905474a-e913-483c-b036-048aeb81a207 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:31.333184 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905474a-e913-483c-b036-048aeb81a207 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:31.334647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905474a-e913-483c-b036-048aeb81a207 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:31.343825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0b3e0-9ee0-4e4a-a4bf-3d1d63e93702 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:31.349196 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 502/974] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Sep 15 00:32:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:31.350306 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905474a-e913-483c-b036-048aeb81a207 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:31.391921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115eae5-a334-4abf-8823-e30f5686df37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:31.392881 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115eae5-a334-4abf-8823-e30f5686df37 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:31.393410 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115eae5-a334-4abf-8823-e30f5686df37 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:31.393903 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115eae5-a334-4abf-8823-e30f5686df37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:31.404667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115eae5-a334-4abf-8823-e30f5686df37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:31.406400 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115eae5-a334-4abf-8823-e30f5686df37 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:31.409261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:31.423732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-0115eae5-a334-4abf-8823-e30f5686df37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:31.423732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:31.423732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:31.423732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:31.423732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:31.423732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:31.423732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:31.423732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:31.423732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:31.423732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:31.423732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:31.423732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:31.423732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:31.423732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:31.423732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:31.423732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:31.424688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:31.424688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:31.424688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:31.424688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:31.424688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:31.424688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:31.424688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:31.424688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:31.424688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:31.424688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:31.424688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:31.424688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:31.424688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:31.424688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:31.424688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:31.424688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:31.424688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:31.425966 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:31.425966 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:31.425966 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:31.432720 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 473/975] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:31.433839 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115eae5-a334-4abf-8823-e30f5686df37 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:31.458184 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905474a-e913-483c-b036-048aeb81a207 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:31.494788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e2929-06c7-480d-b9d2-e80bf4adadec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:31.495392 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e2929-06c7-480d-b9d2-e80bf4adadec None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:31.495668 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e2929-06c7-480d-b9d2-e80bf4adadec None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:31.495935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e2929-06c7-480d-b9d2-e80bf4adadec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:31.496631 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e2929-06c7-480d-b9d2-e80bf4adadec None admin] RBAC: Adding query filter params (interface=admin, service_id=dc0c7e280a5d4be380638158b722f010, region_id=RegionOne) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:31.496936 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e2929-06c7-480d-b9d2-e80bf4adadec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:31.498516 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e2929-06c7-480d-b9d2-e80bf4adadec None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:31.508552 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 503/976] 10.222.0.52 () {56 vars in 1249 bytes} [Thu Sep 15 00:32:31 2022] GET /identity/v3/endpoints?service_id=dc0c7e280a5d4be380638158b722f010&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:31.509655 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e2929-06c7-480d-b9d2-e80bf4adadec None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:31.545563 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115eae5-a334-4abf-8823-e30f5686df37 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:31.571822 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:31.582642 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1ab71-3220-42e5-b4e1-32ef0bc09e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:31.583553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1ab71-3220-42e5-b4e1-32ef0bc09e81 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:31.584053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1ab71-3220-42e5-b4e1-32ef0bc09e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:31.584519 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1ab71-3220-42e5-b4e1-32ef0bc09e81 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:31.585384 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1ab71-3220-42e5-b4e1-32ef0bc09e81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:31.585867 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1ab71-3220-42e5-b4e1-32ef0bc09e81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:31.587466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1ab71-3220-42e5-b4e1-32ef0bc09e81 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:31.605377 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 474/977] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:31.606557 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1ab71-3220-42e5-b4e1-32ef0bc09e81 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:31.622057 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e2929-06c7-480d-b9d2-e80bf4adadec None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:31.658259 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73589a6-3ed2-4482-a5f3-cfbe2c53824f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:31.658779 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73589a6-3ed2-4482-a5f3-cfbe2c53824f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:31.659093 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73589a6-3ed2-4482-a5f3-cfbe2c53824f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:31.659367 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73589a6-3ed2-4482-a5f3-cfbe2c53824f None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:31.660073 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73589a6-3ed2-4482-a5f3-cfbe2c53824f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:31.661350 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73589a6-3ed2-4482-a5f3-cfbe2c53824f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:31.677117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:31.677908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 504/978] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Sep 15 00:32:31 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 00:32:31.729038 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1ab71-3220-42e5-b4e1-32ef0bc09e81 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:31.767520 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59996b-f4a2-4716-b1d4-7f6995565ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:31.768159 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59996b-f4a2-4716-b1d4-7f6995565ecb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:31.768435 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59996b-f4a2-4716-b1d4-7f6995565ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:31.768791 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59996b-f4a2-4716-b1d4-7f6995565ecb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:31.777647 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59996b-f4a2-4716-b1d4-7f6995565ecb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:31.779341 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59996b-f4a2-4716-b1d4-7f6995565ecb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:31.793565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-6c59996b-f4a2-4716-b1d4-7f6995565ecb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:31.793565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:31.793565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:31.793565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:31.793565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:31.793565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:31.793565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:31.793565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:31.793565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:31.793565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:31.793565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:31.793565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:31.793565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:32:31.793565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:32:31.793565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:32:31.795296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:32:31.795296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:31.795296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:31.795296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:31.795296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:31.795296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:31.795296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:31.795296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:31.795296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:31.795296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:31.795296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:31.795296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:31.795296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:31.795296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:31.795296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:31.795296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:31.795296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:31.797641 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:32:31.797641 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:32:31.797641 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:32:31.797641 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:32:31.797641 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:32:31.797641 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:32:31.797641 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:31.797641 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:31.797641 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 475/979] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:32:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:31.806570 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73589a6-3ed2-4482-a5f3-cfbe2c53824f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:31.925308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73589a6-3ed2-4482-a5f3-cfbe2c53824f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:31.947394 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6669a59-f225-4ac3-b63b-c56a20287298 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:31.947892 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6669a59-f225-4ac3-b63b-c56a20287298 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:31.947996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6669a59-f225-4ac3-b63b-c56a20287298 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:31.950075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 476/980] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:31.953054 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:31.955600 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a458086-e2ed-457c-a9e8-924eab485d66 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:31.956640 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a458086-e2ed-457c-a9e8-924eab485d66 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:31.956640 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a458086-e2ed-457c-a9e8-924eab485d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:31.968214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a768b69-6fc4-4213-aa42-4e9f34878534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:31.969131 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a768b69-6fc4-4213-aa42-4e9f34878534 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:31.969611 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a768b69-6fc4-4213-aa42-4e9f34878534 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:31.970093 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a768b69-6fc4-4213-aa42-4e9f34878534 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:31.970998 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a768b69-6fc4-4213-aa42-4e9f34878534 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:31.971528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a768b69-6fc4-4213-aa42-4e9f34878534 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:31.972946 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a768b69-6fc4-4213-aa42-4e9f34878534 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:31.977197 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0a458086-e2ed-457c-a9e8-924eab485d66 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:31.978583 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0a458086-e2ed-457c-a9e8-924eab485d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:31.987920 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 505/981] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:32:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:31.994191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a768b69-6fc4-4213-aa42-4e9f34878534 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:32.066394 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 477/982] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:32.117711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a768b69-6fc4-4213-aa42-4e9f34878534 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:32.154154 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71042d9-30fc-4864-9234-371acf581285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:32.155083 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71042d9-30fc-4864-9234-371acf581285 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:32.155510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71042d9-30fc-4864-9234-371acf581285 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:32.155936 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71042d9-30fc-4864-9234-371acf581285 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:32.156799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71042d9-30fc-4864-9234-371acf581285 None admin] RBAC: Adding query filter params (role.id=775f8b8679a94a5887e259c092f17088, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=ed49a596f15542a29ce331bae4640274) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:32.157282 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71042d9-30fc-4864-9234-371acf581285 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:32.158926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71042d9-30fc-4864-9234-371acf581285 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:32.165582 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 506/983] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:32:31 2022] GET /identity/v3/role_assignments?user.id=ed49a596f15542a29ce331bae4640274&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=775f8b8679a94a5887e259c092f17088 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:32.348998 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a458086-e2ed-457c-a9e8-924eab485d66 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:32.399623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:32.456174 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a458086-e2ed-457c-a9e8-924eab485d66 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:32.492980 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f634c-6e6a-4306-b6d5-afa63ba264b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:32.493633 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f634c-6e6a-4306-b6d5-afa63ba264b7 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:32.493913 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f634c-6e6a-4306-b6d5-afa63ba264b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:32.494245 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f634c-6e6a-4306-b6d5-afa63ba264b7 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:32.494912 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f634c-6e6a-4306-b6d5-afa63ba264b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:32.496452 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f634c-6e6a-4306-b6d5-afa63ba264b7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:32.513344 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.sql.core [None req-ab2f634c-6e6a-4306-b6d5-afa63ba264b7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 15 00:32:32.513344 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 15 00:32:32.513344 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [parameters: {'user_id': '19ef1223fe924c0595104afe7ee6e24c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 15 00:32:32.513344 dv-cinder-857528-2-smb devstack@keystone.service[81615]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81615) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 00:32:32.520690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-ab2f634c-6e6a-4306-b6d5-afa63ba264b7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 15 00:32:32.520690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:32.520690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 00:32:32.520690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 00:32:32.520690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 00:32:32.520690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 00:32:32.520690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 00:32:32.520690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 00:32:32.520690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 00:32:32.520690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application conn.query(q) Sep 15 00:32:32.520690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 00:32:32.520690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 00:32:32.520690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 00:32:32.520690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result.read() Sep 15 00:32:32.520690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 00:32:32.522292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 00:32:32.522292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 00:32:32.522292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 00:32:32.522292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 00:32:32.522292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 00:32:32.522292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 00:32:32.522292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 00:32:32.522292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 15 00:32:32.522292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:32.522292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 15 00:32:32.522292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:32.522292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:32.522292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 15 00:32:32.522292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 15 00:32:32.522292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 15 00:32:32.522292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 15 00:32:32.522292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 00:32:32.522292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application next(self.gen) Sep 15 00:32:32.523261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 15 00:32:32.523261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application yield resource Sep 15 00:32:32.523261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 00:32:32.523261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application next(self.gen) Sep 15 00:32:32.523261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 15 00:32:32.523261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.session.rollback() Sep 15 00:32:32.523261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 15 00:32:32.523261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.force_reraise() Sep 15 00:32:32.523261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 15 00:32:32.523261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise self.value Sep 15 00:32:32.523261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 15 00:32:32.523261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 15 00:32:32.523261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 15 00:32:32.523261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application session.commit() Sep 15 00:32:32.523261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 15 00:32:32.523261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 15 00:32:32.523261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 15 00:32:32.524923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._prepare_impl() Sep 15 00:32:32.524923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 15 00:32:32.524923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.session.flush() Sep 15 00:32:32.524923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 15 00:32:32.524923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._flush(objects) Sep 15 00:32:32.524923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 15 00:32:32.524923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 15 00:32:32.524923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 15 00:32:32.524923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application compat.raise_( Sep 15 00:32:32.524923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 00:32:32.524923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception Sep 15 00:32:32.524923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 15 00:32:32.524923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application flush_context.execute() Sep 15 00:32:32.524923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 15 00:32:32.524923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rec.execute(self) Sep 15 00:32:32.524923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 15 00:32:32.524923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 15 00:32:32.527059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 15 00:32:32.527059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 15 00:32:32.527059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 15 00:32:32.527059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 15 00:32:32.527059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 15 00:32:32.527059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 15 00:32:32.527059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 15 00:32:32.527059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 15 00:32:32.527059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 15 00:32:32.527059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 15 00:32:32.527059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 15 00:32:32.527059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 15 00:32:32.527059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 15 00:32:32.527059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 15 00:32:32.527059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 00:32:32.527059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception Sep 15 00:32:32.529175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 00:32:32.529175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 00:32:32.529175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 00:32:32.529175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 00:32:32.529175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 00:32:32.529175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 00:32:32.529175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 00:32:32.529175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application conn.query(q) Sep 15 00:32:32.529175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 00:32:32.529175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 00:32:32.529175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 00:32:32.529175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application result.read() Sep 15 00:32:32.529175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 00:32:32.529175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 00:32:32.529175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 00:32:32.529175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 00:32:32.531473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 00:32:32.531473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 00:32:32.531473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 00:32:32.531473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 00:32:32.531473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 15 00:32:32.531473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 15 00:32:32.531473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [parameters: {'user_id': '19ef1223fe924c0595104afe7ee6e24c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 15 00:32:32.531473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 15 00:32:32.531473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:32.531473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:32.531473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:32.531473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:32.531473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:32.531473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:32.531473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:32.537904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:32.537904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:32.537904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:32.537904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:32.537904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:32.537904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:32.537904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:32.537904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 15 00:32:32.537904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 15 00:32:32.537904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:32.537904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:32.537904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:32:32.537904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:32.537904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:32:32.537904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:32.537904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 15 00:32:32.537904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 15 00:32:32.538937 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 15 00:32:32.538937 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 15 00:32:32.538937 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 15 00:32:32.538937 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 15 00:32:32.538937 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 15 00:32:32.538937 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:32.538937 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 478/984] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Sep 15 00:32:32 2022] POST /identity/v3/users => generated 160 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:32.539348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71042d9-30fc-4864-9234-371acf581285 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:32.588728 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:32.627378 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0632f12-e40b-4061-a422-e1d64b0f6c59 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:32.627554 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0632f12-e40b-4061-a422-e1d64b0f6c59 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:32.627794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0632f12-e40b-4061-a422-e1d64b0f6c59 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:32.632730 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 479/985] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:32:32.637759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40202d4e-ce91-49ce-8c88-4bea3bd8ac21 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:32.638047 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40202d4e-ce91-49ce-8c88-4bea3bd8ac21 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:32.638327 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40202d4e-ce91-49ce-8c88-4bea3bd8ac21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:32.651916 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71042d9-30fc-4864-9234-371acf581285 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:32.658636 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-40202d4e-ce91-49ce-8c88-4bea3bd8ac21 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:32.660744 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-40202d4e-ce91-49ce-8c88-4bea3bd8ac21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:32.689171 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1369a-4a7f-44e3-a7fc-eec383573b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:32.689761 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1369a-4a7f-44e3-a7fc-eec383573b36 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:32.690043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1369a-4a7f-44e3-a7fc-eec383573b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:32.690320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1369a-4a7f-44e3-a7fc-eec383573b36 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:32.699933 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1369a-4a7f-44e3-a7fc-eec383573b36 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:32.701411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1369a-4a7f-44e3-a7fc-eec383573b36 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:32.714632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-b1b1369a-4a7f-44e3-a7fc-eec383573b36 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 00:32:32.714632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:32.714632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:32.714632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:32.714632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:32.714632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:32.714632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:32.714632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:32.714632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:32.714632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:32.714632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:32.714632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:32.714632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:32:32.714632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:32:32.714632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:32:32.714632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:32:32.715618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:32.715618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:32.715618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:32:32.715618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:32.715618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:32:32.715618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:32.715618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:32.715618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:32.715618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:32.715618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:32.715618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:32.715618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:32.715618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:32.715618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:32.715618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:32.715618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:32.715618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:32.715618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:32.716553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:32.716553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:32.716553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:32:32.716553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:32:32.716553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:32:32.716553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:32:32.716553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:32:32.716553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:32:32.716553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 00:32:32.716553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:32.720529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 507/986] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:32:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:32.721391 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1369a-4a7f-44e3-a7fc-eec383573b36 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:32.752412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 480/987] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 00:32:32.832242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1369a-4a7f-44e3-a7fc-eec383573b36 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:32.840810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:32.878860 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d1e0f-9827-48d6-bd1e-aa05010bc960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:32.879378 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d1e0f-9827-48d6-bd1e-aa05010bc960 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:32.879660 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d1e0f-9827-48d6-bd1e-aa05010bc960 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:32.879932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d1e0f-9827-48d6-bd1e-aa05010bc960 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:32.880658 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d1e0f-9827-48d6-bd1e-aa05010bc960 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:32.880964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d1e0f-9827-48d6-bd1e-aa05010bc960 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:32.882419 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d1e0f-9827-48d6-bd1e-aa05010bc960 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:32.918991 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 508/988] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Sep 15 00:32:32 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:33.044512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40202d4e-ce91-49ce-8c88-4bea3bd8ac21 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:33.090355 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:33.158725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40202d4e-ce91-49ce-8c88-4bea3bd8ac21 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:33.195300 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a65d9-ee4f-40d7-b375-613d84c45f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:33.195913 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a65d9-ee4f-40d7-b375-613d84c45f4d None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:33.196194 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a65d9-ee4f-40d7-b375-613d84c45f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:33.196466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a65d9-ee4f-40d7-b375-613d84c45f4d None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:33.197135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a65d9-ee4f-40d7-b375-613d84c45f4d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:33.198637 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a65d9-ee4f-40d7-b375-613d84c45f4d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:33.216252 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 481/989] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 15 00:32:33 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:32:33.958240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46cdc4-0adc-4e52-adef-9c360ee78162 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:33.958769 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46cdc4-0adc-4e52-adef-9c360ee78162 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:33.959062 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46cdc4-0adc-4e52-adef-9c360ee78162 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:33.960348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 509/990] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:33.965556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed132d-1e86-484f-9070-f0405a3b85da None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:33.965847 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed132d-1e86-484f-9070-f0405a3b85da None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:33.966119 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed132d-1e86-484f-9070-f0405a3b85da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:33.984690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-38ed132d-1e86-484f-9070-f0405a3b85da None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:33.985873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-38ed132d-1e86-484f-9070-f0405a3b85da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:34.063605 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 482/991] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:34.328988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46cdc4-0adc-4e52-adef-9c360ee78162 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:34.437747 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46cdc4-0adc-4e52-adef-9c360ee78162 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:34.438272 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10325c3-e04f-426d-abd9-02ef7b3990a0 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:34.438560 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10325c3-e04f-426d-abd9-02ef7b3990a0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:34.438835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10325c3-e04f-426d-abd9-02ef7b3990a0 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:34.440354 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 483/992] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:32:34.445379 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab17c85-52d9-4664-9084-378df79c3968 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:34.445668 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab17c85-52d9-4664-9084-378df79c3968 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:34.445943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab17c85-52d9-4664-9084-378df79c3968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:34.464970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3ab17c85-52d9-4664-9084-378df79c3968 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:34.466173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3ab17c85-52d9-4664-9084-378df79c3968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:34.477817 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e0d03-31cb-4b9a-8521-6c94690f1696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:34.478449 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e0d03-31cb-4b9a-8521-6c94690f1696 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:34.478728 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e0d03-31cb-4b9a-8521-6c94690f1696 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:34.479000 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e0d03-31cb-4b9a-8521-6c94690f1696 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:34.479587 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e0d03-31cb-4b9a-8521-6c94690f1696 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:34.481533 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e0d03-31cb-4b9a-8521-6c94690f1696 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:34.484946 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:34.491345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-4a1e0d03-31cb-4b9a-8521-6c94690f1696 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 00:32:34.491345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:34.491345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:32:34.491345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:32:34.491345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:32:34.491345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:32:34.491345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:32:34.491345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:34.491345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 00:32:34.491345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:34.491345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:34.491345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:34.491345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:34.491345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:34.491345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:34.491345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:34.491345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:34.492364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:34.492364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:34.492364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:34.492364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:34.492364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:34.492364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:34.492364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:32:34.492364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:32:34.492364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:32:34.492364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:32:34.492364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:34.492364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:34.492364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:34.492364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:34.492364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:34.492364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:34.493429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:34.493429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:34.493429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:34.493429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:34.493429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:34.493429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:34.493429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:34.493429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:34.493429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:34.493429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:34.493429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:32:34.493429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:34.493429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 00:32:34.493429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:34.493429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 510/993] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Sep 15 00:32:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:34.498533 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e0d03-31cb-4b9a-8521-6c94690f1696 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:34.528179 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:34.543770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 484/994] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:34 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 00:32:34.606628 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e0d03-31cb-4b9a-8521-6c94690f1696 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:34.640735 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac974a7-6b55-4ef4-8312-c860b47237fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:34.641358 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac974a7-6b55-4ef4-8312-c860b47237fd None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:34.641640 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac974a7-6b55-4ef4-8312-c860b47237fd None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:34.641910 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac974a7-6b55-4ef4-8312-c860b47237fd None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:34.642527 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac974a7-6b55-4ef4-8312-c860b47237fd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:34.642825 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac974a7-6b55-4ef4-8312-c860b47237fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:34.644165 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac974a7-6b55-4ef4-8312-c860b47237fd None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:34.649683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 511/995] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Sep 15 00:32:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:34.655213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab17c85-52d9-4664-9084-378df79c3968 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:34.753146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab17c85-52d9-4664-9084-378df79c3968 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:34.787215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e4a96-2136-4060-ae09-690643fc8fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:34.787815 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e4a96-2136-4060-ae09-690643fc8fca None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:34.788092 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e4a96-2136-4060-ae09-690643fc8fca None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:34.788364 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e4a96-2136-4060-ae09-690643fc8fca None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:34.788989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e4a96-2136-4060-ae09-690643fc8fca None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:34.789316 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e4a96-2136-4060-ae09-690643fc8fca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:34.790686 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e4a96-2136-4060-ae09-690643fc8fca None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:34.795795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 485/996] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Sep 15 00:32:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:34.801320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac974a7-6b55-4ef4-8312-c860b47237fd None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:34.807763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e4a96-2136-4060-ae09-690643fc8fca None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:34.828359 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:34.915130 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:34.915326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e4a96-2136-4060-ae09-690643fc8fca None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:34.924617 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac974a7-6b55-4ef4-8312-c860b47237fd None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:34.950606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c37711-ed0c-492f-84f1-e24a56418642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:34.951231 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c37711-ed0c-492f-84f1-e24a56418642 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:34.951517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c37711-ed0c-492f-84f1-e24a56418642 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:34.951790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c37711-ed0c-492f-84f1-e24a56418642 None admin] PATH_INFO: `/v3/services/image` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:34.952371 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c37711-ed0c-492f-84f1-e24a56418642 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:34.953777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c37711-ed0c-492f-84f1-e24a56418642 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:34.960972 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef0c17-fdf2-4b25-b49b-a1c428408a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:34.961593 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef0c17-fdf2-4b25-b49b-a1c428408a16 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:34.961871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef0c17-fdf2-4b25-b49b-a1c428408a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:34.962141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef0c17-fdf2-4b25-b49b-a1c428408a16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:34.962802 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef0c17-fdf2-4b25-b49b-a1c428408a16 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:34.963840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-17c37711-ed0c-492f-84f1-e24a56418642 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 00:32:34.963840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:34.963840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:32:34.963840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:32:34.963840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:32:34.963840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:32:34.963840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:32:34.963840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:34.963840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 00:32:34.963840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:34.963840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:34.963840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:34.963840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:34.963840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:34.963840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:34.963840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:34.963840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:34.964865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:34.964865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:34.964865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:34.964865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:34.964865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:34.964865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:34.964865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:32:34.964865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:32:34.964865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:32:34.964865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:32:34.964865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:34.964865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:34.964865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:34.964865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:34.964865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:34.964865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:34.965752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:34.965752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:34.965752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:34.965752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:34.965752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:34.965752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:34.965752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:34.965752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:34.965752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:34.965752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:34.965752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:32:34.965752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:34.965752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 00:32:34.965752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:34.966554 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef0c17-fdf2-4b25-b49b-a1c428408a16 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:34.966626 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 486/997] 10.222.0.52 () {56 vars in 1105 bytes} [Thu Sep 15 00:32:34 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:34.972143 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c37711-ed0c-492f-84f1-e24a56418642 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:34.987008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 512/998] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:32:34 2022] POST /identity/v3/endpoints => generated 325 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:32:35.068458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:35.089713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c37711-ed0c-492f-84f1-e24a56418642 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:35.133602 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5e846-5afd-4aa4-9a7b-5cb108c7a3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:35.134213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5e846-5afd-4aa4-9a7b-5cb108c7a3ed None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:35.134487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5e846-5afd-4aa4-9a7b-5cb108c7a3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:35.134755 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5e846-5afd-4aa4-9a7b-5cb108c7a3ed None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:35.135406 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5e846-5afd-4aa4-9a7b-5cb108c7a3ed None admin] RBAC: Adding query filter params (name=image) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:35.135699 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5e846-5afd-4aa4-9a7b-5cb108c7a3ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:35.137114 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5e846-5afd-4aa4-9a7b-5cb108c7a3ed None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:35.147083 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 487/999] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:35.148222 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef0c17-fdf2-4b25-b49b-a1c428408a16 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:35.255088 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef0c17-fdf2-4b25-b49b-a1c428408a16 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:35.290712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f91899-75c2-49f0-b394-5a1e878cffb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:35.291347 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f91899-75c2-49f0-b394-5a1e878cffb6 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:35.291628 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f91899-75c2-49f0-b394-5a1e878cffb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:35.291901 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f91899-75c2-49f0-b394-5a1e878cffb6 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:35.292549 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f91899-75c2-49f0-b394-5a1e878cffb6 None admin] RBAC: Adding query filter params (type=image) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:35.292855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f91899-75c2-49f0-b394-5a1e878cffb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:35.294297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f91899-75c2-49f0-b394-5a1e878cffb6 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:35.299817 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 513/1000] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:35 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:35.411612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dbb6e-0770-4834-a818-3e1f9c5dfd98 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:35.411966 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dbb6e-0770-4834-a818-3e1f9c5dfd98 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:35.412166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2dbb6e-0770-4834-a818-3e1f9c5dfd98 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:35.413752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 488/1001] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:35.419128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7c721-825a-417b-9918-6d5b1a854e95 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:35.419415 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7c721-825a-417b-9918-6d5b1a854e95 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:35.419688 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7c721-825a-417b-9918-6d5b1a854e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:35.438531 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8fc7c721-825a-417b-9918-6d5b1a854e95 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:35.439755 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8fc7c721-825a-417b-9918-6d5b1a854e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:35.453206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:35.516503 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 514/1002] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:35 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:35.796575 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2dbb6e-0770-4834-a818-3e1f9c5dfd98 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:35.907964 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2dbb6e-0770-4834-a818-3e1f9c5dfd98 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:35.951191 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9ded4-9ed9-421b-a9b9-0b49db1c8c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:35.951820 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9ded4-9ed9-421b-a9b9-0b49db1c8c3f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:35.952152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9ded4-9ed9-421b-a9b9-0b49db1c8c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:35.952430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9ded4-9ed9-421b-a9b9-0b49db1c8c3f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:35.953008 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9ded4-9ed9-421b-a9b9-0b49db1c8c3f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:35.954433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9ded4-9ed9-421b-a9b9-0b49db1c8c3f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:35.964145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-b5a9ded4-9ed9-421b-a9b9-0b49db1c8c3f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 00:32:35.964145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:35.964145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:32:35.964145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:32:35.964145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:32:35.964145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:32:35.964145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:32:35.964145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:35.964145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 00:32:35.964145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:35.964145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:35.964145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:35.964145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:35.964145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:35.964145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:35.964145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:35.964145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:35.965155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:35.965155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:35.965155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:35.965155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:35.965155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:35.965155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:35.965155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:32:35.965155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:32:35.965155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:32:35.965155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:32:35.965155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:35.965155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:35.965155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:35.965155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:35.965155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:35.965155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:35.965994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:35.965994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:35.965994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:35.965994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:35.965994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:35.965994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:35.965994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:35.965994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:35.965994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:35.965994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:35.965994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:32:35.965994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:35.965994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 00:32:35.965994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:35.969423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 489/1003] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:32:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:35.971146 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7c721-825a-417b-9918-6d5b1a854e95 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:36.073920 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7c721-825a-417b-9918-6d5b1a854e95 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:36.108572 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd98957-8f35-49a3-b98e-982dea47cf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:36.109453 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd98957-8f35-49a3-b98e-982dea47cf6e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:36.109916 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd98957-8f35-49a3-b98e-982dea47cf6e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:36.110368 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd98957-8f35-49a3-b98e-982dea47cf6e None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:36.111164 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd98957-8f35-49a3-b98e-982dea47cf6e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:36.111666 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd98957-8f35-49a3-b98e-982dea47cf6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:36.113202 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd98957-8f35-49a3-b98e-982dea47cf6e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:36.122552 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 515/1004] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 15 00:32:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:36.123970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9ded4-9ed9-421b-a9b9-0b49db1c8c3f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:36.134606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:36.232749 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9ded4-9ed9-421b-a9b9-0b49db1c8c3f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:36.277494 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce908cd-eb9e-41bc-80dc-2a0032516eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:36.278359 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce908cd-eb9e-41bc-80dc-2a0032516eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:36.278799 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce908cd-eb9e-41bc-80dc-2a0032516eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:36.279218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce908cd-eb9e-41bc-80dc-2a0032516eb0 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:36.280001 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce908cd-eb9e-41bc-80dc-2a0032516eb0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:36.280451 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce908cd-eb9e-41bc-80dc-2a0032516eb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:36.281985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce908cd-eb9e-41bc-80dc-2a0032516eb0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:36.291940 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 490/1005] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 15 00:32:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:36.292883 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd98957-8f35-49a3-b98e-982dea47cf6e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:36.305347 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:36.401204 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd98957-8f35-49a3-b98e-982dea47cf6e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:36.434145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76944ab4-b1fd-4c9b-85a5-c2cb2f57f42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:36.434765 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76944ab4-b1fd-4c9b-85a5-c2cb2f57f42b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:36.435046 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76944ab4-b1fd-4c9b-85a5-c2cb2f57f42b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:36.435314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76944ab4-b1fd-4c9b-85a5-c2cb2f57f42b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:36.436002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76944ab4-b1fd-4c9b-85a5-c2cb2f57f42b None admin] RBAC: Adding query filter params (interface=public, service_id=7ca196811d71473e80b30cdb79838b62, region_id=RegionOne) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:36.436307 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76944ab4-b1fd-4c9b-85a5-c2cb2f57f42b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:36.437685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76944ab4-b1fd-4c9b-85a5-c2cb2f57f42b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:36.447569 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 516/1006] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Sep 15 00:32:36 2022] GET /identity/v3/endpoints?service_id=7ca196811d71473e80b30cdb79838b62&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:36.449001 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce908cd-eb9e-41bc-80dc-2a0032516eb0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:36.520948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:36.553515 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce908cd-eb9e-41bc-80dc-2a0032516eb0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:36.589808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab044ec-d7f4-46eb-b618-d15b29f7bef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:36.590693 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab044ec-d7f4-46eb-b618-d15b29f7bef4 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:36.590982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab044ec-d7f4-46eb-b618-d15b29f7bef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:36.591257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab044ec-d7f4-46eb-b618-d15b29f7bef4 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:36.592269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab044ec-d7f4-46eb-b618-d15b29f7bef4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:36.594154 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab044ec-d7f4-46eb-b618-d15b29f7bef4 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:36.605485 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 491/1007] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Sep 15 00:32:36 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:32:37.185346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133c0e8-602a-40c8-a898-e90ef317ce2b None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:37.185896 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133c0e8-602a-40c8-a898-e90ef317ce2b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:37.185896 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133c0e8-602a-40c8-a898-e90ef317ce2b None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:37.187246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 517/1008] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:37.192422 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c195e03-855a-495e-ba33-5fe194f52db3 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:37.193436 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c195e03-855a-495e-ba33-5fe194f52db3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:37.193530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c195e03-855a-495e-ba33-5fe194f52db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:37.212235 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9c195e03-855a-495e-ba33-5fe194f52db3 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:37.213671 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9c195e03-855a-495e-ba33-5fe194f52db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:37.280497 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 492/1009] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:37 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:37.446759 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9e22b-1224-40d4-8fad-e42957a27bad None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:37.446973 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9e22b-1224-40d4-8fad-e42957a27bad None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:37.447211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9e22b-1224-40d4-8fad-e42957a27bad None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:37.448677 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 518/1010] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:37.453637 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51de09-ff7b-43bc-be74-590006569308 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:37.453928 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51de09-ff7b-43bc-be74-590006569308 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:37.454201 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51de09-ff7b-43bc-be74-590006569308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:37.472256 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5b51de09-ff7b-43bc-be74-590006569308 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:37.473462 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5b51de09-ff7b-43bc-be74-590006569308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:37.533944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:37.543214 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 493/1011] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:37 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:37.554206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9e22b-1224-40d4-8fad-e42957a27bad None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:37.632761 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:37.659432 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9e22b-1224-40d4-8fad-e42957a27bad None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:37.694077 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8542b-c557-4e21-9aad-e7f5b8e8959c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:37.694696 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8542b-c557-4e21-9aad-e7f5b8e8959c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:37.694976 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8542b-c557-4e21-9aad-e7f5b8e8959c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:37.695245 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8542b-c557-4e21-9aad-e7f5b8e8959c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:37.696347 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8542b-c557-4e21-9aad-e7f5b8e8959c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:37.697842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8542b-c557-4e21-9aad-e7f5b8e8959c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:37.699524 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 519/1012] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:37.705167 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51de09-ff7b-43bc-be74-590006569308 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:37.807919 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8542b-c557-4e21-9aad-e7f5b8e8959c None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:37.813111 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51de09-ff7b-43bc-be74-590006569308 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:37.851662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a66446-627c-412b-b622-d9e30b576c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:37.852269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a66446-627c-412b-b622-d9e30b576c16 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:37.852548 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a66446-627c-412b-b622-d9e30b576c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:37.852819 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a66446-627c-412b-b622-d9e30b576c16 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:37.853499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a66446-627c-412b-b622-d9e30b576c16 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:37.854927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a66446-627c-412b-b622-d9e30b576c16 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:37.883854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 494/1013] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 15 00:32:37 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:32:37.921243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8542b-c557-4e21-9aad-e7f5b8e8959c None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:37.961054 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883283b-d417-479f-8df2-60a6bb80c5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:37.961627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883283b-d417-479f-8df2-60a6bb80c5eb None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:37.962032 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883283b-d417-479f-8df2-60a6bb80c5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:37.962317 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883283b-d417-479f-8df2-60a6bb80c5eb None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:37.963034 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883283b-d417-479f-8df2-60a6bb80c5eb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:37.964430 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883283b-d417-479f-8df2-60a6bb80c5eb None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:37.985149 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 520/1014] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 15 00:32:37 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:32:38.776578 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc95ca0-7aa6-43a8-8bed-6a727104a7cc None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:38.777114 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc95ca0-7aa6-43a8-8bed-6a727104a7cc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:38.777114 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc95ca0-7aa6-43a8-8bed-6a727104a7cc None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:38.778535 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 495/1015] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:38.783494 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df44f8f-55c4-4419-a34d-cbb50ac55f23 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:38.783879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df44f8f-55c4-4419-a34d-cbb50ac55f23 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:38.784056 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df44f8f-55c4-4419-a34d-cbb50ac55f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:38.792184 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:38.805930 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-3df44f8f-55c4-4419-a34d-cbb50ac55f23 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:38.807679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3df44f8f-55c4-4419-a34d-cbb50ac55f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:38.884550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 521/1016] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:38 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:39.151531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc95ca0-7aa6-43a8-8bed-6a727104a7cc None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:39.201535 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:39.260054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc95ca0-7aa6-43a8-8bed-6a727104a7cc None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:39.295310 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909371a3-a406-454c-a102-76459bea436e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:39.295939 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909371a3-a406-454c-a102-76459bea436e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:39.296216 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909371a3-a406-454c-a102-76459bea436e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:39.296488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909371a3-a406-454c-a102-76459bea436e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:39.297073 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909371a3-a406-454c-a102-76459bea436e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:39.298462 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909371a3-a406-454c-a102-76459bea436e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:39.307170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-909371a3-a406-454c-a102-76459bea436e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 00:32:39.307170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:39.307170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:32:39.307170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:32:39.307170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:32:39.307170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:32:39.307170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:32:39.307170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:39.307170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 00:32:39.307170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:39.307170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:39.307170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:39.307170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:39.307170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:39.307170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:39.307170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:39.307170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:39.308161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:39.308161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:39.308161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:39.308161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:39.308161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:39.308161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:39.308161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:32:39.308161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:32:39.308161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:32:39.308161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:32:39.308161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:39.308161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:39.308161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:39.308161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:39.308161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:39.308161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:39.309027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:39.309027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:39.309027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:39.309027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:39.309027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:39.309027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:39.309027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:39.309027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:39.309027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:39.309027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:39.309027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:32:39.309027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:39.309027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 00:32:39.309027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:39.313257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 496/1017] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:32:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:39.314089 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df44f8f-55c4-4419-a34d-cbb50ac55f23 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:39.418884 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df44f8f-55c4-4419-a34d-cbb50ac55f23 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:39.444597 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:39.453399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d9b86-43e3-48e6-8976-e57309f1d7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:39.454006 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d9b86-43e3-48e6-8976-e57309f1d7eb None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:39.454284 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d9b86-43e3-48e6-8976-e57309f1d7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:39.454554 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d9b86-43e3-48e6-8976-e57309f1d7eb None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:39.455174 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d9b86-43e3-48e6-8976-e57309f1d7eb None admin] RBAC: Adding query filter params (name=compute) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:39.455472 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d9b86-43e3-48e6-8976-e57309f1d7eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:39.456811 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d9b86-43e3-48e6-8976-e57309f1d7eb None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:39.466813 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 522/1018] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 15 00:32:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:39.467879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909371a3-a406-454c-a102-76459bea436e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:39.567406 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909371a3-a406-454c-a102-76459bea436e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:39.578373 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:39.602616 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26847504-07e6-4647-9058-994611276c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:39.603439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26847504-07e6-4647-9058-994611276c65 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:39.603870 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26847504-07e6-4647-9058-994611276c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:39.604323 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26847504-07e6-4647-9058-994611276c65 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:39.605145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26847504-07e6-4647-9058-994611276c65 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:39.605610 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26847504-07e6-4647-9058-994611276c65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:39.607121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26847504-07e6-4647-9058-994611276c65 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:39.612426 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 497/1019] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Sep 15 00:32:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:39.618957 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d9b86-43e3-48e6-8976-e57309f1d7eb None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:39.720461 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d9b86-43e3-48e6-8976-e57309f1d7eb None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:39.754606 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fc44a-d938-4c40-8ddc-27bbbc2fdc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:39.755779 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fc44a-d938-4c40-8ddc-27bbbc2fdc77 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:39.756057 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fc44a-d938-4c40-8ddc-27bbbc2fdc77 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:39.756326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fc44a-d938-4c40-8ddc-27bbbc2fdc77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:39.757002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fc44a-d938-4c40-8ddc-27bbbc2fdc77 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:39.758386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fc44a-d938-4c40-8ddc-27bbbc2fdc77 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:39.779196 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 523/1020] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:32:39 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:32:40.135876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4501aa-e715-425c-aca0-c29e720fde15 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:40.136397 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4501aa-e715-425c-aca0-c29e720fde15 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:40.136397 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4501aa-e715-425c-aca0-c29e720fde15 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:40.137930 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 498/1021] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:40.143124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebdba6b-b912-449b-a350-f1fc143ffe7d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:40.143536 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebdba6b-b912-449b-a350-f1fc143ffe7d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:40.143699 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebdba6b-b912-449b-a350-f1fc143ffe7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:40.163578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-7ebdba6b-b912-449b-a350-f1fc143ffe7d None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:40.164764 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7ebdba6b-b912-449b-a350-f1fc143ffe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:40.172181 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c4a94-9977-4b05-bbc0-0e84bedf233d None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:40.172462 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c4a94-9977-4b05-bbc0-0e84bedf233d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:40.172731 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c4a94-9977-4b05-bbc0-0e84bedf233d None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:40.174213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 499/1022] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:32:40.179731 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb747ade-a89f-4867-a999-7cb00207022a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:40.180080 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb747ade-a89f-4867-a999-7cb00207022a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:40.180293 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb747ade-a89f-4867-a999-7cb00207022a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:40.198037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-bb747ade-a89f-4867-a999-7cb00207022a None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:40.199212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bb747ade-a89f-4867-a999-7cb00207022a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:40.212393 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:40.247050 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 524/1023] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:40.278670 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 500/1024] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:40.517050 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebdba6b-b912-449b-a350-f1fc143ffe7d None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:40.543949 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb747ade-a89f-4867-a999-7cb00207022a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:40.622227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebdba6b-b912-449b-a350-f1fc143ffe7d None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:40.651932 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb747ade-a89f-4867-a999-7cb00207022a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:40.654527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:40.659696 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823ae9c-5457-43f1-87bd-d56624caa945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:40.660330 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823ae9c-5457-43f1-87bd-d56624caa945 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:40.660608 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823ae9c-5457-43f1-87bd-d56624caa945 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:40.660873 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823ae9c-5457-43f1-87bd-d56624caa945 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:40.662081 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823ae9c-5457-43f1-87bd-d56624caa945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:40.663486 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823ae9c-5457-43f1-87bd-d56624caa945 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:40.669395 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 525/1025] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:40.671411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823ae9c-5457-43f1-87bd-d56624caa945 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:40.696240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ccc2d-d4b2-4e91-aebf-3d44d901c2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:40.696863 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ccc2d-d4b2-4e91-aebf-3d44d901c2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:40.697169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ccc2d-d4b2-4e91-aebf-3d44d901c2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:40.697443 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ccc2d-d4b2-4e91-aebf-3d44d901c2d2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:40.698030 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ccc2d-d4b2-4e91-aebf-3d44d901c2d2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:40.699394 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ccc2d-d4b2-4e91-aebf-3d44d901c2d2 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:40.708634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-fc3ccc2d-d4b2-4e91-aebf-3d44d901c2d2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 00:32:40.708634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:40.708634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:32:40.708634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:32:40.708634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:32:40.708634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:32:40.708634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:32:40.708634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:40.708634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 00:32:40.708634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:40.708634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:40.708634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:40.708634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:40.708634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:40.708634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:40.708634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:40.708634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:40.709871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:40.709871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:40.709871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:40.709871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:40.709871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:40.709871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:40.709871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:32:40.709871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:32:40.709871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:32:40.709871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:32:40.709871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:40.709871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:40.709871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:40.709871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:40.709871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:40.709871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:40.710872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:40.710872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:40.710872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:40.710872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:40.710872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:40.710872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:40.710872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:40.710872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:40.710872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:40.710872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:40.710872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:32:40.710872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:40.710872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 00:32:40.710872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:40.710872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 501/1026] 10.222.0.52 () {56 vars in 1105 bytes} [Thu Sep 15 00:32:40 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:40.715614 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ccc2d-d4b2-4e91-aebf-3d44d901c2d2 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:40.721381 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:40.784354 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823ae9c-5457-43f1-87bd-d56624caa945 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:40.821074 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ccc2d-d4b2-4e91-aebf-3d44d901c2d2 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:40.821772 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb89990-df8e-4b87-8c7e-baee04463475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:40.822647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb89990-df8e-4b87-8c7e-baee04463475 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:40.823122 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb89990-df8e-4b87-8c7e-baee04463475 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:40.823627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb89990-df8e-4b87-8c7e-baee04463475 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:40.824346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb89990-df8e-4b87-8c7e-baee04463475 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:40.825806 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb89990-df8e-4b87-8c7e-baee04463475 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:40.852772 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 526/1027] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 15 00:32:40 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:32:40.858954 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63314d2-e8a3-4851-869a-42fda3769a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:40.859576 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63314d2-e8a3-4851-869a-42fda3769a53 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:40.859849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63314d2-e8a3-4851-869a-42fda3769a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:40.860186 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63314d2-e8a3-4851-869a-42fda3769a53 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:40.860830 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63314d2-e8a3-4851-869a-42fda3769a53 None admin] RBAC: Adding query filter params (name=image) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:40.861165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63314d2-e8a3-4851-869a-42fda3769a53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:40.862731 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63314d2-e8a3-4851-869a-42fda3769a53 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:40.868705 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 502/1028] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:40.874738 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb89990-df8e-4b87-8c7e-baee04463475 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:40.990433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:40.995617 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb89990-df8e-4b87-8c7e-baee04463475 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:41.033129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6458965-30f2-44bd-b472-bc8b053c759f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:41.033486 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6458965-30f2-44bd-b472-bc8b053c759f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:41.033775 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6458965-30f2-44bd-b472-bc8b053c759f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:41.034028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6458965-30f2-44bd-b472-bc8b053c759f None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:41.036026 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6458965-30f2-44bd-b472-bc8b053c759f None admin] RBAC: Adding query filter params (type=image) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:41.036026 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6458965-30f2-44bd-b472-bc8b053c759f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:41.037346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6458965-30f2-44bd-b472-bc8b053c759f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:41.042860 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 527/1029] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:41.048978 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63314d2-e8a3-4851-869a-42fda3769a53 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:41.084104 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:41.156952 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63314d2-e8a3-4851-869a-42fda3769a53 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:41.190330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02adcf7-968c-4017-bf6d-caa63043fe5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:41.190934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02adcf7-968c-4017-bf6d-caa63043fe5c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:41.191216 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02adcf7-968c-4017-bf6d-caa63043fe5c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:41.191487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02adcf7-968c-4017-bf6d-caa63043fe5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:41.192185 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02adcf7-968c-4017-bf6d-caa63043fe5c None admin] RBAC: Adding query filter params (interface=public, service_id=85cb47408ca249ce84ebca11e5615b39, region_id=RegionOne) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:41.192525 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02adcf7-968c-4017-bf6d-caa63043fe5c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:41.193920 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02adcf7-968c-4017-bf6d-caa63043fe5c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:41.199047 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 503/1030] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Sep 15 00:32:41 2022] GET /identity/v3/endpoints?service_id=85cb47408ca249ce84ebca11e5615b39&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:41.204828 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6458965-30f2-44bd-b472-bc8b053c759f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:41.316185 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6458965-30f2-44bd-b472-bc8b053c759f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:41.354532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f180101-afeb-405a-9543-c21a3378dd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:41.355145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f180101-afeb-405a-9543-c21a3378dd52 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:41.355429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f180101-afeb-405a-9543-c21a3378dd52 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:41.355705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f180101-afeb-405a-9543-c21a3378dd52 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:41.356308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f180101-afeb-405a-9543-c21a3378dd52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:41.357699 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f180101-afeb-405a-9543-c21a3378dd52 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:41.364738 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 528/1031] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Sep 15 00:32:41 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 00:32:42.056368 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819b234-93a6-435c-8c1d-d209af6aeb04 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:42.056713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819b234-93a6-435c-8c1d-d209af6aeb04 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:42.056922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819b234-93a6-435c-8c1d-d209af6aeb04 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:42.058445 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 504/1032] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:42.063563 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26845c2d-ba41-4d6f-8087-1215fff22c48 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:42.063859 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26845c2d-ba41-4d6f-8087-1215fff22c48 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:42.064134 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26845c2d-ba41-4d6f-8087-1215fff22c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:42.082661 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-26845c2d-ba41-4d6f-8087-1215fff22c48 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:42.083869 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-26845c2d-ba41-4d6f-8087-1215fff22c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:42.105925 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:42.154964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 529/1033] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:42.427616 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819b234-93a6-435c-8c1d-d209af6aeb04 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:42.521210 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:42.528601 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819b234-93a6-435c-8c1d-d209af6aeb04 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:42.563675 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3fc82-dcc7-46e4-9541-2874c200f93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:42.564655 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3fc82-dcc7-46e4-9541-2874c200f93f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:42.565204 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3fc82-dcc7-46e4-9541-2874c200f93f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:42.565670 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3fc82-dcc7-46e4-9541-2874c200f93f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:42.576783 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3fc82-dcc7-46e4-9541-2874c200f93f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:32:42.581859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-caf3fc82-dcc7-46e4-9541-2874c200f93f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 00:32:42.581859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:42.581859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:42.581859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:42.581859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:42.581859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:42.581859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:42.581859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:42.581859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:42.581859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:42.581859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:42.581859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:42.581859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:32:42.581859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:32:42.581859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:32:42.581859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:32:42.582795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:32:42.582795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:32:42.582795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:32:42.582795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:32:42.582795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:42.582795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:42.582795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:42.582795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:42.582795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:42.582795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:42.582795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:42.582795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:42.582795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:42.582795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:42.582795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:42.582795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:42.584332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:42.584332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:42.584332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:42.584332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:42.584332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:32:42.584332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:32:42.584332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:32:42.584332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:32:42.584332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:32:42.584332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:32:42.584332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 00:32:42.584332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:42.586356 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 505/1034] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Sep 15 00:32:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:42.592519 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26845c2d-ba41-4d6f-8087-1215fff22c48 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:42.693374 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26845c2d-ba41-4d6f-8087-1215fff22c48 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:42.726701 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca11512-02df-4a67-945c-635678adc9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:42.727585 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca11512-02df-4a67-945c-635678adc9a6 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:42.728037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca11512-02df-4a67-945c-635678adc9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:42.728479 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca11512-02df-4a67-945c-635678adc9a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:42.729358 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca11512-02df-4a67-945c-635678adc9a6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:42.729855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca11512-02df-4a67-945c-635678adc9a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:42.731381 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca11512-02df-4a67-945c-635678adc9a6 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:42.740805 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 530/1035] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Sep 15 00:32:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:42.746278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3fc82-dcc7-46e4-9541-2874c200f93f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:42.848409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3fc82-dcc7-46e4-9541-2874c200f93f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:42.883499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0740f-2647-4f2e-a498-e8c818650fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:42.884124 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0740f-2647-4f2e-a498-e8c818650fad None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:42.884402 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0740f-2647-4f2e-a498-e8c818650fad None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:42.884675 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0740f-2647-4f2e-a498-e8c818650fad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:42.894683 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0740f-2647-4f2e-a498-e8c818650fad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:42.896152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0740f-2647-4f2e-a498-e8c818650fad None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:42.910682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-73b0740f-2647-4f2e-a498-e8c818650fad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:42.910682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:42.910682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:42.910682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:42.910682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:42.910682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:42.910682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:42.910682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:42.910682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:42.910682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:42.910682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:42.910682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:42.910682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:42.910682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:42.910682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:42.910682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:42.912193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:42.912193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:42.912193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:42.912193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:42.912193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:42.912193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:42.912193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:42.912193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:42.912193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:42.912193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:42.912193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:42.912193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:42.912193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:42.912193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:42.912193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:42.912193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:42.912193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:42.913549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:42.913549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:42.913549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:42.913958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 506/1036] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:42.918096 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca11512-02df-4a67-945c-635678adc9a6 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:42.939100 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:43.027553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca11512-02df-4a67-945c-635678adc9a6 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:43.063128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6ca1b-5203-4e91-aeda-9bbb0a557589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:43.063735 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6ca1b-5203-4e91-aeda-9bbb0a557589 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:43.064072 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6ca1b-5203-4e91-aeda-9bbb0a557589 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:43.064349 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6ca1b-5203-4e91-aeda-9bbb0a557589 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:43.064990 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6ca1b-5203-4e91-aeda-9bbb0a557589 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:43.065379 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6ca1b-5203-4e91-aeda-9bbb0a557589 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:43.066732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6ca1b-5203-4e91-aeda-9bbb0a557589 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:43.083156 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 531/1037] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:43.084471 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0740f-2647-4f2e-a498-e8c818650fad None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:43.093341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7641d0e-e8fc-4f79-99a8-f488fe3e04c1 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:43.093624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7641d0e-e8fc-4f79-99a8-f488fe3e04c1 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:43.093906 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7641d0e-e8fc-4f79-99a8-f488fe3e04c1 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:43.095250 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 532/1038] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:32:43.095942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:43.101245 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e75d1-6c13-4811-94b0-2b0ff02c5c40 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:43.101833 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e75d1-6c13-4811-94b0-2b0ff02c5c40 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:43.102385 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e75d1-6c13-4811-94b0-2b0ff02c5c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:43.122899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-219e75d1-6c13-4811-94b0-2b0ff02c5c40 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:43.124080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-219e75d1-6c13-4811-94b0-2b0ff02c5c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:43.194504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0740f-2647-4f2e-a498-e8c818650fad None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:43.197267 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 533/1039] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 00:32:43.234271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0debb8-6496-4991-bf75-ff9b3db4454e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:43.234945 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0debb8-6496-4991-bf75-ff9b3db4454e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:43.235223 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0debb8-6496-4991-bf75-ff9b3db4454e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:43.235493 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0debb8-6496-4991-bf75-ff9b3db4454e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:43.243379 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0debb8-6496-4991-bf75-ff9b3db4454e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:43.244856 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0debb8-6496-4991-bf75-ff9b3db4454e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:43.256301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-0f0debb8-6496-4991-bf75-ff9b3db4454e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 00:32:43.256301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:43.256301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:43.256301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:43.256301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:43.256301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:43.256301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:43.256301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:43.256301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:43.256301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:43.256301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:43.256301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:43.256301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:32:43.256301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:32:43.256301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:32:43.256301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:32:43.257391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:43.257391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:43.257391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:32:43.257391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:43.257391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:32:43.257391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:43.257391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:43.257391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:43.257391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:43.257391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:43.257391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:43.257391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:43.257391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:43.257391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:43.257391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:43.257391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:43.257391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:43.257391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:43.263581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:43.263581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:43.263581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:32:43.263581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:32:43.263581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:32:43.263581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:32:43.263581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:32:43.263581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:32:43.263581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 00:32:43.263581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:43.263581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 507/1040] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Sep 15 00:32:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:43.265554 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e75d1-6c13-4811-94b0-2b0ff02c5c40 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:43.276738 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:43.382571 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e75d1-6c13-4811-94b0-2b0ff02c5c40 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:43.418319 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9382dd4-eba5-469c-a997-c5e7660a9493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:43.418950 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9382dd4-eba5-469c-a997-c5e7660a9493 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:43.419229 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9382dd4-eba5-469c-a997-c5e7660a9493 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:43.419501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9382dd4-eba5-469c-a997-c5e7660a9493 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:43.420251 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9382dd4-eba5-469c-a997-c5e7660a9493 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:43.420559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9382dd4-eba5-469c-a997-c5e7660a9493 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:43.422058 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9382dd4-eba5-469c-a997-c5e7660a9493 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:43.446523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 534/1041] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Sep 15 00:32:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:43.448027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0debb8-6496-4991-bf75-ff9b3db4454e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:43.470828 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9382dd4-eba5-469c-a997-c5e7660a9493 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:43.520238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:43.542720 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:43.555377 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0debb8-6496-4991-bf75-ff9b3db4454e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:43.578502 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9382dd4-eba5-469c-a997-c5e7660a9493 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:43.591311 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90065a-499f-4b12-88ac-a0516986cd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:43.591916 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90065a-499f-4b12-88ac-a0516986cd04 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:43.592198 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90065a-499f-4b12-88ac-a0516986cd04 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:43.592473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90065a-499f-4b12-88ac-a0516986cd04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:43.614764 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa255c9-157c-4d43-a15a-08aad9b3d3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:43.615381 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa255c9-157c-4d43-a15a-08aad9b3d3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:43.615654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa255c9-157c-4d43-a15a-08aad9b3d3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:43.615917 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa255c9-157c-4d43-a15a-08aad9b3d3b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:43.625778 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa255c9-157c-4d43-a15a-08aad9b3d3b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:32:43.631094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-8aa255c9-157c-4d43-a15a-08aad9b3d3b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:32:43.631094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:43.631094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:43.631094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:43.631094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:43.631094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:43.631094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:43.631094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:43.631094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:43.631094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:43.631094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:43.631094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:43.631094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:32:43.631094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:32:43.631094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:32:43.631094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:32:43.632027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:32:43.632027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:32:43.632027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:32:43.632027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:32:43.632027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:43.632027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:43.632027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:43.632027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:43.632027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:43.632027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:43.632027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:43.632027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:43.632027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:43.632027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:43.632027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:43.632027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:43.633147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:43.633147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:43.633147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:43.633147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:43.633147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:32:43.633147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:32:43.633147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:32:43.633147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:32:43.633147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:32:43.633147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:32:43.633147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:32:43.633147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:43.633147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 535/1042] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:32:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:43.634341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822010d-1a30-4fa9-8f77-dc6b9a9be317 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:43.634341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822010d-1a30-4fa9-8f77-dc6b9a9be317 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:43.634341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822010d-1a30-4fa9-8f77-dc6b9a9be317 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:43.635697 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 536/1043] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:43.637965 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822010d-1a30-4fa9-8f77-dc6b9a9be317 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:43.663369 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90065a-499f-4b12-88ac-a0516986cd04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:43.664836 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90065a-499f-4b12-88ac-a0516986cd04 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:43.727412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:43.739281 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822010d-1a30-4fa9-8f77-dc6b9a9be317 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:43.764326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 508/1044] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:32:43 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 00:32:43.765397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:43.765711 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ee8a5-1b84-436f-aaba-db00ca215485 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:43.766002 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ee8a5-1b84-436f-aaba-db00ca215485 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:43.766277 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ee8a5-1b84-436f-aaba-db00ca215485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:43.778553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbc695-2faa-4d11-94dd-75efb45a71ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:43.779153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbc695-2faa-4d11-94dd-75efb45a71ec None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:43.779440 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbc695-2faa-4d11-94dd-75efb45a71ec None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:43.779713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbc695-2faa-4d11-94dd-75efb45a71ec None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:43.780376 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbc695-2faa-4d11-94dd-75efb45a71ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:43.780679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbc695-2faa-4d11-94dd-75efb45a71ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:43.782072 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbbc695-2faa-4d11-94dd-75efb45a71ec None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:43.783859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-668ee8a5-1b84-436f-aaba-db00ca215485 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:43.785066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-668ee8a5-1b84-436f-aaba-db00ca215485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:43.790238 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 537/1045] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:32:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:43.791018 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbc695-2faa-4d11-94dd-75efb45a71ec None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:43.854157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 509/1046] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:43.854986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ee8a5-1b84-436f-aaba-db00ca215485 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:43.893552 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbc695-2faa-4d11-94dd-75efb45a71ec None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:43.928750 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0057b3-6d37-4721-8e88-fb08fa9473b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:43.929548 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0057b3-6d37-4721-8e88-fb08fa9473b4 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:43.929950 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0057b3-6d37-4721-8e88-fb08fa9473b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:43.930221 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0057b3-6d37-4721-8e88-fb08fa9473b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:43.941484 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0057b3-6d37-4721-8e88-fb08fa9473b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:43.943514 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0057b3-6d37-4721-8e88-fb08fa9473b4 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:43.958834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-2d0057b3-6d37-4721-8e88-fb08fa9473b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:43.958834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:43.958834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:43.958834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:43.958834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:43.958834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:43.958834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:43.958834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:43.958834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:43.958834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:43.958834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:43.958834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:43.958834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:43.958834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:43.958834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:43.958834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:43.959786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:43.959786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:43.959786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:43.959786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:43.959786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:43.959786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:43.959786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:43.959786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:43.959786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:43.959786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:43.959786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:43.959786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:43.959786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:43.959786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:43.959786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:43.959786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:43.959786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:43.960819 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:43.960819 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:43.960819 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:43.964715 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 538/1047] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:43.965688 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0057b3-6d37-4721-8e88-fb08fa9473b4 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:43.970157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:43.974157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ee8a5-1b84-436f-aaba-db00ca215485 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:44.013661 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:44.017405 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5364e4-7677-4ad6-9bac-237ab9da3975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:44.018058 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5364e4-7677-4ad6-9bac-237ab9da3975 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:44.018351 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5364e4-7677-4ad6-9bac-237ab9da3975 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:44.018920 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5364e4-7677-4ad6-9bac-237ab9da3975 None admin] PATH_INFO: `/v3/users/96defc54d26c47aaad0b6d87ce6105b2` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:44.032306 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5364e4-7677-4ad6-9bac-237ab9da3975 None admin] RBAC: Authorizing `identity:get_user(user_id=96defc54d26c47aaad0b6d87ce6105b2)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:44.033769 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5364e4-7677-4ad6-9bac-237ab9da3975 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:44.035678 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 510/1048] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:32:43 2022] GET /identity/v3/users/96defc54d26c47aaad0b6d87ce6105b2 => generated 285 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:44.041199 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5364e4-7677-4ad6-9bac-237ab9da3975 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:44.081420 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0057b3-6d37-4721-8e88-fb08fa9473b4 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:44.116418 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c84e8e-9814-45c2-9545-911db7cb942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:44.117011 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c84e8e-9814-45c2-9545-911db7cb942c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:44.117311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c84e8e-9814-45c2-9545-911db7cb942c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:44.117580 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c84e8e-9814-45c2-9545-911db7cb942c None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:44.118211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c84e8e-9814-45c2-9545-911db7cb942c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:44.118512 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c84e8e-9814-45c2-9545-911db7cb942c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:44.119845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c84e8e-9814-45c2-9545-911db7cb942c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:44.133440 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 539/1049] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:44.134233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c84e8e-9814-45c2-9545-911db7cb942c None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:44.147215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5364e4-7677-4ad6-9bac-237ab9da3975 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:44.180461 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884128a6-6fdb-4bfc-ba78-fb46a9dd1fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:44.181062 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884128a6-6fdb-4bfc-ba78-fb46a9dd1fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:44.181376 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884128a6-6fdb-4bfc-ba78-fb46a9dd1fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:44.181652 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884128a6-6fdb-4bfc-ba78-fb46a9dd1fe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:44.205940 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:44.228255 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:44.231303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c84e8e-9814-45c2-9545-911db7cb942c None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:44.249311 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884128a6-6fdb-4bfc-ba78-fb46a9dd1fe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:44.250835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884128a6-6fdb-4bfc-ba78-fb46a9dd1fe9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:44.266916 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849048fe-1c67-4899-ac12-56795bd267f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:44.267544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849048fe-1c67-4899-ac12-56795bd267f1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:44.267826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849048fe-1c67-4899-ac12-56795bd267f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:44.268101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849048fe-1c67-4899-ac12-56795bd267f1 None admin] PATH_INFO: `/v3/services/image` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:44.268684 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849048fe-1c67-4899-ac12-56795bd267f1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:44.270043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849048fe-1c67-4899-ac12-56795bd267f1 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:44.278744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-849048fe-1c67-4899-ac12-56795bd267f1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 00:32:44.278744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:44.278744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:32:44.278744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:32:44.278744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:32:44.278744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:32:44.278744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:32:44.278744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:44.278744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 00:32:44.278744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:44.278744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:32:44.278744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:44.278744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:44.278744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:44.278744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:44.278744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:44.278744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:44.279935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:44.279935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:44.279935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:44.279935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:44.279935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:44.279935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:44.279935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:32:44.279935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:32:44.279935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:32:44.279935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:32:44.279935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:44.279935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:44.279935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:44.279935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:44.279935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:44.279935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:44.280812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:44.280812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:44.280812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:44.280812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:44.280812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:44.280812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:44.280812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:44.280812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:44.280812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:44.280812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:44.280812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:32:44.280812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:32:44.280812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 00:32:44.280812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:44.280812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 540/1050] 10.222.0.52 () {56 vars in 1105 bytes} [Thu Sep 15 00:32:44 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:44.282271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849048fe-1c67-4899-ac12-56795bd267f1 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:44.354314 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 511/1051] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:32:44 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 00:32:44.355159 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884128a6-6fdb-4bfc-ba78-fb46a9dd1fe9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:44.384788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849048fe-1c67-4899-ac12-56795bd267f1 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:44.409711 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:44.418250 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c035bc-ddb2-4109-b802-da5d6a1e6813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:44.418877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c035bc-ddb2-4109-b802-da5d6a1e6813 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:44.419160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c035bc-ddb2-4109-b802-da5d6a1e6813 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:44.419431 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c035bc-ddb2-4109-b802-da5d6a1e6813 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:44.426245 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c035bc-ddb2-4109-b802-da5d6a1e6813 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:44.427672 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c035bc-ddb2-4109-b802-da5d6a1e6813 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:44.439027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-41c035bc-ddb2-4109-b802-da5d6a1e6813 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:44.439027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:44.439027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:44.439027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:44.439027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:44.439027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:44.439027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:44.439027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:44.439027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:44.439027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:44.439027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:44.439027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:44.439027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:32:44.439027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:32:44.439027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:32:44.439921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:32:44.439921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:44.439921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:44.439921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:44.439921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:44.439921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:44.439921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:44.439921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:44.439921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:44.439921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:44.439921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:44.439921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:44.439921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:44.439921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:44.439921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:44.439921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:44.439921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:44.440841 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:32:44.440841 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:32:44.440841 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:32:44.440841 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:32:44.440841 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:32:44.440841 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:32:44.440841 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:44.440841 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:44.445402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 541/1052] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:32:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:44.446215 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c035bc-ddb2-4109-b802-da5d6a1e6813 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:44.453737 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884128a6-6fdb-4bfc-ba78-fb46a9dd1fe9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:44.470881 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:44.488466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0805f61-5bae-47d1-bfc9-98bda8d70627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:44.489063 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0805f61-5bae-47d1-bfc9-98bda8d70627 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:44.489368 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0805f61-5bae-47d1-bfc9-98bda8d70627 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:44.489640 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0805f61-5bae-47d1-bfc9-98bda8d70627 None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:44.490263 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0805f61-5bae-47d1-bfc9-98bda8d70627 None admin] RBAC: Adding query filter params (name=image) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:44.490564 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0805f61-5bae-47d1-bfc9-98bda8d70627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:44.491925 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0805f61-5bae-47d1-bfc9-98bda8d70627 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:44.496543 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 512/1053] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:44.497335 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0805f61-5bae-47d1-bfc9-98bda8d70627 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:44.549790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c035bc-ddb2-4109-b802-da5d6a1e6813 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:44.582524 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925aa3b6-de33-4c62-844d-7b6094307bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:44.583715 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925aa3b6-de33-4c62-844d-7b6094307bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:44.583994 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925aa3b6-de33-4c62-844d-7b6094307bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:44.584266 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925aa3b6-de33-4c62-844d-7b6094307bc9 None admin] PATH_INFO: `/v3/projects/800fd3f014a34a398360e81d05e79023` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:44.585407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925aa3b6-de33-4c62-844d-7b6094307bc9 None admin] RBAC: Authorizing `identity:get_project(project_id=800fd3f014a34a398360e81d05e79023)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:44.586888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925aa3b6-de33-4c62-844d-7b6094307bc9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:44.588493 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 542/1054] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:32:44 2022] GET /identity/v3/projects/800fd3f014a34a398360e81d05e79023 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:44.589938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925aa3b6-de33-4c62-844d-7b6094307bc9 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:44.595670 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0805f61-5bae-47d1-bfc9-98bda8d70627 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:44.616444 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:44.633594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa93bc-aaea-4dbd-95b8-f6c30b70624a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:44.634186 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa93bc-aaea-4dbd-95b8-f6c30b70624a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:44.634459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa93bc-aaea-4dbd-95b8-f6c30b70624a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:44.634726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa93bc-aaea-4dbd-95b8-f6c30b70624a None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:44.635403 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa93bc-aaea-4dbd-95b8-f6c30b70624a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:44.635711 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa93bc-aaea-4dbd-95b8-f6c30b70624a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:44.637178 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa93bc-aaea-4dbd-95b8-f6c30b70624a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:44.649062 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 513/1055] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:32:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:44.649865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa93bc-aaea-4dbd-95b8-f6c30b70624a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:44.680693 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:44.689895 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925aa3b6-de33-4c62-844d-7b6094307bc9 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:44.723474 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9d59e-30fd-4060-a37d-82a5b8fe853d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:44.724072 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9d59e-30fd-4060-a37d-82a5b8fe853d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:44.724350 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9d59e-30fd-4060-a37d-82a5b8fe853d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:44.724621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9d59e-30fd-4060-a37d-82a5b8fe853d None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:44.725276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9d59e-30fd-4060-a37d-82a5b8fe853d None admin] RBAC: Adding query filter params (type=image) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:44.725578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9d59e-30fd-4060-a37d-82a5b8fe853d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:44.726921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9d59e-30fd-4060-a37d-82a5b8fe853d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:44.731748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 543/1056] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:44.732508 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9d59e-30fd-4060-a37d-82a5b8fe853d None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:44.750077 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa93bc-aaea-4dbd-95b8-f6c30b70624a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:44.782780 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b06b70-8b22-405e-b3b1-4bc886c569f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:44.783373 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b06b70-8b22-405e-b3b1-4bc886c569f8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:44.783653 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b06b70-8b22-405e-b3b1-4bc886c569f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:44.783932 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b06b70-8b22-405e-b3b1-4bc886c569f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:44.784707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b06b70-8b22-405e-b3b1-4bc886c569f8 None admin] RBAC: Adding query filter params (role.id=0ee2daa9cb3c41fb901603e3d8caf784, scope.project.id=800fd3f014a34a398360e81d05e79023, user.id=96defc54d26c47aaad0b6d87ce6105b2) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:44.785020 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b06b70-8b22-405e-b3b1-4bc886c569f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:44.786500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b06b70-8b22-405e-b3b1-4bc886c569f8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:44.791654 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 514/1057] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:32:44 2022] GET /identity/v3/role_assignments?user.id=96defc54d26c47aaad0b6d87ce6105b2&scope.project.id=800fd3f014a34a398360e81d05e79023&role.id=0ee2daa9cb3c41fb901603e3d8caf784 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:44.792399 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b06b70-8b22-405e-b3b1-4bc886c569f8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:44.840812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9d59e-30fd-4060-a37d-82a5b8fe853d None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:44.843033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:44.881774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80580169-fd10-4429-89f4-114f38a41de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:44.882407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80580169-fd10-4429-89f4-114f38a41de9 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:44.882705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80580169-fd10-4429-89f4-114f38a41de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:44.882942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80580169-fd10-4429-89f4-114f38a41de9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:44.883687 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80580169-fd10-4429-89f4-114f38a41de9 None admin] RBAC: Adding query filter params (role.id=775f8b8679a94a5887e259c092f17088, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=bfcfcf8061f24231858b9b0205a8abaa) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:44.883993 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80580169-fd10-4429-89f4-114f38a41de9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:44.885480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80580169-fd10-4429-89f4-114f38a41de9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:44.891559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 544/1058] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:32:44 2022] GET /identity/v3/role_assignments?user.id=bfcfcf8061f24231858b9b0205a8abaa&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=775f8b8679a94a5887e259c092f17088 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:44.911832 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b06b70-8b22-405e-b3b1-4bc886c569f8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:44.951342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963be2f-a5b4-401b-9066-c2ec9e15acd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:44.951968 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963be2f-a5b4-401b-9066-c2ec9e15acd7 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:44.952313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963be2f-a5b4-401b-9066-c2ec9e15acd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:44.952650 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963be2f-a5b4-401b-9066-c2ec9e15acd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:44.953456 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963be2f-a5b4-401b-9066-c2ec9e15acd7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:44.954959 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963be2f-a5b4-401b-9066-c2ec9e15acd7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:44.981143 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 515/1059] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:32:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:32:46.955458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5eb67-7f99-4f7e-8718-6f21966b20c8 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:46.956038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5eb67-7f99-4f7e-8718-6f21966b20c8 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:46.956038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5eb67-7f99-4f7e-8718-6f21966b20c8 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:46.957520 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 545/1060] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:46.963048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c03e57-df23-4baf-8d41-634615a6f5e3 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:46.963454 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c03e57-df23-4baf-8d41-634615a6f5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:46.963621 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c03e57-df23-4baf-8d41-634615a6f5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:46.981519 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-62c03e57-df23-4baf-8d41-634615a6f5e3 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:46.982703 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-62c03e57-df23-4baf-8d41-634615a6f5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:47.027729 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7872341-999d-4e0d-886d-acb28e38e86e None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:47.028068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7872341-999d-4e0d-886d-acb28e38e86e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:47.028276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7872341-999d-4e0d-886d-acb28e38e86e None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:47.029769 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 546/1061] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:32:47.034278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3ef66-2f49-4bcd-8367-16deeb46d0af None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:47.034556 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3ef66-2f49-4bcd-8367-16deeb46d0af None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:47.034822 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3ef66-2f49-4bcd-8367-16deeb46d0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:47.057224 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-9fc3ef66-2f49-4bcd-8367-16deeb46d0af None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:47.058455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9fc3ef66-2f49-4bcd-8367-16deeb46d0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:47.064153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 516/1062] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:47.075241 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:47.130107 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 547/1063] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 00:32:47.169278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295748e-2f26-4d57-8c0d-20293ce77a83 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:47.169580 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295748e-2f26-4d57-8c0d-20293ce77a83 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:47.169836 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295748e-2f26-4d57-8c0d-20293ce77a83 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:47.173128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 517/1064] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:47.176926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c2f96-efb9-40d9-9323-021403287041 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:47.177235 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c2f96-efb9-40d9-9323-021403287041 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:47.177510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c2f96-efb9-40d9-9323-021403287041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:47.195986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2b7c2f96-efb9-40d9-9323-021403287041 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:47.197189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2b7c2f96-efb9-40d9-9323-021403287041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:47.263209 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 548/1065] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:47.333352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295748e-2f26-4d57-8c0d-20293ce77a83 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:47.365858 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:47.399560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c2f96-efb9-40d9-9323-021403287041 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:47.448087 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295748e-2f26-4d57-8c0d-20293ce77a83 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:47.484611 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ce485-d061-4b5f-8adc-06ff372d1771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:47.485277 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ce485-d061-4b5f-8adc-06ff372d1771 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:47.485554 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ce485-d061-4b5f-8adc-06ff372d1771 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:47.485663 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:47.485821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ce485-d061-4b5f-8adc-06ff372d1771 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:47.497153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ce485-d061-4b5f-8adc-06ff372d1771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:32:47.502529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-d17ce485-d061-4b5f-8adc-06ff372d1771 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:32:47.502529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:47.502529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:47.502529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:47.502529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:47.502529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:47.502529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:47.502529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:47.502529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:47.502529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:47.502529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:47.502529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:47.502529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:32:47.502529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:32:47.502529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:32:47.502529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:32:47.503566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:32:47.503566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:32:47.503566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:32:47.503566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:32:47.503566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:47.503566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:47.503566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:47.503566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:47.503566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:47.503566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:47.503566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:47.503566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:47.503566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:47.503566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:47.503566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:47.503566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:47.504990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:47.504990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:47.504990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:47.504990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:47.504990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:32:47.504990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:32:47.504990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:32:47.504990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:32:47.504990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:32:47.504990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:32:47.504990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:32:47.504990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:47.504990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 518/1066] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:32:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:47.510001 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c2f96-efb9-40d9-9323-021403287041 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:47.510225 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ce485-d061-4b5f-8adc-06ff372d1771 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:47.545758 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6699ff2-5a08-46ca-8c17-1809fe4fab7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:47.546302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6699ff2-5a08-46ca-8c17-1809fe4fab7d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:47.546580 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6699ff2-5a08-46ca-8c17-1809fe4fab7d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:47.546851 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6699ff2-5a08-46ca-8c17-1809fe4fab7d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:47.556788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6699ff2-5a08-46ca-8c17-1809fe4fab7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:32:47.561650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-c6699ff2-5a08-46ca-8c17-1809fe4fab7d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 00:32:47.561650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:47.561650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:47.561650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:47.561650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:47.561650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:47.561650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:47.561650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:47.561650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:47.561650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:47.561650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:47.561650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:47.561650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:32:47.561650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:32:47.561650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:32:47.561650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:32:47.562603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:32:47.562603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:32:47.562603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:32:47.562603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:32:47.562603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:47.562603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:47.562603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:47.562603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:47.562603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:47.562603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:47.562603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:47.562603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:47.562603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:47.562603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:47.562603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:47.562603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:47.563436 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:47.563436 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:47.563436 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:47.563436 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:47.563436 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:32:47.563436 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:32:47.563436 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:32:47.563436 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:32:47.563436 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:32:47.563436 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:32:47.563436 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 00:32:47.563436 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:47.563436 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 549/1067] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Sep 15 00:32:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:47.564147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6699ff2-5a08-46ca-8c17-1809fe4fab7d None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:47.598262 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:47.613471 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ce485-d061-4b5f-8adc-06ff372d1771 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:47.647487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04629f6-54ca-4435-8097-fd4fd9e9873a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:47.648073 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04629f6-54ca-4435-8097-fd4fd9e9873a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:47.648351 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04629f6-54ca-4435-8097-fd4fd9e9873a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:47.648616 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04629f6-54ca-4435-8097-fd4fd9e9873a None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:47.649313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04629f6-54ca-4435-8097-fd4fd9e9873a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:47.649609 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04629f6-54ca-4435-8097-fd4fd9e9873a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:47.650972 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04629f6-54ca-4435-8097-fd4fd9e9873a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:47.658911 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 519/1068] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:32:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:47.659689 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04629f6-54ca-4435-8097-fd4fd9e9873a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:47.666485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6699ff2-5a08-46ca-8c17-1809fe4fab7d None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:47.700380 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e9ba1-8a17-481a-bbb1-499052a2c94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:47.700966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e9ba1-8a17-481a-bbb1-499052a2c94d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:47.701317 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e9ba1-8a17-481a-bbb1-499052a2c94d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:47.701587 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e9ba1-8a17-481a-bbb1-499052a2c94d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:47.712226 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:47.757728 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04629f6-54ca-4435-8097-fd4fd9e9873a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:47.768762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e9ba1-8a17-481a-bbb1-499052a2c94d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:47.770251 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e9ba1-8a17-481a-bbb1-499052a2c94d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:47.790165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a1c45-268d-4a8e-9b19-29540ff4fb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:47.790754 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a1c45-268d-4a8e-9b19-29540ff4fb35 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:47.791031 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a1c45-268d-4a8e-9b19-29540ff4fb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:47.791301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a1c45-268d-4a8e-9b19-29540ff4fb35 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:47.791951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a1c45-268d-4a8e-9b19-29540ff4fb35 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:47.792249 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a1c45-268d-4a8e-9b19-29540ff4fb35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:47.793645 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a1c45-268d-4a8e-9b19-29540ff4fb35 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:47.805308 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 520/1069] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Sep 15 00:32:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:47.805308 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a1c45-268d-4a8e-9b19-29540ff4fb35 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:47.814577 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:47.876169 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 550/1070] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:32:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 00:32:47.877136 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e9ba1-8a17-481a-bbb1-499052a2c94d None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:47.901913 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a1c45-268d-4a8e-9b19-29540ff4fb35 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:47.917810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:47.934904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e89b1-8d45-4c5e-bbde-f1831a32e41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:47.935523 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e89b1-8d45-4c5e-bbde-f1831a32e41d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:47.935800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e89b1-8d45-4c5e-bbde-f1831a32e41d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:47.936072 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e89b1-8d45-4c5e-bbde-f1831a32e41d None admin] PATH_INFO: `/v3/users/96defc54d26c47aaad0b6d87ce6105b2` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:47.937213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e89b1-8d45-4c5e-bbde-f1831a32e41d None admin] RBAC: Authorizing `identity:get_user(user_id=96defc54d26c47aaad0b6d87ce6105b2)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:47.938672 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e89b1-8d45-4c5e-bbde-f1831a32e41d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:47.940398 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 521/1071] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:32:47 2022] GET /identity/v3/users/96defc54d26c47aaad0b6d87ce6105b2 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:47.940966 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e89b1-8d45-4c5e-bbde-f1831a32e41d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:47.978682 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e9ba1-8a17-481a-bbb1-499052a2c94d None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:48.012926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a828d41-a80f-4045-ba31-6422661cbc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:48.013578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a828d41-a80f-4045-ba31-6422661cbc12 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:48.013859 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a828d41-a80f-4045-ba31-6422661cbc12 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:48.014128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a828d41-a80f-4045-ba31-6422661cbc12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:48.016800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:48.024452 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a828d41-a80f-4045-ba31-6422661cbc12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:48.025893 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a828d41-a80f-4045-ba31-6422661cbc12 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:48.038565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e89b1-8d45-4c5e-bbde-f1831a32e41d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:48.040529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-6a828d41-a80f-4045-ba31-6422661cbc12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:48.040529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:48.040529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:48.040529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:48.040529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:48.040529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:48.040529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:48.040529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:48.040529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:48.040529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:48.040529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:48.040529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:48.040529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:48.040529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:48.040529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:48.040529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:48.041742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:48.041742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:48.041742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:48.041742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:48.041742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:48.041742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:48.041742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:48.041742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:48.041742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:48.041742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:48.041742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:48.041742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:48.041742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:48.041742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:48.041742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:48.041742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:48.041742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:48.042673 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:48.042673 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:48.042673 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:48.042673 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 551/1072] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:48.042673 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a828d41-a80f-4045-ba31-6422661cbc12 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:48.072855 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3536b20-3624-4f6f-9420-083e09404abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:48.073504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3536b20-3624-4f6f-9420-083e09404abe None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:48.073780 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3536b20-3624-4f6f-9420-083e09404abe None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:48.074264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3536b20-3624-4f6f-9420-083e09404abe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:48.084622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3536b20-3624-4f6f-9420-083e09404abe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:48.086082 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3536b20-3624-4f6f-9420-083e09404abe None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:48.100504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-b3536b20-3624-4f6f-9420-083e09404abe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:48.100504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:48.100504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:48.100504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:48.100504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:48.100504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:48.100504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:48.100504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:48.100504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:48.100504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:48.100504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:48.100504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:48.100504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:48.100504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:48.100504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:48.100504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:48.101667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:48.101667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:48.101667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:48.101667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:48.101667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:48.101667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:48.101667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:48.101667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:48.101667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:48.101667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:48.101667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:48.101667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:48.101667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:48.101667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:48.101667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:48.101667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:48.101667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:48.102591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:48.102591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:48.102591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:48.102591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 522/1073] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:48.102831 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3536b20-3624-4f6f-9420-083e09404abe None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:48.141273 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:48.150626 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a828d41-a80f-4045-ba31-6422661cbc12 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:48.184351 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0bcc9-1045-4a3a-97ce-530364820c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:48.185062 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0bcc9-1045-4a3a-97ce-530364820c86 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:48.185366 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0bcc9-1045-4a3a-97ce-530364820c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:48.185638 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0bcc9-1045-4a3a-97ce-530364820c86 None admin] PATH_INFO: `/v3/projects/800fd3f014a34a398360e81d05e79023` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:48.186752 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0bcc9-1045-4a3a-97ce-530364820c86 None admin] RBAC: Authorizing `identity:get_project(project_id=800fd3f014a34a398360e81d05e79023)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:48.188162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0bcc9-1045-4a3a-97ce-530364820c86 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:48.189941 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 552/1074] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:32:48 2022] GET /identity/v3/projects/800fd3f014a34a398360e81d05e79023 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:48.190609 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0bcc9-1045-4a3a-97ce-530364820c86 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:48.204859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3536b20-3624-4f6f-9420-083e09404abe None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:48.232743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:48.239823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdda641-9013-43d8-aee6-947ca58d036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:48.240413 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdda641-9013-43d8-aee6-947ca58d036b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:48.240691 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdda641-9013-43d8-aee6-947ca58d036b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:48.240962 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdda641-9013-43d8-aee6-947ca58d036b None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:48.241625 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdda641-9013-43d8-aee6-947ca58d036b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:48.241925 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdda641-9013-43d8-aee6-947ca58d036b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:48.243283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdda641-9013-43d8-aee6-947ca58d036b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:48.255692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 523/1075] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:48.256455 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdda641-9013-43d8-aee6-947ca58d036b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:48.292679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0bcc9-1045-4a3a-97ce-530364820c86 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:48.327707 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66302d-b6ed-4198-86df-44f6c81ce468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:48.328233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66302d-b6ed-4198-86df-44f6c81ce468 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:48.328509 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66302d-b6ed-4198-86df-44f6c81ce468 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:48.328775 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66302d-b6ed-4198-86df-44f6c81ce468 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:48.329440 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66302d-b6ed-4198-86df-44f6c81ce468 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:48.329740 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66302d-b6ed-4198-86df-44f6c81ce468 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:48.331085 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66302d-b6ed-4198-86df-44f6c81ce468 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:48.346166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 553/1076] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:48.347265 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66302d-b6ed-4198-86df-44f6c81ce468 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:48.354639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdda641-9013-43d8-aee6-947ca58d036b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:48.373289 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:48.396427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44af2a5-4530-414a-8f60-6e6e00711363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:48.397138 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44af2a5-4530-414a-8f60-6e6e00711363 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:48.397424 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44af2a5-4530-414a-8f60-6e6e00711363 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:48.397698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44af2a5-4530-414a-8f60-6e6e00711363 None admin] PATH_INFO: `/v3/projects/800fd3f014a34a398360e81d05e79023/users/96defc54d26c47aaad0b6d87ce6105b2/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:48.400800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44af2a5-4530-414a-8f60-6e6e00711363 None admin] RBAC: Authorizing `identity:create_grant(project_id=800fd3f014a34a398360e81d05e79023, user_id=96defc54d26c47aaad0b6d87ce6105b2, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:48.402701 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44af2a5-4530-414a-8f60-6e6e00711363 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:48.418175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 524/1077] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:32:48 2022] PUT /identity/v3/projects/800fd3f014a34a398360e81d05e79023/users/96defc54d26c47aaad0b6d87ce6105b2/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:32:48.475870 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66302d-b6ed-4198-86df-44f6c81ce468 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:48.516037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8c6e6-bf45-496d-8392-ead217ce23ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:48.516695 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8c6e6-bf45-496d-8392-ead217ce23ea None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:48.516973 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8c6e6-bf45-496d-8392-ead217ce23ea None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:48.517282 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8c6e6-bf45-496d-8392-ead217ce23ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:48.526353 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8c6e6-bf45-496d-8392-ead217ce23ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:48.527803 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8c6e6-bf45-496d-8392-ead217ce23ea None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:48.542253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-42d8c6e6-bf45-496d-8392-ead217ce23ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 00:32:48.542253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:48.542253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:48.542253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:48.542253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:48.542253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:48.542253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:48.542253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:48.542253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:48.542253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:48.542253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:48.542253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:48.542253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:32:48.542253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:32:48.542253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:32:48.542253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:32:48.543276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:48.543276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:48.543276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:32:48.543276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:48.543276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:32:48.543276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:48.543276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:48.543276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:48.543276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:48.543276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:48.543276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:48.543276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:48.543276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:48.543276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:48.543276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:48.543276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:48.543276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:48.543276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:48.544231 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:48.544231 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:48.544231 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:32:48.544231 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:32:48.544231 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:32:48.544231 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:32:48.544231 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:32:48.544231 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:32:48.544231 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 00:32:48.544231 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:48.544231 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 554/1078] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Sep 15 00:32:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:48.549579 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44af2a5-4530-414a-8f60-6e6e00711363 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:48.605816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:48.657886 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44af2a5-4530-414a-8f60-6e6e00711363 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:48.693015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c269f97-7513-4927-8e8b-0d419741b25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:48.693642 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c269f97-7513-4927-8e8b-0d419741b25b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:48.693919 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c269f97-7513-4927-8e8b-0d419741b25b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:48.694189 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c269f97-7513-4927-8e8b-0d419741b25b None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:48.694911 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c269f97-7513-4927-8e8b-0d419741b25b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:48.695213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c269f97-7513-4927-8e8b-0d419741b25b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:48.696629 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c269f97-7513-4927-8e8b-0d419741b25b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:48.715485 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 525/1079] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Sep 15 00:32:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:48.721205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8c6e6-bf45-496d-8392-ead217ce23ea None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:48.801340 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:48.820287 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8c6e6-bf45-496d-8392-ead217ce23ea None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:48.853389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face7fc6-6fee-4598-8279-337be857f4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:48.854000 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face7fc6-6fee-4598-8279-337be857f4ad None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:48.854274 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face7fc6-6fee-4598-8279-337be857f4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:48.854540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face7fc6-6fee-4598-8279-337be857f4ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:48.865131 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face7fc6-6fee-4598-8279-337be857f4ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:48.866486 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face7fc6-6fee-4598-8279-337be857f4ad None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:48.880679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-face7fc6-6fee-4598-8279-337be857f4ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:48.880679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:48.880679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:48.880679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:48.880679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:48.880679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:48.880679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:48.880679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:48.880679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:48.880679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:48.880679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:48.880679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:48.880679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:48.880679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:48.880679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:48.880679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:48.886346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:48.886346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:48.886346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:48.886346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:48.886346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:48.886346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:48.886346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:48.886346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:48.886346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:48.886346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:48.886346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:48.886346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:48.886346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:48.886346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:48.886346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:48.886346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:48.886346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:48.887460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:48.887460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:48.887460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:48.887460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 555/1080] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:48.887747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c269f97-7513-4927-8e8b-0d419741b25b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:48.989203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c269f97-7513-4927-8e8b-0d419741b25b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:48.998282 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:49.023630 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3de58-4ad2-4cb8-8d45-91bd4059bcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:49.024258 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3de58-4ad2-4cb8-8d45-91bd4059bcb0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:49.024480 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3de58-4ad2-4cb8-8d45-91bd4059bcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:49.024746 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3de58-4ad2-4cb8-8d45-91bd4059bcb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:49.025407 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3de58-4ad2-4cb8-8d45-91bd4059bcb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:49.025705 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3de58-4ad2-4cb8-8d45-91bd4059bcb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:49.027051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3de58-4ad2-4cb8-8d45-91bd4059bcb0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:49.038104 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 526/1081] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:49.043818 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face7fc6-6fee-4598-8279-337be857f4ad None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:49.139948 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face7fc6-6fee-4598-8279-337be857f4ad None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:49.169628 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:49.175152 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f9849-021f-42cc-87db-c7f1165b548d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:49.175775 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f9849-021f-42cc-87db-c7f1165b548d None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:49.176052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f9849-021f-42cc-87db-c7f1165b548d None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:49.176358 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f9849-021f-42cc-87db-c7f1165b548d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:49.182892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f9849-021f-42cc-87db-c7f1165b548d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:49.184298 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f9849-021f-42cc-87db-c7f1165b548d None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:49.195770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-0d8f9849-021f-42cc-87db-c7f1165b548d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:49.195770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:49.195770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:49.195770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:49.195770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:49.195770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:49.195770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:49.195770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:49.195770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:49.195770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:49.195770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:49.195770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:49.195770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:32:49.195770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:32:49.195770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:32:49.196842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:32:49.196842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:49.196842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:49.196842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:49.196842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:49.196842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:49.196842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:49.196842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:49.196842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:49.196842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:49.196842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:49.196842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:49.196842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:49.196842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:49.196842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:49.196842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:49.196842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:49.198068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:32:49.198068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:32:49.198068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:32:49.198068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:32:49.198068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:32:49.198068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:32:49.198068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:49.198068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:49.201416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 556/1082] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:32:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:49.202496 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3de58-4ad2-4cb8-8d45-91bd4059bcb0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:49.304812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3de58-4ad2-4cb8-8d45-91bd4059bcb0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:49.343353 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87979f61-f0ea-4156-ab57-7c2176604b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:49.343958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87979f61-f0ea-4156-ab57-7c2176604b85 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:49.344234 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87979f61-f0ea-4156-ab57-7c2176604b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:49.344499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87979f61-f0ea-4156-ab57-7c2176604b85 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:49.345216 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87979f61-f0ea-4156-ab57-7c2176604b85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:49.345520 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87979f61-f0ea-4156-ab57-7c2176604b85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:49.346931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87979f61-f0ea-4156-ab57-7c2176604b85 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:49.359911 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 527/1083] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:32:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:49.365882 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f9849-021f-42cc-87db-c7f1165b548d None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:49.463215 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f9849-021f-42cc-87db-c7f1165b548d None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:49.495945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700ee66-2e57-4a44-9ca1-ad59fcd1adac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:49.496581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700ee66-2e57-4a44-9ca1-ad59fcd1adac None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:49.496863 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700ee66-2e57-4a44-9ca1-ad59fcd1adac None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:49.497228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700ee66-2e57-4a44-9ca1-ad59fcd1adac None admin] PATH_INFO: `/v3/projects/f25792dd210b42c4a3491096a735f909/users/bfcfcf8061f24231858b9b0205a8abaa/roles/775f8b8679a94a5887e259c092f17088` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:49.499354 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700ee66-2e57-4a44-9ca1-ad59fcd1adac None admin] RBAC: Authorizing `identity:create_grant(project_id=f25792dd210b42c4a3491096a735f909, user_id=bfcfcf8061f24231858b9b0205a8abaa, role_id=775f8b8679a94a5887e259c092f17088)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:49.500770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700ee66-2e57-4a44-9ca1-ad59fcd1adac None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:49.514424 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 557/1084] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:32:49 2022] PUT /identity/v3/projects/f25792dd210b42c4a3491096a735f909/users/bfcfcf8061f24231858b9b0205a8abaa/roles/775f8b8679a94a5887e259c092f17088 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:32:50.616876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7708c-5184-4212-8a5f-3a96999f2eac None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:50.617559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7708c-5184-4212-8a5f-3a96999f2eac None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:50.617559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7708c-5184-4212-8a5f-3a96999f2eac None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:50.618877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 528/1085] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:50.623829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cdaf5-5809-4746-b150-a1bdc927769b None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:50.624269 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cdaf5-5809-4746-b150-a1bdc927769b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:50.624439 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cdaf5-5809-4746-b150-a1bdc927769b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:50.642319 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-a21cdaf5-5809-4746-b150-a1bdc927769b None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:50.643490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a21cdaf5-5809-4746-b150-a1bdc927769b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:50.689750 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:50.710595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 558/1086] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 00:32:50.980740 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7708c-5184-4212-8a5f-3a96999f2eac None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:51.007846 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:51.079411 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7708c-5184-4212-8a5f-3a96999f2eac None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:51.113462 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0a725-d3c4-4c96-ad1b-7fa5318d2f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:51.114087 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0a725-d3c4-4c96-ad1b-7fa5318d2f1f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:51.114364 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0a725-d3c4-4c96-ad1b-7fa5318d2f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:51.114627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0a725-d3c4-4c96-ad1b-7fa5318d2f1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:51.124302 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0a725-d3c4-4c96-ad1b-7fa5318d2f1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:32:51.128996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-83f0a725-d3c4-4c96-ad1b-7fa5318d2f1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:32:51.128996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:51.128996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:51.128996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:51.128996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:51.128996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:51.128996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:51.128996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:51.128996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:51.128996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:51.128996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:51.128996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:51.128996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:32:51.128996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:32:51.128996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:32:51.128996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:32:51.130673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:32:51.130673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:32:51.130673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:32:51.130673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:32:51.130673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:51.130673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:51.130673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:51.130673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:51.130673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:51.130673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:51.130673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:51.130673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:51.130673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:51.130673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:51.130673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:51.130673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:51.131859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:51.131859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:51.131859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:51.131859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:51.131859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:32:51.131859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:32:51.131859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:32:51.131859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:32:51.131859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:32:51.131859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:32:51.131859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:32:51.131859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:51.133225 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 529/1087] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:32:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:51.136511 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cdaf5-5809-4746-b150-a1bdc927769b None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:51.235140 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cdaf5-5809-4746-b150-a1bdc927769b None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:51.268734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f9651-0cb1-4e86-a454-d2a0598e222e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:51.269398 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f9651-0cb1-4e86-a454-d2a0598e222e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:51.269674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f9651-0cb1-4e86-a454-d2a0598e222e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:51.270491 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f9651-0cb1-4e86-a454-d2a0598e222e None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:51.271141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f9651-0cb1-4e86-a454-d2a0598e222e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:51.271440 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f9651-0cb1-4e86-a454-d2a0598e222e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:51.272776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f9651-0cb1-4e86-a454-d2a0598e222e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:51.280550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 559/1088] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:32:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:51.286413 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0a725-d3c4-4c96-ad1b-7fa5318d2f1f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:51.374179 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:51.387189 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0a725-d3c4-4c96-ad1b-7fa5318d2f1f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:51.420665 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805b185-f08d-4e41-91b7-761d8dad3977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:51.421327 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805b185-f08d-4e41-91b7-761d8dad3977 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:51.421607 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805b185-f08d-4e41-91b7-761d8dad3977 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:51.421883 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805b185-f08d-4e41-91b7-761d8dad3977 None admin] PATH_INFO: `/v3/users/96defc54d26c47aaad0b6d87ce6105b2` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:51.422994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805b185-f08d-4e41-91b7-761d8dad3977 None admin] RBAC: Authorizing `identity:get_user(user_id=96defc54d26c47aaad0b6d87ce6105b2)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:51.424430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805b185-f08d-4e41-91b7-761d8dad3977 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:51.426066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 530/1089] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:32:51 2022] GET /identity/v3/users/96defc54d26c47aaad0b6d87ce6105b2 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:51.431728 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f9651-0cb1-4e86-a454-d2a0598e222e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:51.477336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:51.531286 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f9651-0cb1-4e86-a454-d2a0598e222e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:51.568322 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b63e0-669a-42ac-9b90-5b7ae42304fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:51.568927 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b63e0-669a-42ac-9b90-5b7ae42304fb None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:51.569240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b63e0-669a-42ac-9b90-5b7ae42304fb None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:51.569513 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b63e0-669a-42ac-9b90-5b7ae42304fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:51.636531 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b63e0-669a-42ac-9b90-5b7ae42304fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:51.637990 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b63e0-669a-42ac-9b90-5b7ae42304fb None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:51.652137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcbfcd-85cb-4baf-b6c7-9ac44b39d01f None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:51.652591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcbfcd-85cb-4baf-b6c7-9ac44b39d01f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:51.652836 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcbfcd-85cb-4baf-b6c7-9ac44b39d01f None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:51.654295 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 531/1090] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:32:51.659326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80d0a2-779a-4c42-a96b-d68bf1ae5753 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:51.659607 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80d0a2-779a-4c42-a96b-d68bf1ae5753 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:51.659879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80d0a2-779a-4c42-a96b-d68bf1ae5753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:51.678039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-de80d0a2-779a-4c42-a96b-d68bf1ae5753 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:51.679233 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-de80d0a2-779a-4c42-a96b-d68bf1ae5753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:51.683710 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:51.737598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 560/1091] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:32:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 00:32:51.744081 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b63e0-669a-42ac-9b90-5b7ae42304fb None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:51.747665 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 532/1092] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 00:32:51.839623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b63e0-669a-42ac-9b90-5b7ae42304fb None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:51.874520 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcd8bb-5a3d-468f-b905-c7c7d2cf87e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:51.875136 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcd8bb-5a3d-468f-b905-c7c7d2cf87e5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:51.875413 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcd8bb-5a3d-468f-b905-c7c7d2cf87e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:51.875682 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcd8bb-5a3d-468f-b905-c7c7d2cf87e5 None admin] PATH_INFO: `/v3/projects/800fd3f014a34a398360e81d05e79023` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:51.876779 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcd8bb-5a3d-468f-b905-c7c7d2cf87e5 None admin] RBAC: Authorizing `identity:get_project(project_id=800fd3f014a34a398360e81d05e79023)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:51.878214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcd8bb-5a3d-468f-b905-c7c7d2cf87e5 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:51.880012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 561/1093] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:32:51 2022] GET /identity/v3/projects/800fd3f014a34a398360e81d05e79023 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:51.885980 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80d0a2-779a-4c42-a96b-d68bf1ae5753 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:51.966306 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:51.981227 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80d0a2-779a-4c42-a96b-d68bf1ae5753 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:52.014213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec905554-5f8a-4e46-a5b3-e3d9da598c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:52.014806 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec905554-5f8a-4e46-a5b3-e3d9da598c79 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:52.015081 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec905554-5f8a-4e46-a5b3-e3d9da598c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:52.015348 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec905554-5f8a-4e46-a5b3-e3d9da598c79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:52.016064 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec905554-5f8a-4e46-a5b3-e3d9da598c79 None admin] RBAC: Adding query filter params (role.id=0ee2daa9cb3c41fb901603e3d8caf784, scope.project.id=800fd3f014a34a398360e81d05e79023, user.id=96defc54d26c47aaad0b6d87ce6105b2) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:52.016369 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec905554-5f8a-4e46-a5b3-e3d9da598c79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:52.017834 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec905554-5f8a-4e46-a5b3-e3d9da598c79 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:52.018438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcd8bb-5a3d-468f-b905-c7c7d2cf87e5 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:52.026862 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 533/1094] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:32:51 2022] GET /identity/v3/role_assignments?user.id=96defc54d26c47aaad0b6d87ce6105b2&scope.project.id=800fd3f014a34a398360e81d05e79023&role.id=0ee2daa9cb3c41fb901603e3d8caf784 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:52.033639 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:52.125302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcd8bb-5a3d-468f-b905-c7c7d2cf87e5 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:52.160021 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f663ef2-1ddf-4a84-877d-4dc6c7e032c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:52.161218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f663ef2-1ddf-4a84-877d-4dc6c7e032c6 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:52.161498 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f663ef2-1ddf-4a84-877d-4dc6c7e032c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:52.161764 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f663ef2-1ddf-4a84-877d-4dc6c7e032c6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:52.172930 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f663ef2-1ddf-4a84-877d-4dc6c7e032c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:32:52.178510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-9f663ef2-1ddf-4a84-877d-4dc6c7e032c6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 00:32:52.178510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:52.178510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:52.178510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:52.178510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:52.178510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:52.178510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:52.178510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:52.178510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:52.178510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:52.178510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:52.178510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:52.178510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:32:52.178510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:32:52.178510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:32:52.178510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:32:52.179649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:32:52.179649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:32:52.179649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:32:52.179649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:32:52.179649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:52.179649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:52.179649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:52.179649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:52.179649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:52.179649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:52.179649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:52.179649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:52.179649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:52.179649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:52.179649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:52.179649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:52.180523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:52.180523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:52.180523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:52.180523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:52.180523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:32:52.180523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:32:52.180523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:32:52.180523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:32:52.180523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:32:52.180523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:32:52.180523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 00:32:52.180523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:52.180523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 562/1095] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Sep 15 00:32:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:52.185921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec905554-5f8a-4e46-a5b3-e3d9da598c79 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:52.287771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec905554-5f8a-4e46-a5b3-e3d9da598c79 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:52.320810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61638ec8-500d-4556-b8a9-21267b2910e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:52.321440 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61638ec8-500d-4556-b8a9-21267b2910e9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:52.321721 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61638ec8-500d-4556-b8a9-21267b2910e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:52.322015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61638ec8-500d-4556-b8a9-21267b2910e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:52.322650 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61638ec8-500d-4556-b8a9-21267b2910e9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:52.322955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61638ec8-500d-4556-b8a9-21267b2910e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:52.324322 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61638ec8-500d-4556-b8a9-21267b2910e9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:52.337585 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 534/1096] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Sep 15 00:32:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:52.338827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f663ef2-1ddf-4a84-877d-4dc6c7e032c6 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:52.409213 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:52.438962 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f663ef2-1ddf-4a84-877d-4dc6c7e032c6 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:52.472458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9907b8f-6c4f-4e10-806d-84192b78be6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:52.473902 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9907b8f-6c4f-4e10-806d-84192b78be6c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:52.474189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9907b8f-6c4f-4e10-806d-84192b78be6c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:52.474454 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9907b8f-6c4f-4e10-806d-84192b78be6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:52.484652 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9907b8f-6c4f-4e10-806d-84192b78be6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:52.486102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9907b8f-6c4f-4e10-806d-84192b78be6c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:52.500243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-a9907b8f-6c4f-4e10-806d-84192b78be6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:52.500243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:52.500243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:52.500243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:52.500243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:52.500243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:52.500243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:52.500243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:52.500243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:52.500243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:52.500243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:52.500243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:52.500243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:52.500243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:52.500243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:52.500243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:52.506102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:52.506102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:52.506102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:52.506102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:52.506102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:52.506102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:52.506102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:52.506102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:52.506102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:52.506102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:52.506102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:52.506102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:52.506102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:52.506102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:52.506102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:52.506102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:52.506102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:52.507039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:52.507039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:52.507039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:52.507039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 563/1097] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:52.507284 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61638ec8-500d-4556-b8a9-21267b2910e9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:52.522844 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:52.606596 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61638ec8-500d-4556-b8a9-21267b2910e9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:52.640236 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6714af-2765-49b4-ac5e-755ec6a4524e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:52.640831 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6714af-2765-49b4-ac5e-755ec6a4524e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:52.641128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6714af-2765-49b4-ac5e-755ec6a4524e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:52.641482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6714af-2765-49b4-ac5e-755ec6a4524e None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:52.642271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6714af-2765-49b4-ac5e-755ec6a4524e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:52.642574 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6714af-2765-49b4-ac5e-755ec6a4524e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:52.643934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6714af-2765-49b4-ac5e-755ec6a4524e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:52.656493 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 535/1098] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:52.662267 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9907b8f-6c4f-4e10-806d-84192b78be6c None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:52.758990 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9907b8f-6c4f-4e10-806d-84192b78be6c None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:52.782046 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:52.793020 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc6ff6-9b7d-440c-a2c9-e441101bc5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:52.793740 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc6ff6-9b7d-440c-a2c9-e441101bc5c9 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:52.794172 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc6ff6-9b7d-440c-a2c9-e441101bc5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:52.794446 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc6ff6-9b7d-440c-a2c9-e441101bc5c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:52.801789 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc6ff6-9b7d-440c-a2c9-e441101bc5c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:52.803188 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc6ff6-9b7d-440c-a2c9-e441101bc5c9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:52.813988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-bebc6ff6-9b7d-440c-a2c9-e441101bc5c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 00:32:52.813988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:52.813988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:52.813988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:52.813988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:52.813988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:52.813988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:52.813988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:52.813988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:52.813988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:52.813988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:52.813988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:52.813988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:32:52.813988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:32:52.813988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:32:52.813988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:32:52.814938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:52.814938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:52.814938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:32:52.814938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:52.814938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:32:52.814938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:32:52.814938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:52.814938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:52.814938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:52.814938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:52.814938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:52.814938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:52.814938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:52.814938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:52.814938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:52.814938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:52.814938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:52.814938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:52.816278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:52.816278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:52.816278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:32:52.816278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:32:52.816278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:32:52.816278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:32:52.816278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:32:52.816278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:32:52.816278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 00:32:52.816278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:32:52.816278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 564/1099] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Sep 15 00:32:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:32:52.821446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6714af-2765-49b4-ac5e-755ec6a4524e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:52.889021 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:52.919243 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6714af-2765-49b4-ac5e-755ec6a4524e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:52.954112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed6895-4e4e-4306-902e-1ae7f8874fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:52.954712 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed6895-4e4e-4306-902e-1ae7f8874fdf None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:52.954991 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed6895-4e4e-4306-902e-1ae7f8874fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:52.955262 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed6895-4e4e-4306-902e-1ae7f8874fdf None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:52.955982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed6895-4e4e-4306-902e-1ae7f8874fdf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:52.956286 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed6895-4e4e-4306-902e-1ae7f8874fdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:52.958365 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed6895-4e4e-4306-902e-1ae7f8874fdf None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:52.974979 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 536/1100] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Sep 15 00:32:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:52.980710 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc6ff6-9b7d-440c-a2c9-e441101bc5c9 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:53.078525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc6ff6-9b7d-440c-a2c9-e441101bc5c9 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:53.110537 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad8157-db98-4e4e-b964-5cef95eb739a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:53.111126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad8157-db98-4e4e-b964-5cef95eb739a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:53.111409 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad8157-db98-4e4e-b964-5cef95eb739a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:53.111682 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad8157-db98-4e4e-b964-5cef95eb739a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:53.161741 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:53.178033 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad8157-db98-4e4e-b964-5cef95eb739a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:53.179399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad8157-db98-4e4e-b964-5cef95eb739a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:53.275746 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 565/1101] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:32:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 00:32:53.281506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed6895-4e4e-4306-902e-1ae7f8874fdf None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:53.378957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed6895-4e4e-4306-902e-1ae7f8874fdf None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:53.407028 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:53.413034 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ba17f-08c1-4712-a07d-670aff5f7b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:53.413668 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ba17f-08c1-4712-a07d-670aff5f7b22 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:53.413943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ba17f-08c1-4712-a07d-670aff5f7b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:53.414213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ba17f-08c1-4712-a07d-670aff5f7b22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:53.423842 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ba17f-08c1-4712-a07d-670aff5f7b22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:53.425291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ba17f-08c1-4712-a07d-670aff5f7b22 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:53.439224 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-cd0ba17f-08c1-4712-a07d-670aff5f7b22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:53.439224 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:53.439224 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:53.439224 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:53.439224 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:53.439224 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:53.439224 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:53.439224 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:53.439224 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:53.439224 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:53.439224 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:53.439224 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:53.439224 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:32:53.439224 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:32:53.439224 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:32:53.439224 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:32:53.440326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:53.440326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:53.440326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:53.440326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:53.440326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:53.440326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:53.440326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:53.440326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:53.440326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:53.440326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:53.440326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:53.440326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:53.440326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:53.440326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:53.440326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:53.440326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:53.440326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:32:53.441405 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:32:53.441405 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:32:53.441405 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:53.441405 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 537/1102] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:53.446557 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad8157-db98-4e4e-b964-5cef95eb739a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:53.527995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:53.543199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad8157-db98-4e4e-b964-5cef95eb739a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:53.575830 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf8f65-eb0d-44cd-a92a-cd6e22963130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:53.576423 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf8f65-eb0d-44cd-a92a-cd6e22963130 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:53.576698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf8f65-eb0d-44cd-a92a-cd6e22963130 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:53.576964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf8f65-eb0d-44cd-a92a-cd6e22963130 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:53.577628 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf8f65-eb0d-44cd-a92a-cd6e22963130 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:53.577926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf8f65-eb0d-44cd-a92a-cd6e22963130 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:53.579264 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf8f65-eb0d-44cd-a92a-cd6e22963130 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:53.596535 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 566/1103] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:53.597737 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ba17f-08c1-4712-a07d-670aff5f7b22 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:53.694857 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ba17f-08c1-4712-a07d-670aff5f7b22 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:53.727456 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc09b63-acf9-4259-b45b-c6245ae7eb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:53.728072 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc09b63-acf9-4259-b45b-c6245ae7eb13 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:53.728345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc09b63-acf9-4259-b45b-c6245ae7eb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:53.728615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc09b63-acf9-4259-b45b-c6245ae7eb13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:53.735280 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc09b63-acf9-4259-b45b-c6245ae7eb13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:53.736702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc09b63-acf9-4259-b45b-c6245ae7eb13 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:53.748091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-9fc09b63-acf9-4259-b45b-c6245ae7eb13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:53.748091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:32:53.748091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:32:53.748091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:32:53.748091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:32:53.748091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:32:53.748091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:32:53.748091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:32:53.748091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:32:53.748091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:32:53.748091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:32:53.748091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:32:53.748091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:32:53.748091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:32:53.748091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:32:53.749131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:32:53.749131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:32:53.749131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:32:53.749131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:32:53.749131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:32:53.749131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:32:53.749131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:32:53.749131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:32:53.749131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:32:53.749131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:32:53.749131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:32:53.749131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:32:53.749131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:32:53.749131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:32:53.749131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:32:53.749131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:32:53.749131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:32:53.750089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:32:53.750089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:32:53.750089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:32:53.750089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:32:53.750089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:32:53.750089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:32:53.750089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:32:53.750089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:32:53.750089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 538/1104] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:32:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:32:53.755829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf8f65-eb0d-44cd-a92a-cd6e22963130 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:53.856139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf8f65-eb0d-44cd-a92a-cd6e22963130 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:53.892763 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857267bd-2e0a-4a62-88f6-2c27dfd3ab72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:53.893533 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857267bd-2e0a-4a62-88f6-2c27dfd3ab72 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:53.894067 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857267bd-2e0a-4a62-88f6-2c27dfd3ab72 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:53.894338 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857267bd-2e0a-4a62-88f6-2c27dfd3ab72 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:53.895572 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857267bd-2e0a-4a62-88f6-2c27dfd3ab72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:53.895871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857267bd-2e0a-4a62-88f6-2c27dfd3ab72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:53.897295 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857267bd-2e0a-4a62-88f6-2c27dfd3ab72 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:53.908964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 567/1105] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:32:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:32:53.915891 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc09b63-acf9-4259-b45b-c6245ae7eb13 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:53.957884 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:54.011981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc09b63-acf9-4259-b45b-c6245ae7eb13 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:54.045055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79f6f5-17da-427c-9554-f7b8ef292953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:54.045661 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79f6f5-17da-427c-9554-f7b8ef292953 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:54.045934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79f6f5-17da-427c-9554-f7b8ef292953 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:54.046200 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79f6f5-17da-427c-9554-f7b8ef292953 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:54.046914 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79f6f5-17da-427c-9554-f7b8ef292953 None admin] RBAC: Adding query filter params (role.id=775f8b8679a94a5887e259c092f17088, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=bfcfcf8061f24231858b9b0205a8abaa) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:54.047219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79f6f5-17da-427c-9554-f7b8ef292953 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:54.048633 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79f6f5-17da-427c-9554-f7b8ef292953 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:54.054445 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 539/1106] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:32:53 2022] GET /identity/v3/role_assignments?user.id=bfcfcf8061f24231858b9b0205a8abaa&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=775f8b8679a94a5887e259c092f17088 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:54.210910 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2af5c-1b3a-46ce-8ea2-a2b185fe5967 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:54.211097 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2af5c-1b3a-46ce-8ea2-a2b185fe5967 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:54.211358 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2af5c-1b3a-46ce-8ea2-a2b185fe5967 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:54.212706 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 568/1107] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:32:54.218325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bef9e3-d8ad-4a51-ad2f-05e1634ead3f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:54.218608 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bef9e3-d8ad-4a51-ad2f-05e1634ead3f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:54.218877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bef9e3-d8ad-4a51-ad2f-05e1634ead3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:54.238689 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-88bef9e3-d8ad-4a51-ad2f-05e1634ead3f None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:54.239895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-88bef9e3-d8ad-4a51-ad2f-05e1634ead3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:54.307116 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 540/1108] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:32:54.574657 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2af5c-1b3a-46ce-8ea2-a2b185fe5967 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:54.578511 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:54.680929 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2af5c-1b3a-46ce-8ea2-a2b185fe5967 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:54.715256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a53c9-dc94-4566-9ed9-e2be00687d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:54.715877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a53c9-dc94-4566-9ed9-e2be00687d91 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:54.716151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a53c9-dc94-4566-9ed9-e2be00687d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:54.716422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a53c9-dc94-4566-9ed9-e2be00687d91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:54.717558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a53c9-dc94-4566-9ed9-e2be00687d91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:54.718974 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a53c9-dc94-4566-9ed9-e2be00687d91 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:54.720526 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 569/1109] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:32:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:54.726900 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bef9e3-d8ad-4a51-ad2f-05e1634ead3f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:54.762762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:54.829317 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bef9e3-d8ad-4a51-ad2f-05e1634ead3f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:54.863370 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d21dc0-1d42-42d5-9bed-92e9b87c08d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:54.864566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d21dc0-1d42-42d5-9bed-92e9b87c08d9 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:54.864844 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d21dc0-1d42-42d5-9bed-92e9b87c08d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:54.865141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d21dc0-1d42-42d5-9bed-92e9b87c08d9 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:54.865805 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d21dc0-1d42-42d5-9bed-92e9b87c08d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:54.867244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d21dc0-1d42-42d5-9bed-92e9b87c08d9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:54.889460 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 541/1110] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 15 00:32:54 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:32:57.044116 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f85a3c-15c5-40c1-8777-96e8294348ee None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:57.044658 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f85a3c-15c5-40c1-8777-96e8294348ee None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:57.044658 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f85a3c-15c5-40c1-8777-96e8294348ee None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:57.046018 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 570/1111] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:32:57.051950 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dd164-bd1d-41d4-949c-5814f1368c31 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:57.052359 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dd164-bd1d-41d4-949c-5814f1368c31 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:57.052524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dd164-bd1d-41d4-949c-5814f1368c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:57.070486 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2b2dd164-bd1d-41d4-949c-5814f1368c31 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:32:57.071669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2b2dd164-bd1d-41d4-949c-5814f1368c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:32:57.136233 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 542/1112] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:32:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 00:32:57.404110 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f85a3c-15c5-40c1-8777-96e8294348ee None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:57.471639 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:57.501155 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f85a3c-15c5-40c1-8777-96e8294348ee None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:57.533944 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4694dfd-689d-4a8e-a3d5-f9fb18f37e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:57.534558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4694dfd-689d-4a8e-a3d5-f9fb18f37e33 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:57.534837 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4694dfd-689d-4a8e-a3d5-f9fb18f37e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:57.535483 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4694dfd-689d-4a8e-a3d5-f9fb18f37e33 None admin] PATH_INFO: `/v3/roles/1c9b176504fd4d24b34942f724e63acf` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:57.536870 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4694dfd-689d-4a8e-a3d5-f9fb18f37e33 None admin] RBAC: Authorizing `identity:get_role(role_id=1c9b176504fd4d24b34942f724e63acf)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:57.538248 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4694dfd-689d-4a8e-a3d5-f9fb18f37e33 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:57.539540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 571/1113] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:32:57 2022] GET /identity/v3/roles/1c9b176504fd4d24b34942f724e63acf => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:57.545365 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2dd164-bd1d-41d4-949c-5814f1368c31 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:57.569098 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:57.642395 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2dd164-bd1d-41d4-949c-5814f1368c31 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:57.674016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472d750-3a34-4c6e-835d-c2520c76fdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:57.674620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472d750-3a34-4c6e-835d-c2520c76fdf8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:57.674893 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472d750-3a34-4c6e-835d-c2520c76fdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:57.675161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472d750-3a34-4c6e-835d-c2520c76fdf8 None admin] PATH_INFO: `/v3/users/756b33ca0e544d91b074fba0b624b4e7` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:57.687957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472d750-3a34-4c6e-835d-c2520c76fdf8 None admin] RBAC: Authorizing `identity:get_user(user_id=756b33ca0e544d91b074fba0b624b4e7)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:57.689406 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472d750-3a34-4c6e-835d-c2520c76fdf8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:57.690951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 543/1114] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:32:57 2022] GET /identity/v3/users/756b33ca0e544d91b074fba0b624b4e7 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:57.697177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4694dfd-689d-4a8e-a3d5-f9fb18f37e33 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:57.791550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4694dfd-689d-4a8e-a3d5-f9fb18f37e33 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:57.824343 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49feffd4-b2a3-431c-8436-e0d063515d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:57.824921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49feffd4-b2a3-431c-8436-e0d063515d62 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:57.825228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49feffd4-b2a3-431c-8436-e0d063515d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:57.825501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49feffd4-b2a3-431c-8436-e0d063515d62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:57.836042 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:57.891870 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49feffd4-b2a3-431c-8436-e0d063515d62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:57.893357 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49feffd4-b2a3-431c-8436-e0d063515d62 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:57.986677 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 572/1115] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:32:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 00:32:57.992773 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472d750-3a34-4c6e-835d-c2520c76fdf8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:58.069504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:58.089110 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472d750-3a34-4c6e-835d-c2520c76fdf8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:58.122034 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3cefe-4e54-4e68-b91a-83a64d1e9a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:58.122645 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3cefe-4e54-4e68-b91a-83a64d1e9a20 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:58.122922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3cefe-4e54-4e68-b91a-83a64d1e9a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:58.123193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3cefe-4e54-4e68-b91a-83a64d1e9a20 None admin] PATH_INFO: `/v3/projects/800fd3f014a34a398360e81d05e79023` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:58.124293 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3cefe-4e54-4e68-b91a-83a64d1e9a20 None admin] RBAC: Authorizing `identity:get_project(project_id=800fd3f014a34a398360e81d05e79023)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:58.125778 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3cefe-4e54-4e68-b91a-83a64d1e9a20 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:58.127471 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 544/1116] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:32:57 2022] GET /identity/v3/projects/800fd3f014a34a398360e81d05e79023 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:32:58.134275 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49feffd4-b2a3-431c-8436-e0d063515d62 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:32:58.175107 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:32:58.230545 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49feffd4-b2a3-431c-8436-e0d063515d62 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:32:58.263796 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f17aa5-6765-4ebc-92aa-70620f69e366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:32:58.264376 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f17aa5-6765-4ebc-92aa-70620f69e366 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:32:58.264654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f17aa5-6765-4ebc-92aa-70620f69e366 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:32:58.264924 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f17aa5-6765-4ebc-92aa-70620f69e366 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:32:58.265659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f17aa5-6765-4ebc-92aa-70620f69e366 None admin] RBAC: Adding query filter params (role.id=1c9b176504fd4d24b34942f724e63acf, scope.project.id=800fd3f014a34a398360e81d05e79023, user.id=756b33ca0e544d91b074fba0b624b4e7) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:32:58.265965 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f17aa5-6765-4ebc-92aa-70620f69e366 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:32:58.267363 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f17aa5-6765-4ebc-92aa-70620f69e366 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:32:58.272492 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 573/1117] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:32:58 2022] GET /identity/v3/role_assignments?user.id=756b33ca0e544d91b074fba0b624b4e7&scope.project.id=800fd3f014a34a398360e81d05e79023&role.id=1c9b176504fd4d24b34942f724e63acf => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:00.385257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e3b2a-94da-4156-8b22-9d54540fb325 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:00.385704 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e3b2a-94da-4156-8b22-9d54540fb325 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:00.385792 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e3b2a-94da-4156-8b22-9d54540fb325 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:00.387112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 545/1118] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:33:00.392147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed4197-0ab4-4e2c-bce6-34c1e57ea7e7 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:00.392584 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed4197-0ab4-4e2c-bce6-34c1e57ea7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:00.392687 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed4197-0ab4-4e2c-bce6-34c1e57ea7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:00.410938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f8ed4197-0ab4-4e2c-bce6-34c1e57ea7e7 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:33:00.412090 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f8ed4197-0ab4-4e2c-bce6-34c1e57ea7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:33:00.475958 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 574/1119] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:33:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 00:33:00.744272 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e3b2a-94da-4156-8b22-9d54540fb325 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:00.840483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e3b2a-94da-4156-8b22-9d54540fb325 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:00.873426 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de3971-e8ff-4511-a1f5-f5d165768107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:00.874032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de3971-e8ff-4511-a1f5-f5d165768107 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:00.874302 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de3971-e8ff-4511-a1f5-f5d165768107 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:00.874567 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de3971-e8ff-4511-a1f5-f5d165768107 None admin] PATH_INFO: `/v3/roles/1c9b176504fd4d24b34942f724e63acf` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:00.875917 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de3971-e8ff-4511-a1f5-f5d165768107 None admin] RBAC: Authorizing `identity:get_role(role_id=1c9b176504fd4d24b34942f724e63acf)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:00.877296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de3971-e8ff-4511-a1f5-f5d165768107 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:00.878559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 546/1120] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:33:00 2022] GET /identity/v3/roles/1c9b176504fd4d24b34942f724e63acf => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:00.884620 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed4197-0ab4-4e2c-bce6-34c1e57ea7e7 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:00.917210 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:00.980400 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed4197-0ab4-4e2c-bce6-34c1e57ea7e7 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:01.013580 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca85057-af37-4638-b21f-49f33f55a90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:01.014256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca85057-af37-4638-b21f-49f33f55a90b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:01.014693 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca85057-af37-4638-b21f-49f33f55a90b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:01.015147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca85057-af37-4638-b21f-49f33f55a90b None admin] PATH_INFO: `/v3/users/756b33ca0e544d91b074fba0b624b4e7` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:01.016856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca85057-af37-4638-b21f-49f33f55a90b None admin] RBAC: Authorizing `identity:get_user(user_id=756b33ca0e544d91b074fba0b624b4e7)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:01.019916 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca85057-af37-4638-b21f-49f33f55a90b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:01.022266 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 575/1121] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:33:00 2022] GET /identity/v3/users/756b33ca0e544d91b074fba0b624b4e7 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:01.028104 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de3971-e8ff-4511-a1f5-f5d165768107 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:01.045617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:01.123721 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de3971-e8ff-4511-a1f5-f5d165768107 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:01.157528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fdef9-7551-44a6-9f31-d9bf7968b90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:01.158135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fdef9-7551-44a6-9f31-d9bf7968b90e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:01.158410 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fdef9-7551-44a6-9f31-d9bf7968b90e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:01.158680 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fdef9-7551-44a6-9f31-d9bf7968b90e None admin] PATH_INFO: `/v3/projects/800fd3f014a34a398360e81d05e79023` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:01.159766 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fdef9-7551-44a6-9f31-d9bf7968b90e None admin] RBAC: Authorizing `identity:get_project(project_id=800fd3f014a34a398360e81d05e79023)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:01.161245 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fdef9-7551-44a6-9f31-d9bf7968b90e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:01.162840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 547/1122] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:33:01 2022] GET /identity/v3/projects/800fd3f014a34a398360e81d05e79023 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:01.168926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca85057-af37-4638-b21f-49f33f55a90b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:01.269226 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca85057-af37-4638-b21f-49f33f55a90b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:01.270662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:01.303117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68092668-6b78-4ac4-86fc-fc3c70efe6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:01.303759 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68092668-6b78-4ac4-86fc-fc3c70efe6be None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:01.304043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68092668-6b78-4ac4-86fc-fc3c70efe6be None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:01.304315 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68092668-6b78-4ac4-86fc-fc3c70efe6be None admin] PATH_INFO: `/v3/projects/800fd3f014a34a398360e81d05e79023/users/756b33ca0e544d91b074fba0b624b4e7/roles/1c9b176504fd4d24b34942f724e63acf` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:01.306472 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68092668-6b78-4ac4-86fc-fc3c70efe6be None admin] RBAC: Authorizing `identity:create_grant(project_id=800fd3f014a34a398360e81d05e79023, user_id=756b33ca0e544d91b074fba0b624b4e7, role_id=1c9b176504fd4d24b34942f724e63acf)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:01.307890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68092668-6b78-4ac4-86fc-fc3c70efe6be None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:01.320341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 576/1123] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:33:01 2022] PUT /identity/v3/projects/800fd3f014a34a398360e81d05e79023/users/756b33ca0e544d91b074fba0b624b4e7/roles/1c9b176504fd4d24b34942f724e63acf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:33:03.439412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205aa81e-584f-462c-9e9b-9ffaa5d864e0 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:03.439923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205aa81e-584f-462c-9e9b-9ffaa5d864e0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:03.440008 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205aa81e-584f-462c-9e9b-9ffaa5d864e0 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:03.441338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 548/1124] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:33:03.446459 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade76db-bed3-41a2-a1fd-2b3cb74bce03 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:03.446826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade76db-bed3-41a2-a1fd-2b3cb74bce03 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:03.447011 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade76db-bed3-41a2-a1fd-2b3cb74bce03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:03.465214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-4ade76db-bed3-41a2-a1fd-2b3cb74bce03 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:33:03.466381 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4ade76db-bed3-41a2-a1fd-2b3cb74bce03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:33:03.529916 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 577/1125] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:33:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:33:03.800156 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205aa81e-584f-462c-9e9b-9ffaa5d864e0 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:03.883204 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:03.901190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205aa81e-584f-462c-9e9b-9ffaa5d864e0 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:03.934970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3049649-5ce6-47e4-ae6f-19859440c2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:03.935583 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3049649-5ce6-47e4-ae6f-19859440c2bc None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:03.935860 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3049649-5ce6-47e4-ae6f-19859440c2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:03.936130 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3049649-5ce6-47e4-ae6f-19859440c2bc None admin] PATH_INFO: `/v3/roles/1c9b176504fd4d24b34942f724e63acf` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:03.937526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3049649-5ce6-47e4-ae6f-19859440c2bc None admin] RBAC: Authorizing `identity:get_role(role_id=1c9b176504fd4d24b34942f724e63acf)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:03.938895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3049649-5ce6-47e4-ae6f-19859440c2bc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:03.940187 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 549/1126] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:33:03 2022] GET /identity/v3/roles/1c9b176504fd4d24b34942f724e63acf => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:03.945961 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade76db-bed3-41a2-a1fd-2b3cb74bce03 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:04.032638 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:04.042151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade76db-bed3-41a2-a1fd-2b3cb74bce03 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:04.074727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffeae6-0129-4013-816f-f2e4ca1fb9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:04.075341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffeae6-0129-4013-816f-f2e4ca1fb9ff None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:04.075621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffeae6-0129-4013-816f-f2e4ca1fb9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:04.075891 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffeae6-0129-4013-816f-f2e4ca1fb9ff None admin] PATH_INFO: `/v3/users/756b33ca0e544d91b074fba0b624b4e7` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:04.076987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffeae6-0129-4013-816f-f2e4ca1fb9ff None admin] RBAC: Authorizing `identity:get_user(user_id=756b33ca0e544d91b074fba0b624b4e7)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:04.078425 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffeae6-0129-4013-816f-f2e4ca1fb9ff None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:04.079958 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 578/1127] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:33:03 2022] GET /identity/v3/users/756b33ca0e544d91b074fba0b624b4e7 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:04.085769 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3049649-5ce6-47e4-ae6f-19859440c2bc None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:04.183294 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3049649-5ce6-47e4-ae6f-19859440c2bc None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:04.215669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc26b6-2338-41cd-99e2-4332a1b72b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:04.216255 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc26b6-2338-41cd-99e2-4332a1b72b20 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:04.216532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc26b6-2338-41cd-99e2-4332a1b72b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:04.216803 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc26b6-2338-41cd-99e2-4332a1b72b20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:04.237581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:04.284739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc26b6-2338-41cd-99e2-4332a1b72b20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:04.286705 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc26b6-2338-41cd-99e2-4332a1b72b20 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:04.380676 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 550/1128] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:33:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 00:33:04.386604 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffeae6-0129-4013-816f-f2e4ca1fb9ff None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:04.483211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffeae6-0129-4013-816f-f2e4ca1fb9ff None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:04.515358 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c120d-a6f2-4cc8-993c-d846247cabbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:04.515963 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c120d-a6f2-4cc8-993c-d846247cabbf None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:04.516238 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c120d-a6f2-4cc8-993c-d846247cabbf None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:04.516504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c120d-a6f2-4cc8-993c-d846247cabbf None admin] PATH_INFO: `/v3/projects/800fd3f014a34a398360e81d05e79023` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:04.517610 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c120d-a6f2-4cc8-993c-d846247cabbf None admin] RBAC: Authorizing `identity:get_project(project_id=800fd3f014a34a398360e81d05e79023)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:04.519545 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c120d-a6f2-4cc8-993c-d846247cabbf None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:04.521121 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 579/1129] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:33:04 2022] GET /identity/v3/projects/800fd3f014a34a398360e81d05e79023 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:04.527271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc26b6-2338-41cd-99e2-4332a1b72b20 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:04.583760 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:04.630609 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc26b6-2338-41cd-99e2-4332a1b72b20 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:04.663387 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38fc04-3ef8-40f8-88b1-4cecb4edac67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:04.663978 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38fc04-3ef8-40f8-88b1-4cecb4edac67 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:04.664258 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38fc04-3ef8-40f8-88b1-4cecb4edac67 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:04.664533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38fc04-3ef8-40f8-88b1-4cecb4edac67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:04.665283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38fc04-3ef8-40f8-88b1-4cecb4edac67 None admin] RBAC: Adding query filter params (role.id=1c9b176504fd4d24b34942f724e63acf, scope.project.id=800fd3f014a34a398360e81d05e79023, user.id=756b33ca0e544d91b074fba0b624b4e7) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:33:04.665596 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38fc04-3ef8-40f8-88b1-4cecb4edac67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:04.667028 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38fc04-3ef8-40f8-88b1-4cecb4edac67 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:04.672591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 551/1130] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:33:04 2022] GET /identity/v3/role_assignments?user.id=756b33ca0e544d91b074fba0b624b4e7&scope.project.id=800fd3f014a34a398360e81d05e79023&role.id=1c9b176504fd4d24b34942f724e63acf => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:06.827799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d54319-1ef5-4fe8-8750-0955d85ea933 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:06.828306 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d54319-1ef5-4fe8-8750-0955d85ea933 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:06.828397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d54319-1ef5-4fe8-8750-0955d85ea933 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:06.829689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 580/1131] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:33:06.835418 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1727e-04cf-4cb8-a5b6-05024b4f0055 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:06.835814 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1727e-04cf-4cb8-a5b6-05024b4f0055 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:06.835962 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1727e-04cf-4cb8-a5b6-05024b4f0055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:06.854277 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e4d1727e-04cf-4cb8-a5b6-05024b4f0055 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:33:06.855443 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e4d1727e-04cf-4cb8-a5b6-05024b4f0055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:33:06.919379 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 552/1132] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:33:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:33:07.183680 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d54319-1ef5-4fe8-8750-0955d85ea933 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:07.211210 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:07.283227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d54319-1ef5-4fe8-8750-0955d85ea933 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:07.316434 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837b706-0ead-4a90-bd99-96b9322da88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:07.317043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837b706-0ead-4a90-bd99-96b9322da88b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:07.317354 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837b706-0ead-4a90-bd99-96b9322da88b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:07.317623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837b706-0ead-4a90-bd99-96b9322da88b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:07.318714 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837b706-0ead-4a90-bd99-96b9322da88b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:07.320140 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837b706-0ead-4a90-bd99-96b9322da88b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:07.321736 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 581/1133] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:33:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:07.327485 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1727e-04cf-4cb8-a5b6-05024b4f0055 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:07.372290 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:07.423410 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1727e-04cf-4cb8-a5b6-05024b4f0055 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:07.455458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca819b39-2daf-4bde-a84e-4f62699db57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:07.455987 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca819b39-2daf-4bde-a84e-4f62699db57b None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:07.456331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca819b39-2daf-4bde-a84e-4f62699db57b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:07.457143 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca819b39-2daf-4bde-a84e-4f62699db57b None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:07.457790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca819b39-2daf-4bde-a84e-4f62699db57b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:07.459211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca819b39-2daf-4bde-a84e-4f62699db57b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:07.484222 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 553/1134] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 15 00:33:07 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:33:09.655878 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e27fb-7106-4373-9c32-2b2a91809774 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:09.656406 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e27fb-7106-4373-9c32-2b2a91809774 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:09.656406 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e27fb-7106-4373-9c32-2b2a91809774 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:09.657708 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 582/1135] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:33:09.663457 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94e2e5-d355-4cdc-a323-b101a7db9fe8 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:09.663877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94e2e5-d355-4cdc-a323-b101a7db9fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:09.664009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94e2e5-d355-4cdc-a323-b101a7db9fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:09.682347 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-cc94e2e5-d355-4cdc-a323-b101a7db9fe8 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:33:09.683517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cc94e2e5-d355-4cdc-a323-b101a7db9fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:33:09.747528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 554/1136] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:33:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:33:10.017173 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e27fb-7106-4373-9c32-2b2a91809774 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:10.109661 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:10.116468 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e27fb-7106-4373-9c32-2b2a91809774 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:10.148863 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e48867-b52d-4edb-ba82-421bc47f6250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:10.149499 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e48867-b52d-4edb-ba82-421bc47f6250 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:10.149775 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e48867-b52d-4edb-ba82-421bc47f6250 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:10.150043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e48867-b52d-4edb-ba82-421bc47f6250 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:10.151138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e48867-b52d-4edb-ba82-421bc47f6250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:10.152542 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e48867-b52d-4edb-ba82-421bc47f6250 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:10.154102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 583/1137] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:33:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:10.160346 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94e2e5-d355-4cdc-a323-b101a7db9fe8 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:10.186749 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:10.256222 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94e2e5-d355-4cdc-a323-b101a7db9fe8 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:10.289599 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7ab07-36db-49f4-b1c3-f608480b24aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:10.290122 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7ab07-36db-49f4-b1c3-f608480b24aa None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:10.290398 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7ab07-36db-49f4-b1c3-f608480b24aa None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:10.290667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7ab07-36db-49f4-b1c3-f608480b24aa None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:10.291318 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7ab07-36db-49f4-b1c3-f608480b24aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:10.292747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7ab07-36db-49f4-b1c3-f608480b24aa None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:10.312473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 555/1138] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 15 00:33:10 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:33:12.464545 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c13d81-7f0e-44a6-9413-de6f5b09200f None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:12.465138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c13d81-7f0e-44a6-9413-de6f5b09200f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:12.465138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c13d81-7f0e-44a6-9413-de6f5b09200f None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:12.466443 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 584/1139] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:33:12.473132 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88411d-012a-40ce-ae1b-60035308c946 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:12.473579 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88411d-012a-40ce-ae1b-60035308c946 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:12.473682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88411d-012a-40ce-ae1b-60035308c946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:12.492743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2f88411d-012a-40ce-ae1b-60035308c946 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:33:12.493955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2f88411d-012a-40ce-ae1b-60035308c946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:33:12.557650 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 556/1140] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:33:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 00:33:12.825661 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c13d81-7f0e-44a6-9413-de6f5b09200f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:12.923791 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c13d81-7f0e-44a6-9413-de6f5b09200f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:12.957027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304cc2e-0ab6-4514-a9a8-f4a67cd457fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:12.957655 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304cc2e-0ab6-4514-a9a8-f4a67cd457fd None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:12.957934 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304cc2e-0ab6-4514-a9a8-f4a67cd457fd None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:12.958204 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304cc2e-0ab6-4514-a9a8-f4a67cd457fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:12.967866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304cc2e-0ab6-4514-a9a8-f4a67cd457fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:33:12.972630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-4304cc2e-0ab6-4514-a9a8-f4a67cd457fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:33:12.972630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:33:12.972630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:33:12.972630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:33:12.972630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:33:12.972630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:33:12.972630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:33:12.972630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:33:12.972630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:33:12.972630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:33:12.972630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:33:12.972630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:33:12.972630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:33:12.972630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:33:12.972630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:33:12.972630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:33:12.973788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:33:12.973788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:33:12.973788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:33:12.973788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:33:12.973788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:33:12.973788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:33:12.973788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:33:12.973788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:33:12.973788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:33:12.973788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:33:12.973788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:33:12.973788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:33:12.973788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:33:12.973788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:33:12.973788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:33:12.973788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:33:12.974814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:33:12.974814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:33:12.974814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:33:12.974814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:33:12.974814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:33:12.974814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:33:12.974814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:33:12.974814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:33:12.974814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:33:12.974814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:33:12.974814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:33:12.974814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:33:12.974814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 585/1141] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:33:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:33:12.979485 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88411d-012a-40ce-ae1b-60035308c946 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:12.994686 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:13.076536 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88411d-012a-40ce-ae1b-60035308c946 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:13.108510 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9a6bd-9d23-40b8-8890-928462e7de53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:13.109118 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9a6bd-9d23-40b8-8890-928462e7de53 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:13.109408 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9a6bd-9d23-40b8-8890-928462e7de53 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:13.109676 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9a6bd-9d23-40b8-8890-928462e7de53 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:13.110328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9a6bd-9d23-40b8-8890-928462e7de53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:33:13.110667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9a6bd-9d23-40b8-8890-928462e7de53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:13.112013 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9a6bd-9d23-40b8-8890-928462e7de53 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:13.120126 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 557/1142] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:33:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:33:13.126086 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304cc2e-0ab6-4514-a9a8-f4a67cd457fd None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:13.151415 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:13.223894 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304cc2e-0ab6-4514-a9a8-f4a67cd457fd None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:13.257378 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b858048-0885-43e3-a93e-b006b3097bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:13.257986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b858048-0885-43e3-a93e-b006b3097bdd None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:13.258267 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b858048-0885-43e3-a93e-b006b3097bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:13.258539 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b858048-0885-43e3-a93e-b006b3097bdd None admin] PATH_INFO: `/v3/users/7a732cdc955746be86c85e1240115e86` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:13.271100 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b858048-0885-43e3-a93e-b006b3097bdd None admin] RBAC: Authorizing `identity:get_user(user_id=7a732cdc955746be86c85e1240115e86)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:13.272529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b858048-0885-43e3-a93e-b006b3097bdd None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:13.274190 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 586/1143] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:33:13 2022] GET /identity/v3/users/7a732cdc955746be86c85e1240115e86 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:13.279812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9a6bd-9d23-40b8-8890-928462e7de53 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:13.355848 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:13.379350 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9a6bd-9d23-40b8-8890-928462e7de53 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:13.411546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97326030-5b60-4086-aca5-f632306df82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:13.412138 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97326030-5b60-4086-aca5-f632306df82c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:13.412417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97326030-5b60-4086-aca5-f632306df82c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:13.412687 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97326030-5b60-4086-aca5-f632306df82c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:13.476166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97326030-5b60-4086-aca5-f632306df82c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:13.477636 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97326030-5b60-4086-aca5-f632306df82c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:13.548677 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:13.571850 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 558/1144] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:33:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 00:33:13.577777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b858048-0885-43e3-a93e-b006b3097bdd None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:13.657661 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:13.675569 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b858048-0885-43e3-a93e-b006b3097bdd None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:13.707942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0fc6c-12bf-4142-9cb6-dce1a0bbc855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:13.708558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0fc6c-12bf-4142-9cb6-dce1a0bbc855 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:13.708835 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0fc6c-12bf-4142-9cb6-dce1a0bbc855 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:13.709128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0fc6c-12bf-4142-9cb6-dce1a0bbc855 None admin] PATH_INFO: `/v3/projects/722b5dc12425402f9dfa91a5f5ea0297` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:13.710233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0fc6c-12bf-4142-9cb6-dce1a0bbc855 None admin] RBAC: Authorizing `identity:get_project(project_id=722b5dc12425402f9dfa91a5f5ea0297)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:13.711633 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0fc6c-12bf-4142-9cb6-dce1a0bbc855 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:13.713224 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 587/1145] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:33:13 2022] GET /identity/v3/projects/722b5dc12425402f9dfa91a5f5ea0297 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:13.719238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97326030-5b60-4086-aca5-f632306df82c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:13.814423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97326030-5b60-4086-aca5-f632306df82c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:13.849782 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4729cb-dc76-4bd0-b921-8edf9f352851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:13.850376 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4729cb-dc76-4bd0-b921-8edf9f352851 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:13.850654 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4729cb-dc76-4bd0-b921-8edf9f352851 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:13.850924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4729cb-dc76-4bd0-b921-8edf9f352851 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:13.851636 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4729cb-dc76-4bd0-b921-8edf9f352851 None admin] RBAC: Adding query filter params (role.id=0ee2daa9cb3c41fb901603e3d8caf784, scope.project.id=722b5dc12425402f9dfa91a5f5ea0297, user.id=7a732cdc955746be86c85e1240115e86) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:33:13.851942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4729cb-dc76-4bd0-b921-8edf9f352851 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:13.853388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4729cb-dc76-4bd0-b921-8edf9f352851 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:13.858950 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 559/1146] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:33:13 2022] GET /identity/v3/role_assignments?user.id=7a732cdc955746be86c85e1240115e86&scope.project.id=722b5dc12425402f9dfa91a5f5ea0297&role.id=0ee2daa9cb3c41fb901603e3d8caf784 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:15.958951 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d3572-9d6b-49f4-bfae-bcccfb84143f None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:15.959523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d3572-9d6b-49f4-bfae-bcccfb84143f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:15.959523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d3572-9d6b-49f4-bfae-bcccfb84143f None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:15.960829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 588/1147] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:33:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:33:15.966010 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22942dcf-073e-46e5-b165-6286470fac12 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:15.966415 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22942dcf-073e-46e5-b165-6286470fac12 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:15.966553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22942dcf-073e-46e5-b165-6286470fac12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:15.984539 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-22942dcf-073e-46e5-b165-6286470fac12 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:33:15.985757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-22942dcf-073e-46e5-b165-6286470fac12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:33:16.019461 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:16.052212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 560/1148] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:33:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:33:16.338289 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d3572-9d6b-49f4-bfae-bcccfb84143f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:16.442447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d3572-9d6b-49f4-bfae-bcccfb84143f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:16.475720 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59439c30-816e-4a52-986c-e0c7f24ae85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:16.476341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59439c30-816e-4a52-986c-e0c7f24ae85a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:16.476619 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59439c30-816e-4a52-986c-e0c7f24ae85a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:16.476889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59439c30-816e-4a52-986c-e0c7f24ae85a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:16.487044 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59439c30-816e-4a52-986c-e0c7f24ae85a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:33:16.491790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-59439c30-816e-4a52-986c-e0c7f24ae85a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:33:16.491790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:33:16.491790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:33:16.491790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:33:16.491790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:33:16.491790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:33:16.491790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:33:16.491790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:33:16.491790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:33:16.491790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:33:16.491790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:33:16.491790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:33:16.491790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:33:16.491790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:33:16.491790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:33:16.491790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:33:16.493624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:33:16.493624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:33:16.493624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:33:16.493624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:33:16.493624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:33:16.493624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:33:16.493624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:33:16.493624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:33:16.493624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:33:16.493624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:33:16.493624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:33:16.493624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:33:16.493624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:33:16.493624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:33:16.493624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:33:16.493624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:33:16.494845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:33:16.494845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:33:16.494845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:33:16.494845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:33:16.494845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:33:16.494845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:33:16.494845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:33:16.494845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:33:16.494845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:33:16.494845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:33:16.494845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:33:16.494845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:33:16.494845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 589/1149] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:33:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:33:16.498980 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22942dcf-073e-46e5-b165-6286470fac12 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:16.598099 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22942dcf-073e-46e5-b165-6286470fac12 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:16.635477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1ec8b-9db0-4713-8a5f-e5cd84b1e867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:16.636088 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1ec8b-9db0-4713-8a5f-e5cd84b1e867 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:16.636365 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1ec8b-9db0-4713-8a5f-e5cd84b1e867 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:16.636635 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1ec8b-9db0-4713-8a5f-e5cd84b1e867 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:16.637314 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1ec8b-9db0-4713-8a5f-e5cd84b1e867 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:33:16.637614 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1ec8b-9db0-4713-8a5f-e5cd84b1e867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:16.638970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1ec8b-9db0-4713-8a5f-e5cd84b1e867 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:16.647605 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 561/1150] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:33:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:16.653466 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59439c30-816e-4a52-986c-e0c7f24ae85a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:16.666053 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:16.751121 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59439c30-816e-4a52-986c-e0c7f24ae85a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:16.783634 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7159815-770e-480d-b015-daeecc094fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:16.784289 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7159815-770e-480d-b015-daeecc094fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:16.784565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7159815-770e-480d-b015-daeecc094fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:16.784833 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7159815-770e-480d-b015-daeecc094fd7 None admin] PATH_INFO: `/v3/users/7a732cdc955746be86c85e1240115e86` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:16.785962 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7159815-770e-480d-b015-daeecc094fd7 None admin] RBAC: Authorizing `identity:get_user(user_id=7a732cdc955746be86c85e1240115e86)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:16.787368 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7159815-770e-480d-b015-daeecc094fd7 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:16.788896 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 590/1151] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:33:16 2022] GET /identity/v3/users/7a732cdc955746be86c85e1240115e86 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:16.794613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1ec8b-9db0-4713-8a5f-e5cd84b1e867 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:16.825740 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:16.893372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1ec8b-9db0-4713-8a5f-e5cd84b1e867 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:16.925740 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b21e0-7965-4cd4-98e6-bcc7f60ab883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:16.926348 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b21e0-7965-4cd4-98e6-bcc7f60ab883 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:16.926625 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b21e0-7965-4cd4-98e6-bcc7f60ab883 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:16.926894 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b21e0-7965-4cd4-98e6-bcc7f60ab883 None admin] PATH_INFO: `/v3/projects/722b5dc12425402f9dfa91a5f5ea0297` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:16.927986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b21e0-7965-4cd4-98e6-bcc7f60ab883 None admin] RBAC: Authorizing `identity:get_project(project_id=722b5dc12425402f9dfa91a5f5ea0297)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:16.929423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b21e0-7965-4cd4-98e6-bcc7f60ab883 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:16.931016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 562/1152] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:33:16 2022] GET /identity/v3/projects/722b5dc12425402f9dfa91a5f5ea0297 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:16.936810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7159815-770e-480d-b015-daeecc094fd7 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:17.012056 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:17.033203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7159815-770e-480d-b015-daeecc094fd7 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:17.066087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8730fb-8ddb-42ac-ae4b-c37f00093d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:17.066712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8730fb-8ddb-42ac-ae4b-c37f00093d39 None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:17.066985 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8730fb-8ddb-42ac-ae4b-c37f00093d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:17.067251 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8730fb-8ddb-42ac-ae4b-c37f00093d39 None admin] PATH_INFO: `/v3/projects/722b5dc12425402f9dfa91a5f5ea0297/users/7a732cdc955746be86c85e1240115e86/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:17.069119 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8730fb-8ddb-42ac-ae4b-c37f00093d39 None admin] RBAC: Authorizing `identity:create_grant(project_id=722b5dc12425402f9dfa91a5f5ea0297, user_id=7a732cdc955746be86c85e1240115e86, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:17.070528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8730fb-8ddb-42ac-ae4b-c37f00093d39 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:17.083561 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 591/1153] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:33:16 2022] PUT /identity/v3/projects/722b5dc12425402f9dfa91a5f5ea0297/users/7a732cdc955746be86c85e1240115e86/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:33:19.187246 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4a8df-92e2-4710-b994-0b4ad6d7ec82 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:19.187792 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4a8df-92e2-4710-b994-0b4ad6d7ec82 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:19.187792 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4a8df-92e2-4710-b994-0b4ad6d7ec82 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:19.189143 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 563/1154] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:33:19.194441 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0266dfa-1065-4543-bfb2-699fb6d0abc2 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:19.194866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0266dfa-1065-4543-bfb2-699fb6d0abc2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:19.194977 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0266dfa-1065-4543-bfb2-699fb6d0abc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:19.213408 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-d0266dfa-1065-4543-bfb2-699fb6d0abc2 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:33:19.214582 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d0266dfa-1065-4543-bfb2-699fb6d0abc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:33:19.278986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 592/1155] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:33:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:33:19.549402 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4a8df-92e2-4710-b994-0b4ad6d7ec82 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:19.647139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:19.651201 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4a8df-92e2-4710-b994-0b4ad6d7ec82 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:19.683842 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ff460-7785-4a46-9822-ca30e4923404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:19.684451 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ff460-7785-4a46-9822-ca30e4923404 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:19.684727 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ff460-7785-4a46-9822-ca30e4923404 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:19.684995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ff460-7785-4a46-9822-ca30e4923404 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:19.695355 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ff460-7785-4a46-9822-ca30e4923404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:33:19.700146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-6f0ff460-7785-4a46-9822-ca30e4923404 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:33:19.700146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:33:19.700146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:33:19.700146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:33:19.700146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:33:19.700146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:33:19.700146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:33:19.700146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:33:19.700146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:33:19.700146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:33:19.700146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:33:19.700146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:33:19.700146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:33:19.700146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:33:19.700146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:33:19.700146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:33:19.701340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:33:19.701340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:33:19.701340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:33:19.701340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:33:19.701340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:33:19.701340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:33:19.701340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:33:19.701340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:33:19.701340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:33:19.701340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:33:19.701340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:33:19.701340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:33:19.701340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:33:19.701340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:33:19.701340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:33:19.701340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:33:19.702257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:33:19.702257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:33:19.702257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:33:19.702257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:33:19.702257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:33:19.702257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:33:19.702257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:33:19.702257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:33:19.702257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:33:19.702257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:33:19.702257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:33:19.702257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:33:19.702257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 564/1156] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:33:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:33:19.707336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0266dfa-1065-4543-bfb2-699fb6d0abc2 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:19.771825 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:19.804607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0266dfa-1065-4543-bfb2-699fb6d0abc2 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:19.837681 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf4766-ef2d-4520-8b87-d24e37b88692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:19.838267 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf4766-ef2d-4520-8b87-d24e37b88692 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:19.838543 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf4766-ef2d-4520-8b87-d24e37b88692 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:19.838811 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf4766-ef2d-4520-8b87-d24e37b88692 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:19.839457 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf4766-ef2d-4520-8b87-d24e37b88692 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:33:19.839756 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf4766-ef2d-4520-8b87-d24e37b88692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:19.841117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf4766-ef2d-4520-8b87-d24e37b88692 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:19.848793 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 593/1157] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:33:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:19.854684 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ff460-7785-4a46-9822-ca30e4923404 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:19.955749 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ff460-7785-4a46-9822-ca30e4923404 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:19.991126 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c824af-bc4c-4f8b-80e4-90f34a4e221f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:19.991729 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c824af-bc4c-4f8b-80e4-90f34a4e221f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:19.992010 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c824af-bc4c-4f8b-80e4-90f34a4e221f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:19.992278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c824af-bc4c-4f8b-80e4-90f34a4e221f None admin] PATH_INFO: `/v3/users/7a732cdc955746be86c85e1240115e86` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:19.993398 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c824af-bc4c-4f8b-80e4-90f34a4e221f None admin] RBAC: Authorizing `identity:get_user(user_id=7a732cdc955746be86c85e1240115e86)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:19.994823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c824af-bc4c-4f8b-80e4-90f34a4e221f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:19.996380 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 565/1158] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:33:19 2022] GET /identity/v3/users/7a732cdc955746be86c85e1240115e86 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:20.002185 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf4766-ef2d-4520-8b87-d24e37b88692 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:20.098987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf4766-ef2d-4520-8b87-d24e37b88692 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:20.125988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:20.131835 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd1eac-e641-446f-87a4-02cacce801f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:20.132419 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd1eac-e641-446f-87a4-02cacce801f5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:20.132695 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd1eac-e641-446f-87a4-02cacce801f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:20.132959 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd1eac-e641-446f-87a4-02cacce801f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:20.196406 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd1eac-e641-446f-87a4-02cacce801f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:20.197848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd1eac-e641-446f-87a4-02cacce801f5 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:20.290519 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 594/1159] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:33:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 00:33:20.296514 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c824af-bc4c-4f8b-80e4-90f34a4e221f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:20.324437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:20.394834 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c824af-bc4c-4f8b-80e4-90f34a4e221f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:20.427181 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cf467-71e2-430a-a773-b108617a8845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:20.427799 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cf467-71e2-430a-a773-b108617a8845 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:20.428077 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cf467-71e2-430a-a773-b108617a8845 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:20.428346 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cf467-71e2-430a-a773-b108617a8845 None admin] PATH_INFO: `/v3/projects/722b5dc12425402f9dfa91a5f5ea0297` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:20.429475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cf467-71e2-430a-a773-b108617a8845 None admin] RBAC: Authorizing `identity:get_project(project_id=722b5dc12425402f9dfa91a5f5ea0297)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:20.430899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cf467-71e2-430a-a773-b108617a8845 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:20.432513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 566/1160] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:33:20 2022] GET /identity/v3/projects/722b5dc12425402f9dfa91a5f5ea0297 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:20.438791 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd1eac-e641-446f-87a4-02cacce801f5 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:20.467759 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:20.535995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd1eac-e641-446f-87a4-02cacce801f5 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:20.568237 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f909ec3-a152-41f7-8640-d848fdd637ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:20.568817 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f909ec3-a152-41f7-8640-d848fdd637ae None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:20.569109 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f909ec3-a152-41f7-8640-d848fdd637ae None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:20.569388 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f909ec3-a152-41f7-8640-d848fdd637ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:20.570089 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f909ec3-a152-41f7-8640-d848fdd637ae None admin] RBAC: Adding query filter params (role.id=0ee2daa9cb3c41fb901603e3d8caf784, scope.project.id=722b5dc12425402f9dfa91a5f5ea0297, user.id=7a732cdc955746be86c85e1240115e86) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:33:20.570391 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f909ec3-a152-41f7-8640-d848fdd637ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:20.571772 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f909ec3-a152-41f7-8640-d848fdd637ae None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:20.577323 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 595/1161] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:33:20 2022] GET /identity/v3/role_assignments?user.id=7a732cdc955746be86c85e1240115e86&scope.project.id=722b5dc12425402f9dfa91a5f5ea0297&role.id=0ee2daa9cb3c41fb901603e3d8caf784 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:22.730124 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc6d0c-ef0d-40c6-aeec-956dc12460db None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:22.730618 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc6d0c-ef0d-40c6-aeec-956dc12460db None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:22.730618 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc6d0c-ef0d-40c6-aeec-956dc12460db None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:22.732192 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 567/1162] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:33:22.737315 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547188cd-9781-40b5-adcb-ed526340630e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:22.737730 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547188cd-9781-40b5-adcb-ed526340630e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:22.737902 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547188cd-9781-40b5-adcb-ed526340630e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:22.755752 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-547188cd-9781-40b5-adcb-ed526340630e None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:33:22.756930 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-547188cd-9781-40b5-adcb-ed526340630e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:33:22.823481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 596/1163] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:33:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:33:23.090240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc6d0c-ef0d-40c6-aeec-956dc12460db None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:23.181060 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:23.187749 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc6d0c-ef0d-40c6-aeec-956dc12460db None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:23.220752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f879b-f6a9-4dce-a08c-9fc610dd70ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:23.221361 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f879b-f6a9-4dce-a08c-9fc610dd70ce None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:23.221640 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f879b-f6a9-4dce-a08c-9fc610dd70ce None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:23.221909 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f879b-f6a9-4dce-a08c-9fc610dd70ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:23.287104 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f879b-f6a9-4dce-a08c-9fc610dd70ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:23.288538 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f879b-f6a9-4dce-a08c-9fc610dd70ce None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:23.377236 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:23.384642 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 568/1164] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:33:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 00:33:23.390428 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547188cd-9781-40b5-adcb-ed526340630e None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:23.414047 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:23.486677 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547188cd-9781-40b5-adcb-ed526340630e None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:23.519999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80164673-2d23-4e0a-b411-8eff73059ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:23.520610 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80164673-2d23-4e0a-b411-8eff73059ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:23.520889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80164673-2d23-4e0a-b411-8eff73059ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:23.521195 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80164673-2d23-4e0a-b411-8eff73059ae9 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:23.527673 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80164673-2d23-4e0a-b411-8eff73059ae9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:23.529108 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80164673-2d23-4e0a-b411-8eff73059ae9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:23.540987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-80164673-2d23-4e0a-b411-8eff73059ae9 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 15 00:33:23.540987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:33:23.540987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 15 00:33:23.540987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 15 00:33:23.540987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:33:23.540987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:33:23.540987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:33:23.540987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:33:23.540987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 15 00:33:23.540987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:33:23.540987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:33:23.540987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:33:23.540987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:33:23.540987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:33:23.540987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:33:23.540987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:33:23.540987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:33:23.542177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:33:23.542177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:33:23.542177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:33:23.542177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:33:23.542177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:33:23.542177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:33:23.542177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:33:23.542177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:33:23.542177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:33:23.542177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:33:23.542177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:33:23.542177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:33:23.542177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:33:23.542177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:33:23.542177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:33:23.542177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:33:23.543031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:33:23.543031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:33:23.543031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:33:23.543031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:33:23.543031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:33:23.543031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:33:23.543031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:33:23.543031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:33:23.543031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:33:23.543031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:33:23.543031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 15 00:33:23.543031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:33:23.543031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 15 00:33:23.543031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:33:23.543031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 597/1165] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Sep 15 00:33:23 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:33:23.548010 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f879b-f6a9-4dce-a08c-9fc610dd70ce None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:23.643003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f879b-f6a9-4dce-a08c-9fc610dd70ce None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:23.674665 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1071f70-8b98-47f0-a06a-443af5aee6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:23.675765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1071f70-8b98-47f0-a06a-443af5aee6ad None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:23.676042 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1071f70-8b98-47f0-a06a-443af5aee6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:23.676312 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1071f70-8b98-47f0-a06a-443af5aee6ad None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:23.676940 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1071f70-8b98-47f0-a06a-443af5aee6ad None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:33:23.677269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1071f70-8b98-47f0-a06a-443af5aee6ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:23.678627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1071f70-8b98-47f0-a06a-443af5aee6ad None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:23.685449 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 569/1166] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Sep 15 00:33:23 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:25.803294 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e092bb5-2fb2-42eb-89c8-0ca776d80cad None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:25.803809 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e092bb5-2fb2-42eb-89c8-0ca776d80cad None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:25.803809 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e092bb5-2fb2-42eb-89c8-0ca776d80cad None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:25.805071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 598/1167] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:33:25.810335 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c570e1-14f5-4de9-9a7f-c37934f8cfc8 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:25.810716 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c570e1-14f5-4de9-9a7f-c37934f8cfc8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:25.810877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c570e1-14f5-4de9-9a7f-c37934f8cfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:25.829236 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-47c570e1-14f5-4de9-9a7f-c37934f8cfc8 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:33:25.830401 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-47c570e1-14f5-4de9-9a7f-c37934f8cfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:33:25.883984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:25.895159 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 570/1168] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:33:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:33:26.164007 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e092bb5-2fb2-42eb-89c8-0ca776d80cad None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:26.247931 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:26.264733 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e092bb5-2fb2-42eb-89c8-0ca776d80cad None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:26.297152 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fdf2a-e838-47a3-846f-bf2dffc0aae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:26.297741 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fdf2a-e838-47a3-846f-bf2dffc0aae7 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:26.298023 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fdf2a-e838-47a3-846f-bf2dffc0aae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:26.298296 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fdf2a-e838-47a3-846f-bf2dffc0aae7 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:26.298968 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fdf2a-e838-47a3-846f-bf2dffc0aae7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:26.300911 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fdf2a-e838-47a3-846f-bf2dffc0aae7 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:26.316217 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 599/1169] 10.222.0.52 () {60 vars in 1138 bytes} [Thu Sep 15 00:33:26 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:33:28.463656 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d67e0-64e9-4913-a586-6607fa1995d1 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:28.464199 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d67e0-64e9-4913-a586-6607fa1995d1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:28.464199 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d67e0-64e9-4913-a586-6607fa1995d1 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:28.465591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 571/1170] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:33:28.470739 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354ab27-41b4-4f92-8e8d-695051ca4ea7 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:28.471171 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354ab27-41b4-4f92-8e8d-695051ca4ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:28.471276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354ab27-41b4-4f92-8e8d-695051ca4ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:28.490390 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-d354ab27-41b4-4f92-8e8d-695051ca4ea7 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:33:28.491565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d354ab27-41b4-4f92-8e8d-695051ca4ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:33:28.555756 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 600/1171] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:33:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:33:28.820795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d67e0-64e9-4913-a586-6607fa1995d1 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:28.919212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d67e0-64e9-4913-a586-6607fa1995d1 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:28.951296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d64c5-f8c2-423d-8eac-acf7feb600e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:28.951902 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d64c5-f8c2-423d-8eac-acf7feb600e3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:28.952181 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d64c5-f8c2-423d-8eac-acf7feb600e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:28.952458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d64c5-f8c2-423d-8eac-acf7feb600e3 None admin] PATH_INFO: `/v3/domains/1853ce6745394984a2557a886d579025` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:28.963040 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d64c5-f8c2-423d-8eac-acf7feb600e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1853ce6745394984a2557a886d579025)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:28.964474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d64c5-f8c2-423d-8eac-acf7feb600e3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:28.966059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 572/1172] 10.222.0.52 () {56 vars in 1183 bytes} [Thu Sep 15 00:33:28 2022] GET /identity/v3/domains/1853ce6745394984a2557a886d579025 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:28.972290 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354ab27-41b4-4f92-8e8d-695051ca4ea7 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:29.043764 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:29.069619 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354ab27-41b4-4f92-8e8d-695051ca4ea7 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:29.102035 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41467b0-9d3e-49b9-97ca-9df5817681bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:29.102565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41467b0-9d3e-49b9-97ca-9df5817681bb None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:29.102840 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41467b0-9d3e-49b9-97ca-9df5817681bb None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:29.103109 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41467b0-9d3e-49b9-97ca-9df5817681bb None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:29.103745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41467b0-9d3e-49b9-97ca-9df5817681bb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:29.105171 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41467b0-9d3e-49b9-97ca-9df5817681bb None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:29.130461 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 601/1173] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 15 00:33:28 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:33:31.294030 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724e123-d7b3-423f-a08e-8ae8c9b00b04 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:31.294563 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724e123-d7b3-423f-a08e-8ae8c9b00b04 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:31.294563 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724e123-d7b3-423f-a08e-8ae8c9b00b04 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:31.295948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 573/1174] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:33:31.301897 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af0af5-aad5-4dcd-b90e-1a8b8ae028b3 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:31.302331 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af0af5-aad5-4dcd-b90e-1a8b8ae028b3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:31.302471 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af0af5-aad5-4dcd-b90e-1a8b8ae028b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:31.320844 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-21af0af5-aad5-4dcd-b90e-1a8b8ae028b3 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:33:31.322071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-21af0af5-aad5-4dcd-b90e-1a8b8ae028b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:33:31.391677 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 602/1175] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:33:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 00:33:31.664925 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724e123-d7b3-423f-a08e-8ae8c9b00b04 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:31.713885 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:31.762802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724e123-d7b3-423f-a08e-8ae8c9b00b04 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:31.796181 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca94c6-dcc2-49e2-89aa-b70665b34c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:31.796787 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca94c6-dcc2-49e2-89aa-b70665b34c26 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:31.797066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca94c6-dcc2-49e2-89aa-b70665b34c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:31.797365 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca94c6-dcc2-49e2-89aa-b70665b34c26 None admin] PATH_INFO: `/v3/domains/1853ce6745394984a2557a886d579025` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:31.798470 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca94c6-dcc2-49e2-89aa-b70665b34c26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1853ce6745394984a2557a886d579025)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:31.799916 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca94c6-dcc2-49e2-89aa-b70665b34c26 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:31.801493 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 574/1176] 10.222.0.52 () {56 vars in 1183 bytes} [Thu Sep 15 00:33:31 2022] GET /identity/v3/domains/1853ce6745394984a2557a886d579025 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:31.807105 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af0af5-aad5-4dcd-b90e-1a8b8ae028b3 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:31.861233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:31.910514 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af0af5-aad5-4dcd-b90e-1a8b8ae028b3 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:31.943513 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc804d8-bf97-41a8-aed2-5e2641a10203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:31.944048 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc804d8-bf97-41a8-aed2-5e2641a10203 None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:31.944324 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc804d8-bf97-41a8-aed2-5e2641a10203 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:31.944595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc804d8-bf97-41a8-aed2-5e2641a10203 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:31.945272 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc804d8-bf97-41a8-aed2-5e2641a10203 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:31.946689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc804d8-bf97-41a8-aed2-5e2641a10203 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:31.966948 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 603/1177] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 15 00:33:31 2022] POST /identity/v3/users => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:33:34.111775 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c94c2-5a1f-4db3-9f05-601c2618c2ad None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:34.112304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c94c2-5a1f-4db3-9f05-601c2618c2ad None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:34.112304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c94c2-5a1f-4db3-9f05-601c2618c2ad None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:34.113699 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 575/1178] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:33:34.118781 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f49dfb-954e-4af3-b3d8-ec4e7e75ac7d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:34.119206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f49dfb-954e-4af3-b3d8-ec4e7e75ac7d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:34.119336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f49dfb-954e-4af3-b3d8-ec4e7e75ac7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:34.137874 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-a9f49dfb-954e-4af3-b3d8-ec4e7e75ac7d None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:33:34.139047 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a9f49dfb-954e-4af3-b3d8-ec4e7e75ac7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:33:34.203346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 604/1179] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:33:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:33:34.471094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c94c2-5a1f-4db3-9f05-601c2618c2ad None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:34.570245 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c94c2-5a1f-4db3-9f05-601c2618c2ad None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:34.588285 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:34.605100 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5c7c1-5e5f-4491-830c-587efb487fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:34.605733 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5c7c1-5e5f-4491-830c-587efb487fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:34.606007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5c7c1-5e5f-4491-830c-587efb487fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:34.606275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5c7c1-5e5f-4491-830c-587efb487fa0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:34.616741 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5c7c1-5e5f-4491-830c-587efb487fa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:33:34.621473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-ced5c7c1-5e5f-4491-830c-587efb487fa0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:33:34.621473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:33:34.621473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:33:34.621473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:33:34.621473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:33:34.621473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:33:34.621473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:33:34.621473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:33:34.621473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:33:34.621473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:33:34.621473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:33:34.621473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:33:34.621473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:33:34.621473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:33:34.621473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:33:34.621473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:33:34.622547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:33:34.622547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:33:34.622547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:33:34.622547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:33:34.622547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:33:34.622547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:33:34.622547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:33:34.622547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:33:34.622547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:33:34.622547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:33:34.622547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:33:34.622547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:33:34.622547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:33:34.622547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:33:34.622547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:33:34.622547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:33:34.623459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:33:34.623459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:33:34.623459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:33:34.623459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:33:34.623459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:33:34.623459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:33:34.623459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:33:34.623459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:33:34.623459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:33:34.623459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:33:34.623459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:33:34.623459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:33:34.623459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 576/1180] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:33:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:33:34.629158 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f49dfb-954e-4af3-b3d8-ec4e7e75ac7d None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:34.671012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:34.724896 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f49dfb-954e-4af3-b3d8-ec4e7e75ac7d None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:34.757941 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517383ba-22f3-4e5e-9dc8-6b029e614a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:34.758526 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517383ba-22f3-4e5e-9dc8-6b029e614a02 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:34.758799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517383ba-22f3-4e5e-9dc8-6b029e614a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:34.759064 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517383ba-22f3-4e5e-9dc8-6b029e614a02 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:34.759707 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517383ba-22f3-4e5e-9dc8-6b029e614a02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:33:34.760004 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517383ba-22f3-4e5e-9dc8-6b029e614a02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:34.761370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517383ba-22f3-4e5e-9dc8-6b029e614a02 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:34.768994 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 605/1181] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:33:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:33:34.774894 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5c7c1-5e5f-4491-830c-587efb487fa0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:34.870603 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5c7c1-5e5f-4491-830c-587efb487fa0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:34.902696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bc03f-07c8-417b-a108-a1bd97159355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:34.903294 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bc03f-07c8-417b-a108-a1bd97159355 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:34.903565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bc03f-07c8-417b-a108-a1bd97159355 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:34.903829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bc03f-07c8-417b-a108-a1bd97159355 None admin] PATH_INFO: `/v3/users/6f053319e2f74489bd451f497f15adb7` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:34.916835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bc03f-07c8-417b-a108-a1bd97159355 None admin] RBAC: Authorizing `identity:get_user(user_id=6f053319e2f74489bd451f497f15adb7)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:34.918290 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bc03f-07c8-417b-a108-a1bd97159355 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:34.919838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 577/1182] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:33:34 2022] GET /identity/v3/users/6f053319e2f74489bd451f497f15adb7 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:34.925860 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517383ba-22f3-4e5e-9dc8-6b029e614a02 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:35.026874 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517383ba-22f3-4e5e-9dc8-6b029e614a02 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:35.029049 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:35.059879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff01c4-6dc8-427f-a2e9-fe9b2a2afa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:35.060476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff01c4-6dc8-427f-a2e9-fe9b2a2afa9f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:35.060758 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff01c4-6dc8-427f-a2e9-fe9b2a2afa9f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:35.061032 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff01c4-6dc8-427f-a2e9-fe9b2a2afa9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:35.125752 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff01c4-6dc8-427f-a2e9-fe9b2a2afa9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:35.127180 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff01c4-6dc8-427f-a2e9-fe9b2a2afa9f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:35.221747 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 606/1183] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:33:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 00:33:35.227697 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bc03f-07c8-417b-a108-a1bd97159355 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:35.264784 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:35.327479 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bc03f-07c8-417b-a108-a1bd97159355 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:35.360737 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608bf94-4d7a-4e08-8a5f-c7f4edeeb577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:35.361372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608bf94-4d7a-4e08-8a5f-c7f4edeeb577 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:35.361650 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608bf94-4d7a-4e08-8a5f-c7f4edeeb577 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:35.362448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608bf94-4d7a-4e08-8a5f-c7f4edeeb577 None admin] PATH_INFO: `/v3/projects/cd14518e588b4ca3aaecc9ea253c951b` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:35.363551 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608bf94-4d7a-4e08-8a5f-c7f4edeeb577 None admin] RBAC: Authorizing `identity:get_project(project_id=cd14518e588b4ca3aaecc9ea253c951b)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:35.364989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608bf94-4d7a-4e08-8a5f-c7f4edeeb577 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:35.366645 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 578/1184] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:33:35 2022] GET /identity/v3/projects/cd14518e588b4ca3aaecc9ea253c951b => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:35.372658 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff01c4-6dc8-427f-a2e9-fe9b2a2afa9f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:35.375670 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:35.469869 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff01c4-6dc8-427f-a2e9-fe9b2a2afa9f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:35.503086 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f3c73-036b-4df6-8ad3-1bbe1756a72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:35.503677 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f3c73-036b-4df6-8ad3-1bbe1756a72b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:35.503957 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f3c73-036b-4df6-8ad3-1bbe1756a72b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:35.504228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f3c73-036b-4df6-8ad3-1bbe1756a72b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:35.504941 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f3c73-036b-4df6-8ad3-1bbe1756a72b None admin] RBAC: Adding query filter params (role.id=0ee2daa9cb3c41fb901603e3d8caf784, scope.project.id=cd14518e588b4ca3aaecc9ea253c951b, user.id=6f053319e2f74489bd451f497f15adb7) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:33:35.505284 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f3c73-036b-4df6-8ad3-1bbe1756a72b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:35.506689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f3c73-036b-4df6-8ad3-1bbe1756a72b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:35.511818 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 607/1185] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:33:35 2022] GET /identity/v3/role_assignments?user.id=6f053319e2f74489bd451f497f15adb7&scope.project.id=cd14518e588b4ca3aaecc9ea253c951b&role.id=0ee2daa9cb3c41fb901603e3d8caf784 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:37.629293 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b1d75-462e-4a01-802e-6cddfb44c8a7 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:37.629846 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b1d75-462e-4a01-802e-6cddfb44c8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:37.629846 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b1d75-462e-4a01-802e-6cddfb44c8a7 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:37.631088 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 579/1186] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:33:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:33:37.636160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c02191-7f4e-46df-a379-313034b7de31 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:37.636549 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c02191-7f4e-46df-a379-313034b7de31 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:37.636706 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c02191-7f4e-46df-a379-313034b7de31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:37.655043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f5c02191-7f4e-46df-a379-313034b7de31 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:33:37.656212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f5c02191-7f4e-46df-a379-313034b7de31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:33:37.715657 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:37.721492 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 608/1187] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:33:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:33:37.992705 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b1d75-462e-4a01-802e-6cddfb44c8a7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:38.091418 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b1d75-462e-4a01-802e-6cddfb44c8a7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:38.093685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:38.124921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1c7e3-8b8d-4098-be01-8dc2e63f67cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:38.125554 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1c7e3-8b8d-4098-be01-8dc2e63f67cf None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:38.125831 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1c7e3-8b8d-4098-be01-8dc2e63f67cf None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:38.126099 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1c7e3-8b8d-4098-be01-8dc2e63f67cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:38.135809 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1c7e3-8b8d-4098-be01-8dc2e63f67cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:33:38.140513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-88c1c7e3-8b8d-4098-be01-8dc2e63f67cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:33:38.140513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:33:38.140513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:33:38.140513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:33:38.140513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:33:38.140513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:33:38.140513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:33:38.140513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:33:38.140513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:33:38.140513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:33:38.140513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:33:38.140513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:33:38.140513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:33:38.140513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:33:38.140513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:33:38.140513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:33:38.141634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:33:38.141634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:33:38.141634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:33:38.141634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:33:38.141634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:33:38.141634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:33:38.141634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:33:38.141634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:33:38.141634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:33:38.141634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:33:38.141634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:33:38.141634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:33:38.141634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:33:38.141634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:33:38.141634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:33:38.141634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:33:38.142877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:33:38.142877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:33:38.142877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:33:38.142877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:33:38.142877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:33:38.142877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:33:38.142877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:33:38.142877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:33:38.142877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:33:38.142877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:33:38.142877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:33:38.142877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:33:38.142877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 580/1188] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:33:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:33:38.147661 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c02191-7f4e-46df-a379-313034b7de31 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:38.243820 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c02191-7f4e-46df-a379-313034b7de31 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:38.275369 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8928b-b7f8-49aa-83d8-0b5caa292db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:38.275953 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8928b-b7f8-49aa-83d8-0b5caa292db9 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:38.276228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8928b-b7f8-49aa-83d8-0b5caa292db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:38.276495 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8928b-b7f8-49aa-83d8-0b5caa292db9 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:38.277160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8928b-b7f8-49aa-83d8-0b5caa292db9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:33:38.277460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8928b-b7f8-49aa-83d8-0b5caa292db9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:38.278797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8928b-b7f8-49aa-83d8-0b5caa292db9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:38.286906 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 609/1189] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:33:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:38.292406 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1c7e3-8b8d-4098-be01-8dc2e63f67cf None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:38.388647 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1c7e3-8b8d-4098-be01-8dc2e63f67cf None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:38.422071 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4edfc4-e785-49ec-8ff4-38d2b894cd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:38.422670 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4edfc4-e785-49ec-8ff4-38d2b894cd66 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:38.422938 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4edfc4-e785-49ec-8ff4-38d2b894cd66 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:38.423203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4edfc4-e785-49ec-8ff4-38d2b894cd66 None admin] PATH_INFO: `/v3/users/6f053319e2f74489bd451f497f15adb7` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:38.424331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4edfc4-e785-49ec-8ff4-38d2b894cd66 None admin] RBAC: Authorizing `identity:get_user(user_id=6f053319e2f74489bd451f497f15adb7)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:38.425781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4edfc4-e785-49ec-8ff4-38d2b894cd66 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:38.427313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 581/1190] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:33:38 2022] GET /identity/v3/users/6f053319e2f74489bd451f497f15adb7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:38.433251 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8928b-b7f8-49aa-83d8-0b5caa292db9 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:38.490789 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:38.530559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8928b-b7f8-49aa-83d8-0b5caa292db9 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:38.564070 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44afca-26ec-462f-90ee-453b2d4874a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:38.564695 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44afca-26ec-462f-90ee-453b2d4874a1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:38.564975 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44afca-26ec-462f-90ee-453b2d4874a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:38.565291 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44afca-26ec-462f-90ee-453b2d4874a1 None admin] PATH_INFO: `/v3/projects/cd14518e588b4ca3aaecc9ea253c951b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:38.566415 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44afca-26ec-462f-90ee-453b2d4874a1 None admin] RBAC: Authorizing `identity:get_project(project_id=cd14518e588b4ca3aaecc9ea253c951b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:38.567855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44afca-26ec-462f-90ee-453b2d4874a1 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:38.569490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 610/1191] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:33:38 2022] GET /identity/v3/projects/cd14518e588b4ca3aaecc9ea253c951b => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:38.575554 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4edfc4-e785-49ec-8ff4-38d2b894cd66 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:38.606794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:38.672695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4edfc4-e785-49ec-8ff4-38d2b894cd66 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:38.705192 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbd879-b8c4-4592-a5d9-a56b8ef22a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:38.706382 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbd879-b8c4-4592-a5d9-a56b8ef22a97 None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:38.706667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbd879-b8c4-4592-a5d9-a56b8ef22a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:38.706932 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbd879-b8c4-4592-a5d9-a56b8ef22a97 None admin] PATH_INFO: `/v3/projects/cd14518e588b4ca3aaecc9ea253c951b/users/6f053319e2f74489bd451f497f15adb7/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:38.708821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbd879-b8c4-4592-a5d9-a56b8ef22a97 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd14518e588b4ca3aaecc9ea253c951b, user_id=6f053319e2f74489bd451f497f15adb7, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:38.710279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbd879-b8c4-4592-a5d9-a56b8ef22a97 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:38.722914 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 582/1192] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:33:38 2022] PUT /identity/v3/projects/cd14518e588b4ca3aaecc9ea253c951b/users/6f053319e2f74489bd451f497f15adb7/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:33:40.829620 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786568fe-fe86-4649-8d42-817b6fcf3ea3 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:40.830129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786568fe-fe86-4649-8d42-817b6fcf3ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:40.830220 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786568fe-fe86-4649-8d42-817b6fcf3ea3 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:40.832029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 611/1193] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:33:40.837186 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a4809-31a3-46bc-90c5-09507d304ba9 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:40.837553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a4809-31a3-46bc-90c5-09507d304ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:40.837742 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a4809-31a3-46bc-90c5-09507d304ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:40.855956 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3b2a4809-31a3-46bc-90c5-09507d304ba9 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:33:40.857407 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3b2a4809-31a3-46bc-90c5-09507d304ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:33:40.921181 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 583/1194] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:33:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:33:41.193247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786568fe-fe86-4649-8d42-817b6fcf3ea3 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:41.292034 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786568fe-fe86-4649-8d42-817b6fcf3ea3 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:41.317501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:41.325800 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49102d-9f6c-4e87-ab70-8f29b650dd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:41.326416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49102d-9f6c-4e87-ab70-8f29b650dd12 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:41.326691 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49102d-9f6c-4e87-ab70-8f29b650dd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:41.326957 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49102d-9f6c-4e87-ab70-8f29b650dd12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:41.337549 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49102d-9f6c-4e87-ab70-8f29b650dd12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:33:41.342565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-6e49102d-9f6c-4e87-ab70-8f29b650dd12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:33:41.342565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:33:41.342565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:33:41.342565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:33:41.342565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:33:41.342565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:33:41.342565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:33:41.342565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:33:41.342565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:33:41.342565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:33:41.342565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:33:41.342565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:33:41.342565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:33:41.342565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:33:41.342565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:33:41.342565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:33:41.343647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:33:41.343647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:33:41.343647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:33:41.343647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:33:41.343647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:33:41.343647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:33:41.343647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:33:41.343647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:33:41.343647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:33:41.343647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:33:41.343647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:33:41.343647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:33:41.343647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:33:41.343647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:33:41.343647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:33:41.343647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:33:41.344685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:33:41.344685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:33:41.344685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:33:41.344685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:33:41.344685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:33:41.344685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:33:41.344685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:33:41.344685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:33:41.344685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:33:41.344685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:33:41.344685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:33:41.344685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:33:41.344685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 612/1195] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:33:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:33:41.349783 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a4809-31a3-46bc-90c5-09507d304ba9 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:41.373111 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:41.446247 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a4809-31a3-46bc-90c5-09507d304ba9 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:41.477855 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a81687-0b4e-446a-9817-ce69e7ea8f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:41.478438 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a81687-0b4e-446a-9817-ce69e7ea8f25 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:41.478712 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a81687-0b4e-446a-9817-ce69e7ea8f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:41.478977 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a81687-0b4e-446a-9817-ce69e7ea8f25 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:41.479622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a81687-0b4e-446a-9817-ce69e7ea8f25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:33:41.479917 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a81687-0b4e-446a-9817-ce69e7ea8f25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:41.481545 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a81687-0b4e-446a-9817-ce69e7ea8f25 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:41.489645 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 584/1196] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:33:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:41.495989 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49102d-9f6c-4e87-ab70-8f29b650dd12 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:41.592457 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49102d-9f6c-4e87-ab70-8f29b650dd12 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:41.625225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ebb33-9248-49ed-842a-3fda558c9467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:41.625833 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ebb33-9248-49ed-842a-3fda558c9467 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:41.626111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ebb33-9248-49ed-842a-3fda558c9467 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:41.626385 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ebb33-9248-49ed-842a-3fda558c9467 None admin] PATH_INFO: `/v3/users/6f053319e2f74489bd451f497f15adb7` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:41.628043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ebb33-9248-49ed-842a-3fda558c9467 None admin] RBAC: Authorizing `identity:get_user(user_id=6f053319e2f74489bd451f497f15adb7)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:41.629488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ebb33-9248-49ed-842a-3fda558c9467 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:41.631057 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 613/1197] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Sep 15 00:33:41 2022] GET /identity/v3/users/6f053319e2f74489bd451f497f15adb7 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:41.636618 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a81687-0b4e-446a-9817-ce69e7ea8f25 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:41.717154 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:41.732796 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a81687-0b4e-446a-9817-ce69e7ea8f25 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:41.765360 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0c4ac-3c12-4a9e-ae43-263c027edddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:41.765944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0c4ac-3c12-4a9e-ae43-263c027edddb None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:41.766217 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0c4ac-3c12-4a9e-ae43-263c027edddb None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:41.766486 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0c4ac-3c12-4a9e-ae43-263c027edddb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:41.830372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0c4ac-3c12-4a9e-ae43-263c027edddb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:41.831800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0c4ac-3c12-4a9e-ae43-263c027edddb None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:41.910325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:41.926990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 585/1198] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:33:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 00:33:41.932905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ebb33-9248-49ed-842a-3fda558c9467 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:41.987948 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:42.028417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ebb33-9248-49ed-842a-3fda558c9467 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:42.061242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec384918-42a9-4df1-87da-f1411b9f9fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:42.061847 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec384918-42a9-4df1-87da-f1411b9f9fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:42.062122 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec384918-42a9-4df1-87da-f1411b9f9fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:42.062390 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec384918-42a9-4df1-87da-f1411b9f9fe2 None admin] PATH_INFO: `/v3/projects/cd14518e588b4ca3aaecc9ea253c951b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:42.063477 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec384918-42a9-4df1-87da-f1411b9f9fe2 None admin] RBAC: Authorizing `identity:get_project(project_id=cd14518e588b4ca3aaecc9ea253c951b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:42.064936 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec384918-42a9-4df1-87da-f1411b9f9fe2 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:42.066544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 614/1199] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Sep 15 00:33:41 2022] GET /identity/v3/projects/cd14518e588b4ca3aaecc9ea253c951b => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:42.072672 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0c4ac-3c12-4a9e-ae43-263c027edddb None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:33:42.168611 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0c4ac-3c12-4a9e-ae43-263c027edddb None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:33:42.200378 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf19490-6d8e-40ec-8a4e-ad9235a0b51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:33:42.200956 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf19490-6d8e-40ec-8a4e-ad9235a0b51c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:33:42.201263 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf19490-6d8e-40ec-8a4e-ad9235a0b51c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:33:42.201536 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf19490-6d8e-40ec-8a4e-ad9235a0b51c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:33:42.202245 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf19490-6d8e-40ec-8a4e-ad9235a0b51c None admin] RBAC: Adding query filter params (role.id=0ee2daa9cb3c41fb901603e3d8caf784, scope.project.id=cd14518e588b4ca3aaecc9ea253c951b, user.id=6f053319e2f74489bd451f497f15adb7) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:33:42.202551 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf19490-6d8e-40ec-8a4e-ad9235a0b51c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:33:42.203961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf19490-6d8e-40ec-8a4e-ad9235a0b51c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:33:42.209950 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 586/1200] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:33:42 2022] GET /identity/v3/role_assignments?user.id=6f053319e2f74489bd451f497f15adb7&scope.project.id=cd14518e588b4ca3aaecc9ea253c951b&role.id=0ee2daa9cb3c41fb901603e3d8caf784 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:33:52.057211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=38 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:33:52.207480 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=76 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:37.589582 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec95b6-35d9-4ff0-899e-c6a560489221 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:37.590189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec95b6-35d9-4ff0-899e-c6a560489221 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:37.590189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec95b6-35d9-4ff0-899e-c6a560489221 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:37.591548 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 615/1201] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:34:37.600109 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f14ed-f937-452d-bccb-6effb4a285c2 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:37.600653 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f14ed-f937-452d-bccb-6effb4a285c2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:37.600653 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f14ed-f937-452d-bccb-6effb4a285c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:37.625827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-151f14ed-f937-452d-bccb-6effb4a285c2 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:34:37.627388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-151f14ed-f937-452d-bccb-6effb4a285c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:34:37.713568 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 587/1202] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:34:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 00:34:38.023497 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec95b6-35d9-4ff0-899e-c6a560489221 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:38.160947 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec95b6-35d9-4ff0-899e-c6a560489221 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:38.204378 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81818d-31c3-4e47-8003-63b7a773abf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:38.205435 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81818d-31c3-4e47-8003-63b7a773abf7 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:38.206153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81818d-31c3-4e47-8003-63b7a773abf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:38.206762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81818d-31c3-4e47-8003-63b7a773abf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:38.219846 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81818d-31c3-4e47-8003-63b7a773abf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:38.221976 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81818d-31c3-4e47-8003-63b7a773abf7 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:38.242892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-ca81818d-31c3-4e47-8003-63b7a773abf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:34:38.242892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:34:38.242892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:34:38.242892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:34:38.242892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:34:38.242892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:34:38.242892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:34:38.242892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:34:38.242892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:34:38.242892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:34:38.242892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:34:38.242892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:34:38.242892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:34:38.242892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:34:38.242892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:34:38.242892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:34:38.244481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:34:38.244481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:34:38.244481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:34:38.244481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:34:38.244481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:34:38.244481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:34:38.244481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:34:38.244481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:34:38.244481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:34:38.244481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:34:38.244481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:34:38.244481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:34:38.244481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:34:38.244481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:34:38.244481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:34:38.244481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:34:38.244481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:34:38.245654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:34:38.245654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:34:38.245654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:34:38.252674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 616/1203] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:34:38.256202 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f14ed-f937-452d-bccb-6effb4a285c2 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:38.399990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f14ed-f937-452d-bccb-6effb4a285c2 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:38.438791 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:38.446442 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16030978-ff65-4d23-83f0-dbf9b6d74e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:38.447289 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16030978-ff65-4d23-83f0-dbf9b6d74e4c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:38.447901 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16030978-ff65-4d23-83f0-dbf9b6d74e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:38.448246 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16030978-ff65-4d23-83f0-dbf9b6d74e4c None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:38.449148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16030978-ff65-4d23-83f0-dbf9b6d74e4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:38.449551 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16030978-ff65-4d23-83f0-dbf9b6d74e4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:38.451890 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16030978-ff65-4d23-83f0-dbf9b6d74e4c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:38.473134 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 588/1204] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:34:38.475749 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81818d-31c3-4e47-8003-63b7a773abf7 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:38.545584 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:38.606058 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81818d-31c3-4e47-8003-63b7a773abf7 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:38.644137 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1ff86-ad1a-47da-bee4-6e223b92908b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:38.644987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1ff86-ad1a-47da-bee4-6e223b92908b None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:38.644987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1ff86-ad1a-47da-bee4-6e223b92908b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:38.645204 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1ff86-ad1a-47da-bee4-6e223b92908b None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:38.645862 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1ff86-ad1a-47da-bee4-6e223b92908b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:38.647292 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1ff86-ad1a-47da-bee4-6e223b92908b None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:38.677342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 617/1205] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Sep 15 00:34:38 2022] POST /identity/v3/users => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:34:41.047388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b183e88-d89a-4709-b34b-e925942626fa None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:41.048069 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b183e88-d89a-4709-b34b-e925942626fa None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:41.048069 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b183e88-d89a-4709-b34b-e925942626fa None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:41.049248 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 589/1206] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:34:41.054652 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a92a87-d9e5-408b-847c-de9d2210b2c7 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:41.055107 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a92a87-d9e5-408b-847c-de9d2210b2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:41.055216 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a92a87-d9e5-408b-847c-de9d2210b2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:41.075871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f8a92a87-d9e5-408b-847c-de9d2210b2c7 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:34:41.077131 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f8a92a87-d9e5-408b-847c-de9d2210b2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:34:41.150832 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 618/1207] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:34:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 00:34:41.459749 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b183e88-d89a-4709-b34b-e925942626fa None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:41.579196 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b183e88-d89a-4709-b34b-e925942626fa None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:41.622503 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809a7da-fbea-47d0-b7c8-f946b02ccd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:41.623107 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809a7da-fbea-47d0-b7c8-f946b02ccd72 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:41.623343 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809a7da-fbea-47d0-b7c8-f946b02ccd72 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:41.623613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809a7da-fbea-47d0-b7c8-f946b02ccd72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:41.634478 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809a7da-fbea-47d0-b7c8-f946b02ccd72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:34:41.639849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-f809a7da-fbea-47d0-b7c8-f946b02ccd72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:34:41.639849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:34:41.639849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:34:41.639849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:34:41.639849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:34:41.639849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:34:41.639849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:34:41.639849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:34:41.639849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:34:41.639849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:34:41.639849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:34:41.639849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:34:41.639849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:34:41.639849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:34:41.639849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:34:41.639849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:34:41.641135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:34:41.641135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:34:41.641135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:34:41.641135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:34:41.641135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:34:41.641135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:34:41.641135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:34:41.641135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:34:41.641135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:34:41.641135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:34:41.641135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:34:41.641135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:34:41.641135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:34:41.641135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:34:41.641135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:34:41.641135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:34:41.642283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:34:41.642283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:34:41.642283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:34:41.642283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:34:41.642283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:34:41.642283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:34:41.642283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:34:41.642283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:34:41.642283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:34:41.642283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:34:41.642283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:34:41.642283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:34:41.645328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 590/1208] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:34:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:34:41.646845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a92a87-d9e5-408b-847c-de9d2210b2c7 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:41.691768 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:41.764919 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a92a87-d9e5-408b-847c-de9d2210b2c7 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:41.801385 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf616e8-a09a-4694-92f5-a5b8e8b5b0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:41.802002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf616e8-a09a-4694-92f5-a5b8e8b5b0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:41.802319 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf616e8-a09a-4694-92f5-a5b8e8b5b0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:41.802550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf616e8-a09a-4694-92f5-a5b8e8b5b0d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:41.803254 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf616e8-a09a-4694-92f5-a5b8e8b5b0d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:41.803507 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf616e8-a09a-4694-92f5-a5b8e8b5b0d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:41.804878 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf616e8-a09a-4694-92f5-a5b8e8b5b0d1 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:41.814326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 619/1209] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 15 00:34:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:34:41.820891 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809a7da-fbea-47d0-b7c8-f946b02ccd72 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:41.884772 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:41.942322 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809a7da-fbea-47d0-b7c8-f946b02ccd72 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:41.983536 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb84ec9-f897-41f1-91ad-fa51c14b1487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:41.984164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb84ec9-f897-41f1-91ad-fa51c14b1487 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:41.984476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb84ec9-f897-41f1-91ad-fa51c14b1487 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:41.984785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb84ec9-f897-41f1-91ad-fa51c14b1487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:41.995614 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb84ec9-f897-41f1-91ad-fa51c14b1487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:41.997066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb84ec9-f897-41f1-91ad-fa51c14b1487 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:42.012770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-8fb84ec9-f897-41f1-91ad-fa51c14b1487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:34:42.012770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:34:42.012770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:34:42.012770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:34:42.012770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:34:42.012770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:34:42.012770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:34:42.012770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:34:42.012770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:34:42.012770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:34:42.012770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:34:42.012770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:34:42.012770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:34:42.012770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:34:42.012770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:34:42.012770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:34:42.014153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:34:42.014153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:34:42.014153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:34:42.014153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:34:42.014153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:34:42.014153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:34:42.014153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:34:42.014153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:34:42.014153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:34:42.014153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:34:42.014153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:34:42.014153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:34:42.014153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:34:42.014153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:34:42.014153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:34:42.014153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:34:42.014153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:34:42.015424 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:34:42.015424 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:34:42.015424 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:34:42.015424 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 591/1210] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:34:42.020281 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf616e8-a09a-4694-92f5-a5b8e8b5b0d1 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:42.149123 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:42.152123 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf616e8-a09a-4694-92f5-a5b8e8b5b0d1 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:42.190461 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e8772-3363-4a51-bee1-000bf20dcb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:42.191124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e8772-3363-4a51-bee1-000bf20dcb38 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:42.194245 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e8772-3363-4a51-bee1-000bf20dcb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:42.194245 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e8772-3363-4a51-bee1-000bf20dcb38 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:42.194245 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e8772-3363-4a51-bee1-000bf20dcb38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:42.194245 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e8772-3363-4a51-bee1-000bf20dcb38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:42.194245 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e8772-3363-4a51-bee1-000bf20dcb38 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:42.207057 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 620/1211] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:34:42.212940 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb84ec9-f897-41f1-91ad-fa51c14b1487 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:42.334785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb84ec9-f897-41f1-91ad-fa51c14b1487 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:42.336380 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:42.375592 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa08c18-c6bc-49d0-aff0-959a338cfe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:42.376344 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa08c18-c6bc-49d0-aff0-959a338cfe9c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:42.376651 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa08c18-c6bc-49d0-aff0-959a338cfe9c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:42.376920 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa08c18-c6bc-49d0-aff0-959a338cfe9c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:42.384967 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa08c18-c6bc-49d0-aff0-959a338cfe9c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:42.386673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa08c18-c6bc-49d0-aff0-959a338cfe9c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:42.400128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-7fa08c18-c6bc-49d0-aff0-959a338cfe9c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 00:34:42.400128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:34:42.400128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:34:42.400128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:34:42.400128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:34:42.400128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:34:42.400128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:34:42.400128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:34:42.400128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:34:42.400128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:34:42.400128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:34:42.400128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:34:42.400128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:34:42.400128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:34:42.400128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:34:42.400128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:34:42.401291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:34:42.401291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:34:42.401291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:34:42.401291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:34:42.401291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:34:42.401291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:34:42.401291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:34:42.401291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:34:42.401291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:34:42.401291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:34:42.401291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:34:42.401291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:34:42.401291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:34:42.401291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:34:42.401291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:34:42.401291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:34:42.401291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:34:42.401291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:34:42.402528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:34:42.402528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:34:42.402528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:34:42.402528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:34:42.402528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:34:42.402528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:34:42.402528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:34:42.402528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:34:42.402528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 00:34:42.402528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:34:42.406726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 592/1212] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:34:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:34:42.407864 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e8772-3363-4a51-bee1-000bf20dcb38 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:42.517165 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e8772-3363-4a51-bee1-000bf20dcb38 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:42.550985 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950776fe-98ad-455f-a1a9-2f16349181f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:42.551525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950776fe-98ad-455f-a1a9-2f16349181f0 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:42.551804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950776fe-98ad-455f-a1a9-2f16349181f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:42.552084 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950776fe-98ad-455f-a1a9-2f16349181f0 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:42.552788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950776fe-98ad-455f-a1a9-2f16349181f0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:42.553170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950776fe-98ad-455f-a1a9-2f16349181f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:42.554519 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950776fe-98ad-455f-a1a9-2f16349181f0 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:42.573417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 621/1213] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Sep 15 00:34:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:34:42.579629 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa08c18-c6bc-49d0-aff0-959a338cfe9c None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:42.686125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa08c18-c6bc-49d0-aff0-959a338cfe9c None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:42.726675 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86700bca-ab09-47bc-9a2e-3e651a168785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:42.727395 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86700bca-ab09-47bc-9a2e-3e651a168785 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:42.727746 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86700bca-ab09-47bc-9a2e-3e651a168785 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:42.728049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86700bca-ab09-47bc-9a2e-3e651a168785 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:42.761160 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:42.801606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86700bca-ab09-47bc-9a2e-3e651a168785 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:42.803072 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86700bca-ab09-47bc-9a2e-3e651a168785 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:42.922330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 593/1214] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:34:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 00:34:42.923667 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950776fe-98ad-455f-a1a9-2f16349181f0 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:42.946259 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:43.041490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950776fe-98ad-455f-a1a9-2f16349181f0 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:43.083901 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02984a-e044-4ccf-b078-8bea5ee874b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:43.084537 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02984a-e044-4ccf-b078-8bea5ee874b4 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:43.084818 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02984a-e044-4ccf-b078-8bea5ee874b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:43.085110 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02984a-e044-4ccf-b078-8bea5ee874b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:43.096568 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02984a-e044-4ccf-b078-8bea5ee874b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:43.098045 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02984a-e044-4ccf-b078-8bea5ee874b4 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:43.116932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-3e02984a-e044-4ccf-b078-8bea5ee874b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:34:43.116932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:34:43.116932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:34:43.116932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:34:43.116932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:34:43.116932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:34:43.116932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:34:43.116932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:34:43.116932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:34:43.116932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:34:43.116932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:34:43.116932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:34:43.116932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:34:43.116932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:34:43.116932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:34:43.116932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:34:43.118170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:34:43.118170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:34:43.118170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:34:43.118170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:34:43.118170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:34:43.118170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:34:43.118170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:34:43.118170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:34:43.118170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:34:43.118170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:34:43.118170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:34:43.118170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:34:43.118170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:34:43.118170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:34:43.118170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:34:43.118170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:34:43.118170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:34:43.119578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:34:43.119578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:34:43.119578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:34:43.120031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 622/1215] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:34:43.124292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86700bca-ab09-47bc-9a2e-3e651a168785 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:43.195755 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:43.242253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86700bca-ab09-47bc-9a2e-3e651a168785 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:43.286448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995da73d-42c2-4e08-9a97-133cabd9edac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:43.287144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995da73d-42c2-4e08-9a97-133cabd9edac None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:43.287442 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995da73d-42c2-4e08-9a97-133cabd9edac None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:43.287712 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995da73d-42c2-4e08-9a97-133cabd9edac None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:43.288514 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995da73d-42c2-4e08-9a97-133cabd9edac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:43.288845 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995da73d-42c2-4e08-9a97-133cabd9edac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:43.290426 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995da73d-42c2-4e08-9a97-133cabd9edac None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:43.304100 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 594/1216] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:34:43.310169 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02984a-e044-4ccf-b078-8bea5ee874b4 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:43.389037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:43.424756 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02984a-e044-4ccf-b078-8bea5ee874b4 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:43.464148 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567375c-c90f-4681-8d6c-f95c33a89515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:43.464865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567375c-c90f-4681-8d6c-f95c33a89515 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:43.465356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567375c-c90f-4681-8d6c-f95c33a89515 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:43.465782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567375c-c90f-4681-8d6c-f95c33a89515 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:43.473877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567375c-c90f-4681-8d6c-f95c33a89515 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:43.475324 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567375c-c90f-4681-8d6c-f95c33a89515 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:43.487730 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-d567375c-c90f-4681-8d6c-f95c33a89515 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:34:43.487730 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:34:43.487730 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:34:43.487730 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:34:43.487730 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:34:43.487730 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:34:43.487730 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:34:43.487730 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:34:43.487730 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:34:43.487730 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:34:43.487730 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:34:43.487730 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:34:43.487730 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:34:43.487730 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:34:43.487730 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:34:43.489225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:34:43.489225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:34:43.489225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:34:43.489225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:34:43.489225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:34:43.489225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:34:43.489225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:34:43.489225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:34:43.489225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:34:43.489225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:34:43.489225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:34:43.489225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:34:43.489225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:34:43.489225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:34:43.489225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:34:43.489225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:34:43.489225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:34:43.490153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:34:43.490153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:34:43.490153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:34:43.490153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:34:43.490153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:34:43.490153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:34:43.490153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:34:43.490153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:34:43.490153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 623/1217] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:34:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:34:43.495077 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995da73d-42c2-4e08-9a97-133cabd9edac None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:43.601582 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995da73d-42c2-4e08-9a97-133cabd9edac None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:43.626333 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:43.639104 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b91210-17f5-4bc2-aab2-febd7c1e0f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:43.640074 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b91210-17f5-4bc2-aab2-febd7c1e0f72 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:43.640566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b91210-17f5-4bc2-aab2-febd7c1e0f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:43.641078 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b91210-17f5-4bc2-aab2-febd7c1e0f72 None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:43.642324 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b91210-17f5-4bc2-aab2-febd7c1e0f72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:43.642870 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b91210-17f5-4bc2-aab2-febd7c1e0f72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:43.644858 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b91210-17f5-4bc2-aab2-febd7c1e0f72 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:43.660596 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 595/1218] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:34:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:34:43.667264 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567375c-c90f-4681-8d6c-f95c33a89515 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:43.775973 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567375c-c90f-4681-8d6c-f95c33a89515 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:43.807112 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:43.813388 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236d3e4-022b-45a3-a803-25f03c3e7320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:43.813983 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236d3e4-022b-45a3-a803-25f03c3e7320 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:43.814297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236d3e4-022b-45a3-a803-25f03c3e7320 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:43.814569 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236d3e4-022b-45a3-a803-25f03c3e7320 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:43.815284 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236d3e4-022b-45a3-a803-25f03c3e7320 None admin] RBAC: Adding query filter params (role.id=e5b76a8345d542c2a899f8dbdd95290d, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=6ed987b44d934ac7b2dc64c0aab28099) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:43.815586 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236d3e4-022b-45a3-a803-25f03c3e7320 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:43.816982 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236d3e4-022b-45a3-a803-25f03c3e7320 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:43.822351 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 624/1219] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:34:43 2022] GET /identity/v3/role_assignments?user.id=6ed987b44d934ac7b2dc64c0aab28099&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=e5b76a8345d542c2a899f8dbdd95290d => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:34:46.090852 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021570bc-19d8-434d-a082-beb502923247 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:46.091419 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021570bc-19d8-434d-a082-beb502923247 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:46.091510 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021570bc-19d8-434d-a082-beb502923247 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:46.093552 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 596/1220] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:34:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:34:46.098794 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d385aa1-ae4a-4d18-a511-0651c6f14e3c None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:46.099223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d385aa1-ae4a-4d18-a511-0651c6f14e3c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:46.099344 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d385aa1-ae4a-4d18-a511-0651c6f14e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:46.119586 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-4d385aa1-ae4a-4d18-a511-0651c6f14e3c None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:34:46.120923 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4d385aa1-ae4a-4d18-a511-0651c6f14e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:34:46.196126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 625/1221] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:34:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:34:46.465376 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021570bc-19d8-434d-a082-beb502923247 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:46.579153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021570bc-19d8-434d-a082-beb502923247 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:46.614974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921eb31-21f0-4d10-bedc-9e74b065f713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:46.615735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921eb31-21f0-4d10-bedc-9e74b065f713 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:46.616346 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921eb31-21f0-4d10-bedc-9e74b065f713 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:46.616689 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921eb31-21f0-4d10-bedc-9e74b065f713 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:46.627612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921eb31-21f0-4d10-bedc-9e74b065f713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:34:46.632393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-0921eb31-21f0-4d10-bedc-9e74b065f713 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:34:46.632393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:34:46.632393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:34:46.632393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:34:46.632393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:34:46.632393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:34:46.632393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:34:46.632393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:34:46.632393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:34:46.632393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:34:46.632393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:34:46.632393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:34:46.632393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:34:46.632393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:34:46.632393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:34:46.632393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:34:46.633546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:34:46.633546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:34:46.633546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:34:46.633546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:34:46.633546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:34:46.633546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:34:46.633546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:34:46.633546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:34:46.633546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:34:46.633546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:34:46.633546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:34:46.633546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:34:46.633546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:34:46.633546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:34:46.633546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:34:46.633546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:34:46.634627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:34:46.634627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:34:46.634627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:34:46.634627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:34:46.634627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:34:46.634627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:34:46.634627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:34:46.634627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:34:46.634627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:34:46.634627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:34:46.634627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:34:46.634627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:34:46.637380 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 597/1222] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:34:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:34:46.640014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d385aa1-ae4a-4d18-a511-0651c6f14e3c None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:46.742660 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d385aa1-ae4a-4d18-a511-0651c6f14e3c None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:46.768621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:46.782466 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2dba6-0d15-420f-9b4a-6ee61369bcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:46.783070 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2dba6-0d15-420f-9b4a-6ee61369bcf7 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:46.783351 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2dba6-0d15-420f-9b4a-6ee61369bcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:46.783620 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2dba6-0d15-420f-9b4a-6ee61369bcf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:46.784311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2dba6-0d15-420f-9b4a-6ee61369bcf7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:46.784636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2dba6-0d15-420f-9b4a-6ee61369bcf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:46.786051 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2dba6-0d15-420f-9b4a-6ee61369bcf7 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:46.794334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 626/1223] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 15 00:34:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:34:46.800186 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921eb31-21f0-4d10-bedc-9e74b065f713 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:46.845312 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:46.904483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921eb31-21f0-4d10-bedc-9e74b065f713 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:46.938247 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859ae58-d4cd-4e89-a18f-efc4da630a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:46.938787 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859ae58-d4cd-4e89-a18f-efc4da630a7f None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:46.939060 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859ae58-d4cd-4e89-a18f-efc4da630a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:46.939358 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859ae58-d4cd-4e89-a18f-efc4da630a7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:46.949529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859ae58-d4cd-4e89-a18f-efc4da630a7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:46.951499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859ae58-d4cd-4e89-a18f-efc4da630a7f None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:46.965594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-4859ae58-d4cd-4e89-a18f-efc4da630a7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:34:46.965594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:34:46.965594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:34:46.965594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:34:46.965594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:34:46.965594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:34:46.965594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:34:46.965594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:34:46.965594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:34:46.965594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:34:46.965594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:34:46.965594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:34:46.965594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:34:46.965594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:34:46.965594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:34:46.965594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:34:46.967319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:34:46.967319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:34:46.967319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:34:46.967319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:34:46.967319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:34:46.967319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:34:46.967319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:34:46.967319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:34:46.967319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:34:46.967319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:34:46.967319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:34:46.967319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:34:46.967319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:34:46.967319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:34:46.967319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:34:46.967319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:34:46.967319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:34:46.968393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:34:46.968393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:34:46.968393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:34:46.968393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 598/1224] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:34:46.973197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2dba6-0d15-420f-9b4a-6ee61369bcf7 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:47.082989 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2dba6-0d15-420f-9b4a-6ee61369bcf7 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:47.117575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a02e57-ad22-4a0e-897a-dfeaac680fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:47.119000 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a02e57-ad22-4a0e-897a-dfeaac680fef None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:47.119000 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a02e57-ad22-4a0e-897a-dfeaac680fef None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:47.119000 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a02e57-ad22-4a0e-897a-dfeaac680fef None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:47.119431 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a02e57-ad22-4a0e-897a-dfeaac680fef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:47.119730 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a02e57-ad22-4a0e-897a-dfeaac680fef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:47.121080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a02e57-ad22-4a0e-897a-dfeaac680fef None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:47.134447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 627/1225] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:34:47.140885 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859ae58-d4cd-4e89-a18f-efc4da630a7f None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:47.243132 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:47.251507 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859ae58-d4cd-4e89-a18f-efc4da630a7f None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:47.286225 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bb113-d4c0-47b6-bbfd-1dafb2a7b6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:47.286807 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bb113-d4c0-47b6-bbfd-1dafb2a7b6b8 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:47.287153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bb113-d4c0-47b6-bbfd-1dafb2a7b6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:47.287424 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bb113-d4c0-47b6-bbfd-1dafb2a7b6b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:47.295088 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bb113-d4c0-47b6-bbfd-1dafb2a7b6b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:47.296525 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bb113-d4c0-47b6-bbfd-1dafb2a7b6b8 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:47.308148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-105bb113-d4c0-47b6-bbfd-1dafb2a7b6b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 00:34:47.308148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:34:47.308148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:34:47.308148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:34:47.308148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:34:47.308148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:34:47.308148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:34:47.308148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:34:47.308148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:34:47.308148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:34:47.308148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:34:47.308148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:34:47.308148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:34:47.308148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:34:47.308148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:34:47.308148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:34:47.310238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:34:47.310238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:34:47.310238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:34:47.310238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:34:47.310238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:34:47.310238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:34:47.310238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:34:47.310238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:34:47.310238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:34:47.310238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:34:47.310238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:34:47.310238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:34:47.310238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:34:47.310238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:34:47.310238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:34:47.310238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:34:47.310238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:34:47.310238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:34:47.311784 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:34:47.311784 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:34:47.311784 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:34:47.311784 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:34:47.311784 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:34:47.311784 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:34:47.311784 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:34:47.311784 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:34:47.311784 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 00:34:47.311784 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:34:47.311784 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 599/1226] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:34:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:34:47.315958 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a02e57-ad22-4a0e-897a-dfeaac680fef None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:47.366182 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:47.425183 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a02e57-ad22-4a0e-897a-dfeaac680fef None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:47.460551 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e8173-31cd-4d39-9731-f2df0c027107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:47.461240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e8173-31cd-4d39-9731-f2df0c027107 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:47.461521 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e8173-31cd-4d39-9731-f2df0c027107 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:47.461824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e8173-31cd-4d39-9731-f2df0c027107 None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:47.462596 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e8173-31cd-4d39-9731-f2df0c027107 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:47.462963 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e8173-31cd-4d39-9731-f2df0c027107 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:47.464447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e8173-31cd-4d39-9731-f2df0c027107 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:47.484400 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 628/1227] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Sep 15 00:34:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:34:47.490608 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bb113-d4c0-47b6-bbfd-1dafb2a7b6b8 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:47.596524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bb113-d4c0-47b6-bbfd-1dafb2a7b6b8 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:47.637095 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6acb60-52ab-44bf-82a6-3587a96eeb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:47.637925 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6acb60-52ab-44bf-82a6-3587a96eeb9a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:47.638212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6acb60-52ab-44bf-82a6-3587a96eeb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:47.638585 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6acb60-52ab-44bf-82a6-3587a96eeb9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:47.651039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6acb60-52ab-44bf-82a6-3587a96eeb9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:47.652736 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6acb60-52ab-44bf-82a6-3587a96eeb9a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:47.670115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-7f6acb60-52ab-44bf-82a6-3587a96eeb9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:34:47.670115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:34:47.670115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:34:47.670115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:34:47.670115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:34:47.670115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:34:47.670115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:34:47.670115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:34:47.670115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:34:47.670115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:34:47.670115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:34:47.670115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:34:47.670115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:34:47.670115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:34:47.670115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:34:47.670115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:34:47.671271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:34:47.671271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:34:47.671271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:34:47.671271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:34:47.671271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:34:47.671271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:34:47.671271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:34:47.671271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:34:47.671271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:34:47.671271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:34:47.671271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:34:47.671271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:34:47.671271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:34:47.671271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:34:47.671271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:34:47.671271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:34:47.671271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:34:47.672211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:34:47.672211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:34:47.672211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:34:47.672211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 600/1228] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:34:47.677366 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e8173-31cd-4d39-9731-f2df0c027107 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:47.787045 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e8173-31cd-4d39-9731-f2df0c027107 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:47.790035 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:47.829627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74d7e6-7dab-44c6-b3b3-93abd5482304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:47.830231 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74d7e6-7dab-44c6-b3b3-93abd5482304 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:47.830513 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74d7e6-7dab-44c6-b3b3-93abd5482304 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:47.830787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74d7e6-7dab-44c6-b3b3-93abd5482304 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:47.831459 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74d7e6-7dab-44c6-b3b3-93abd5482304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:47.831878 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74d7e6-7dab-44c6-b3b3-93abd5482304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:47.833715 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74d7e6-7dab-44c6-b3b3-93abd5482304 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:47.846452 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 629/1229] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:34:47.854484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6acb60-52ab-44bf-82a6-3587a96eeb9a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:47.865282 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:47.964088 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6acb60-52ab-44bf-82a6-3587a96eeb9a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:48.000552 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da012a-9529-422e-8f89-3b4c4d0f85ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:48.001295 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da012a-9529-422e-8f89-3b4c4d0f85ea None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:48.001579 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da012a-9529-422e-8f89-3b4c4d0f85ea None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:48.001852 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da012a-9529-422e-8f89-3b4c4d0f85ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:48.009391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da012a-9529-422e-8f89-3b4c4d0f85ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:48.011030 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da012a-9529-422e-8f89-3b4c4d0f85ea None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:48.024089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-48da012a-9529-422e-8f89-3b4c4d0f85ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:34:48.024089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:34:48.024089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:34:48.024089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:34:48.024089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:34:48.024089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:34:48.024089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:34:48.024089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:34:48.024089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:34:48.024089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:34:48.024089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:34:48.024089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:34:48.024089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:34:48.024089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:34:48.024089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:34:48.025313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:34:48.025313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:34:48.025313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:34:48.025313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:34:48.025313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:34:48.025313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:34:48.025313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:34:48.025313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:34:48.025313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:34:48.025313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:34:48.025313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:34:48.025313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:34:48.025313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:34:48.025313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:34:48.025313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:34:48.025313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:34:48.025313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:34:48.026425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:34:48.026425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:34:48.026425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:34:48.026425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:34:48.026425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:34:48.026425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:34:48.026425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:34:48.026425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:34:48.031241 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 601/1230] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:34:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:34:48.032576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74d7e6-7dab-44c6-b3b3-93abd5482304 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:48.144892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74d7e6-7dab-44c6-b3b3-93abd5482304 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:48.179014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ac73c-c1d2-4954-9963-269ebdbe9d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:48.179614 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ac73c-c1d2-4954-9963-269ebdbe9d7f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:48.179888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ac73c-c1d2-4954-9963-269ebdbe9d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:48.180155 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ac73c-c1d2-4954-9963-269ebdbe9d7f None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:48.180879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ac73c-c1d2-4954-9963-269ebdbe9d7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:48.181163 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ac73c-c1d2-4954-9963-269ebdbe9d7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:48.182570 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ac73c-c1d2-4954-9963-269ebdbe9d7f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:48.195417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 630/1231] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:34:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:34:48.201747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da012a-9529-422e-8f89-3b4c4d0f85ea None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:48.267581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:48.304888 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da012a-9529-422e-8f89-3b4c4d0f85ea None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:48.347275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02984a20-c0ef-4851-84d4-81821abcb5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:48.347976 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02984a20-c0ef-4851-84d4-81821abcb5cc None admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:48.348284 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02984a20-c0ef-4851-84d4-81821abcb5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:48.348559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02984a20-c0ef-4851-84d4-81821abcb5cc None admin] PATH_INFO: `/v3/projects/f25792dd210b42c4a3491096a735f909/users/6ed987b44d934ac7b2dc64c0aab28099/roles/e5b76a8345d542c2a899f8dbdd95290d` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:48.364921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02984a20-c0ef-4851-84d4-81821abcb5cc None admin] RBAC: Authorizing `identity:create_grant(project_id=f25792dd210b42c4a3491096a735f909, user_id=6ed987b44d934ac7b2dc64c0aab28099, role_id=e5b76a8345d542c2a899f8dbdd95290d)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:48.366409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02984a20-c0ef-4851-84d4-81821abcb5cc None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:48.381126 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 602/1232] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:34:48 2022] PUT /identity/v3/projects/f25792dd210b42c4a3491096a735f909/users/6ed987b44d934ac7b2dc64c0aab28099/roles/e5b76a8345d542c2a899f8dbdd95290d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:34:50.541495 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe527d75-8c55-42f8-9533-0f795925ab02 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:50.542079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe527d75-8c55-42f8-9533-0f795925ab02 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:50.542189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe527d75-8c55-42f8-9533-0f795925ab02 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:50.544356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 631/1233] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:34:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:34:50.550111 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b7d16-088d-40c6-8d26-66821e5f855c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:50.550575 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b7d16-088d-40c6-8d26-66821e5f855c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:50.550752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b7d16-088d-40c6-8d26-66821e5f855c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:50.570791 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-994b7d16-088d-40c6-8d26-66821e5f855c None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:34:50.571983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-994b7d16-088d-40c6-8d26-66821e5f855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:34:50.642429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 603/1234] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:34:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:34:50.913439 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe527d75-8c55-42f8-9533-0f795925ab02 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:50.942712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:51.031054 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe527d75-8c55-42f8-9533-0f795925ab02 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:51.072767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2558f-1e82-457a-b1a9-f02f3a80a890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:51.073437 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2558f-1e82-457a-b1a9-f02f3a80a890 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:51.073791 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2558f-1e82-457a-b1a9-f02f3a80a890 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:51.073968 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2558f-1e82-457a-b1a9-f02f3a80a890 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:51.086011 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2558f-1e82-457a-b1a9-f02f3a80a890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:34:51.092360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-1cf2558f-1e82-457a-b1a9-f02f3a80a890 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:34:51.092360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:34:51.092360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:34:51.092360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:34:51.092360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:34:51.092360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:34:51.092360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:34:51.092360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:34:51.092360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:34:51.092360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:34:51.092360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:34:51.092360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:34:51.092360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:34:51.092360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:34:51.092360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:34:51.092360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:34:51.093575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:34:51.093575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:34:51.093575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:34:51.093575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:34:51.093575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:34:51.093575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:34:51.093575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:34:51.093575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:34:51.093575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:34:51.093575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:34:51.093575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:34:51.093575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:34:51.093575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:34:51.093575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:34:51.093575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:34:51.093575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:34:51.098485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:34:51.098485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:34:51.098485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:34:51.098485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:34:51.098485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:34:51.098485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:34:51.098485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:34:51.098485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:34:51.098485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:34:51.098485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:34:51.098485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 00:34:51.098485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:34:51.098485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 632/1235] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Sep 15 00:34:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:34:51.099774 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b7d16-088d-40c6-8d26-66821e5f855c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:51.147159 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:51.209768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b7d16-088d-40c6-8d26-66821e5f855c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:51.249616 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0770cd-1d31-4c28-bcec-139a526dc541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:51.250253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0770cd-1d31-4c28-bcec-139a526dc541 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:51.250526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0770cd-1d31-4c28-bcec-139a526dc541 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:51.250792 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0770cd-1d31-4c28-bcec-139a526dc541 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:51.251447 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0770cd-1d31-4c28-bcec-139a526dc541 None admin] RBAC: Adding query filter params (name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:51.251745 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0770cd-1d31-4c28-bcec-139a526dc541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:51.253133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0770cd-1d31-4c28-bcec-139a526dc541 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:51.267574 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 604/1236] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Sep 15 00:34:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:34:51.269027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2558f-1e82-457a-b1a9-f02f3a80a890 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:51.359255 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:51.375012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2558f-1e82-457a-b1a9-f02f3a80a890 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:51.412246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedeadf-176f-417b-8816-63fa109b7e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:51.412874 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedeadf-176f-417b-8816-63fa109b7e81 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:51.413169 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedeadf-176f-417b-8816-63fa109b7e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:51.413441 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedeadf-176f-417b-8816-63fa109b7e81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:51.423990 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedeadf-176f-417b-8816-63fa109b7e81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:51.425533 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedeadf-176f-417b-8816-63fa109b7e81 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:51.441505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-eaedeadf-176f-417b-8816-63fa109b7e81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:34:51.441505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:34:51.441505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:34:51.441505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:34:51.441505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:34:51.441505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:34:51.441505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:34:51.441505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:34:51.441505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:34:51.441505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:34:51.441505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:34:51.441505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:34:51.441505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:34:51.441505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:34:51.441505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:34:51.441505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:34:51.442581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:34:51.442581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:34:51.442581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:34:51.442581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:34:51.442581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:34:51.442581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:34:51.442581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:34:51.442581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:34:51.442581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:34:51.442581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:34:51.442581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:34:51.442581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:34:51.442581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:34:51.442581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:34:51.442581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:34:51.442581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:34:51.442581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:34:51.443923 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:34:51.443923 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:34:51.443923 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:34:51.443923 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 633/1237] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:34:51.450821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0770cd-1d31-4c28-bcec-139a526dc541 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:51.555256 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0770cd-1d31-4c28-bcec-139a526dc541 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:51.565322 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:51.597946 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0787fa-d4f8-495f-b061-dfa933d4cc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:51.598613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0787fa-d4f8-495f-b061-dfa933d4cc23 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:51.598930 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0787fa-d4f8-495f-b061-dfa933d4cc23 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:51.599233 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0787fa-d4f8-495f-b061-dfa933d4cc23 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:51.599964 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0787fa-d4f8-495f-b061-dfa933d4cc23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:51.600284 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0787fa-d4f8-495f-b061-dfa933d4cc23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:51.601873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0787fa-d4f8-495f-b061-dfa933d4cc23 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:51.614768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 605/1238] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:34:51.620489 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedeadf-176f-417b-8816-63fa109b7e81 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:51.735715 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedeadf-176f-417b-8816-63fa109b7e81 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:51.773415 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b37b8-88ce-4dc9-89e9-4ed82404a5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:51.774034 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b37b8-88ce-4dc9-89e9-4ed82404a5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:51.774376 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b37b8-88ce-4dc9-89e9-4ed82404a5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:51.774649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b37b8-88ce-4dc9-89e9-4ed82404a5d7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:51.777596 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:51.784170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b37b8-88ce-4dc9-89e9-4ed82404a5d7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:51.785844 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b37b8-88ce-4dc9-89e9-4ed82404a5d7 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:51.798326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-ba4b37b8-88ce-4dc9-89e9-4ed82404a5d7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 00:34:51.798326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:34:51.798326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:34:51.798326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:34:51.798326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:34:51.798326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:34:51.798326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:34:51.798326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:34:51.798326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:34:51.798326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:34:51.798326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:34:51.798326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:34:51.798326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:34:51.798326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:34:51.798326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:34:51.798326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:34:51.799356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:34:51.799356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:34:51.799356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:34:51.799356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:34:51.799356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:34:51.799356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:34:51.799356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:34:51.799356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:34:51.799356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:34:51.799356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:34:51.799356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:34:51.799356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:34:51.799356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:34:51.799356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:34:51.799356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:34:51.799356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:34:51.799356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:34:51.799356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:34:51.800665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:34:51.800665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:34:51.800665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:34:51.800665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:34:51.800665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:34:51.800665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:34:51.800665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:34:51.800665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:34:51.800665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 00:34:51.800665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:34:51.800665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 634/1239] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:34:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:34:51.805830 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0787fa-d4f8-495f-b061-dfa933d4cc23 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:51.916236 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0787fa-d4f8-495f-b061-dfa933d4cc23 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:51.953469 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c61d80-07bc-4ba8-9937-4045da4a9c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:51.954078 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c61d80-07bc-4ba8-9937-4045da4a9c0d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:51.956835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c61d80-07bc-4ba8-9937-4045da4a9c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:51.956835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c61d80-07bc-4ba8-9937-4045da4a9c0d None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:51.956835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c61d80-07bc-4ba8-9937-4045da4a9c0d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:51.956835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c61d80-07bc-4ba8-9937-4045da4a9c0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:51.957262 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c61d80-07bc-4ba8-9937-4045da4a9c0d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:51.975080 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 606/1240] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Sep 15 00:34:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:34:51.982451 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b37b8-88ce-4dc9-89e9-4ed82404a5d7 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:52.091726 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b37b8-88ce-4dc9-89e9-4ed82404a5d7 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:52.133056 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147eb615-1060-447c-a541-bc81ff6565d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:52.133793 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147eb615-1060-447c-a541-bc81ff6565d3 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:52.134171 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147eb615-1060-447c-a541-bc81ff6565d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:52.134534 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147eb615-1060-447c-a541-bc81ff6565d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:52.203913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:52.211681 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147eb615-1060-447c-a541-bc81ff6565d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:52.213179 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147eb615-1060-447c-a541-bc81ff6565d3 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:52.328924 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 635/1241] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:34:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 00:34:52.331924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c61d80-07bc-4ba8-9937-4045da4a9c0d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:52.361058 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:52.439984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c61d80-07bc-4ba8-9937-4045da4a9c0d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:52.475720 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acf178-dcc3-4827-9886-2ee4bdf9a428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:52.476348 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acf178-dcc3-4827-9886-2ee4bdf9a428 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:52.476622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acf178-dcc3-4827-9886-2ee4bdf9a428 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:52.476891 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acf178-dcc3-4827-9886-2ee4bdf9a428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:52.488278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acf178-dcc3-4827-9886-2ee4bdf9a428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:52.489766 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acf178-dcc3-4827-9886-2ee4bdf9a428 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:52.504781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-76acf178-dcc3-4827-9886-2ee4bdf9a428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:34:52.504781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:34:52.504781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:34:52.504781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:34:52.504781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:34:52.504781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:34:52.504781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:34:52.504781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:34:52.504781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:34:52.504781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:34:52.504781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:34:52.504781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:34:52.504781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:34:52.504781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:34:52.504781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:34:52.504781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:34:52.506153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:34:52.506153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:34:52.506153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:34:52.506153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:34:52.506153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:34:52.506153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:34:52.506153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:34:52.506153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:34:52.506153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:34:52.506153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:34:52.506153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:34:52.506153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:34:52.506153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:34:52.506153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:34:52.506153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:34:52.506153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:34:52.506153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:34:52.507283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:34:52.507283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:34:52.507283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:34:52.507283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 607/1242] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:34:52.511614 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147eb615-1060-447c-a541-bc81ff6565d3 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:52.616134 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:52.623279 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147eb615-1060-447c-a541-bc81ff6565d3 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:52.659800 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be157ae6-e554-4288-b0a0-1dd6b2b9291f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:52.660402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be157ae6-e554-4288-b0a0-1dd6b2b9291f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:52.660678 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be157ae6-e554-4288-b0a0-1dd6b2b9291f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:52.660951 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be157ae6-e554-4288-b0a0-1dd6b2b9291f None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:52.661625 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be157ae6-e554-4288-b0a0-1dd6b2b9291f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:52.661919 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be157ae6-e554-4288-b0a0-1dd6b2b9291f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:52.663308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be157ae6-e554-4288-b0a0-1dd6b2b9291f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:52.674821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 636/1243] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:34:52.680737 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acf178-dcc3-4827-9886-2ee4bdf9a428 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:52.769708 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:52.793556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acf178-dcc3-4827-9886-2ee4bdf9a428 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:52.829746 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6c028-de38-47a7-a96f-d3a29e2d4ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:52.830381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6c028-de38-47a7-a96f-d3a29e2d4ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:52.830644 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6c028-de38-47a7-a96f-d3a29e2d4ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:52.830910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6c028-de38-47a7-a96f-d3a29e2d4ca9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:52.837615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6c028-de38-47a7-a96f-d3a29e2d4ca9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:52.839087 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6c028-de38-47a7-a96f-d3a29e2d4ca9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:52.853918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-1ba6c028-de38-47a7-a96f-d3a29e2d4ca9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:34:52.853918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:34:52.853918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:34:52.853918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:34:52.853918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:34:52.853918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:34:52.853918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:34:52.853918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:34:52.853918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:34:52.853918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:34:52.853918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:34:52.853918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:34:52.853918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:34:52.853918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:34:52.853918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:34:52.855009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:34:52.855009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:34:52.855009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:34:52.855009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:34:52.855009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:34:52.855009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:34:52.855009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:34:52.855009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:34:52.855009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:34:52.855009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:34:52.855009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:34:52.855009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:34:52.855009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:34:52.855009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:34:52.855009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:34:52.855009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:34:52.855009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:34:52.856009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:34:52.856009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:34:52.856009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:34:52.856009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:34:52.856009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:34:52.856009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:34:52.856009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:34:52.856009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:34:52.856009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 608/1244] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:34:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:34:52.861487 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be157ae6-e554-4288-b0a0-1dd6b2b9291f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:52.971112 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be157ae6-e554-4288-b0a0-1dd6b2b9291f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:53.010358 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d900141-314d-4214-941c-21ee2c4f9cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:53.011077 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d900141-314d-4214-941c-21ee2c4f9cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:53.011364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d900141-314d-4214-941c-21ee2c4f9cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:53.011636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d900141-314d-4214-941c-21ee2c4f9cf5 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:53.012903 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d900141-314d-4214-941c-21ee2c4f9cf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:53.013360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d900141-314d-4214-941c-21ee2c4f9cf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:53.014792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d900141-314d-4214-941c-21ee2c4f9cf5 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:53.028657 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 637/1245] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:34:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:34:53.035011 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6c028-de38-47a7-a96f-d3a29e2d4ca9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:53.154807 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6c028-de38-47a7-a96f-d3a29e2d4ca9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:53.191274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d6567-e7c8-4f4f-821e-a434799c192d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:53.192192 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d6567-e7c8-4f4f-821e-a434799c192d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:53.192689 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d6567-e7c8-4f4f-821e-a434799c192d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:53.193104 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d6567-e7c8-4f4f-821e-a434799c192d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:53.193867 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d6567-e7c8-4f4f-821e-a434799c192d None admin] RBAC: Adding query filter params (role.id=e5b76a8345d542c2a899f8dbdd95290d, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=6ed987b44d934ac7b2dc64c0aab28099) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:53.194145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d6567-e7c8-4f4f-821e-a434799c192d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:53.195660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d6567-e7c8-4f4f-821e-a434799c192d None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:53.203181 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 609/1246] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:34:53 2022] GET /identity/v3/role_assignments?user.id=6ed987b44d934ac7b2dc64c0aab28099&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=e5b76a8345d542c2a899f8dbdd95290d => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:34:55.437007 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422b810-3491-4bab-8878-e3618ed7746c None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:55.437652 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422b810-3491-4bab-8878-e3618ed7746c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:55.437652 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422b810-3491-4bab-8878-e3618ed7746c None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:55.439159 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 638/1247] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:34:55.444486 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c4ef1-dcbd-4098-9a87-f90c2b76d1f0 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:55.444944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c4ef1-dcbd-4098-9a87-f90c2b76d1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:55.445034 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c4ef1-dcbd-4098-9a87-f90c2b76d1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:55.452789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:55.466923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-072c4ef1-dcbd-4098-9a87-f90c2b76d1f0 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:34:55.468249 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-072c4ef1-dcbd-4098-9a87-f90c2b76d1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:34:55.540956 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 610/1248] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:34:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 00:34:55.810346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422b810-3491-4bab-8878-e3618ed7746c None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:55.830887 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:55.918742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422b810-3491-4bab-8878-e3618ed7746c None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:55.964001 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0ef48-3ba3-44dd-b3a5-8dfe290a5a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:55.964605 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0ef48-3ba3-44dd-b3a5-8dfe290a5a4b None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:55.965004 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0ef48-3ba3-44dd-b3a5-8dfe290a5a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:55.966019 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0ef48-3ba3-44dd-b3a5-8dfe290a5a4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:55.980758 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0ef48-3ba3-44dd-b3a5-8dfe290a5a4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:34:55.988139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-80c0ef48-3ba3-44dd-b3a5-8dfe290a5a4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:34:55.988139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:34:55.988139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:34:55.988139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:34:55.988139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:34:55.988139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:34:55.988139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:34:55.988139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:34:55.988139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:34:55.988139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:34:55.988139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:34:55.988139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:34:55.988139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:34:55.988139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:34:55.988139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:34:55.988139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:34:55.990099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:34:55.990099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:34:55.990099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:34:55.990099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:34:55.990099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:34:55.990099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:34:55.990099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:34:55.990099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:34:55.990099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:34:55.990099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:34:55.990099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:34:55.990099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:34:55.990099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:34:55.990099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:34:55.990099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:34:55.990099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:34:55.991981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:34:55.991981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:34:55.991981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:34:55.991981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:34:55.991981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:34:55.991981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:34:55.991981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:34:55.991981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:34:55.991981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:34:55.991981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:34:55.991981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:34:55.991981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:34:55.991981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 639/1249] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:34:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:34:55.996811 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c4ef1-dcbd-4098-9a87-f90c2b76d1f0 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:56.101546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c4ef1-dcbd-4098-9a87-f90c2b76d1f0 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:56.131882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:56.137123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d05c35-07ea-4961-9d9f-4132536b4e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:56.138343 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d05c35-07ea-4961-9d9f-4132536b4e97 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:56.138621 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d05c35-07ea-4961-9d9f-4132536b4e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:56.138889 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d05c35-07ea-4961-9d9f-4132536b4e97 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:56.139543 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d05c35-07ea-4961-9d9f-4132536b4e97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:56.139842 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d05c35-07ea-4961-9d9f-4132536b4e97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:56.141234 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d05c35-07ea-4961-9d9f-4132536b4e97 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:56.149403 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 611/1250] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:34:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:34:56.155355 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0ef48-3ba3-44dd-b3a5-8dfe290a5a4b None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:56.234370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:56.260349 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0ef48-3ba3-44dd-b3a5-8dfe290a5a4b None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:56.298111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36547d-6db7-4472-bc76-c0c960233908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:56.298764 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36547d-6db7-4472-bc76-c0c960233908 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:56.299069 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36547d-6db7-4472-bc76-c0c960233908 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:56.299331 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36547d-6db7-4472-bc76-c0c960233908 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:56.312799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36547d-6db7-4472-bc76-c0c960233908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:56.317636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36547d-6db7-4472-bc76-c0c960233908 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:56.337574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-9b36547d-6db7-4472-bc76-c0c960233908 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:34:56.337574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:34:56.337574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:34:56.337574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:34:56.337574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:34:56.337574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:34:56.337574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:34:56.337574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:34:56.337574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:34:56.337574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:34:56.337574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:34:56.337574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:34:56.337574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:34:56.337574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:34:56.337574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:34:56.337574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:34:56.338654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:34:56.338654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:34:56.338654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:34:56.338654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:34:56.338654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:34:56.338654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:34:56.338654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:34:56.338654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:34:56.338654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:34:56.338654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:34:56.338654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:34:56.338654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:34:56.338654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:34:56.338654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:34:56.338654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:34:56.338654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:34:56.338654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:34:56.339574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:34:56.339574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:34:56.339574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:34:56.339574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 640/1251] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:34:56.344809 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d05c35-07ea-4961-9d9f-4132536b4e97 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:56.451778 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d05c35-07ea-4961-9d9f-4132536b4e97 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:56.485504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c4fd4-aed4-4ead-94b3-206cee12e3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:56.486099 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c4fd4-aed4-4ead-94b3-206cee12e3ce None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:56.486378 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c4fd4-aed4-4ead-94b3-206cee12e3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:56.486664 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c4fd4-aed4-4ead-94b3-206cee12e3ce None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:56.487280 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c4fd4-aed4-4ead-94b3-206cee12e3ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:56.487579 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c4fd4-aed4-4ead-94b3-206cee12e3ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:56.489019 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c4fd4-aed4-4ead-94b3-206cee12e3ce None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:56.503039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 612/1252] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:34:56.508861 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36547d-6db7-4472-bc76-c0c960233908 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:56.616620 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36547d-6db7-4472-bc76-c0c960233908 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:56.645991 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:56.654608 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029c51d-a155-4918-9f9f-5e686f7f2087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:56.655260 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029c51d-a155-4918-9f9f-5e686f7f2087 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:56.655540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029c51d-a155-4918-9f9f-5e686f7f2087 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:56.655809 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029c51d-a155-4918-9f9f-5e686f7f2087 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:56.664455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029c51d-a155-4918-9f9f-5e686f7f2087 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:56.665938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029c51d-a155-4918-9f9f-5e686f7f2087 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:56.678674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-0029c51d-a155-4918-9f9f-5e686f7f2087 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 00:34:56.678674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:34:56.678674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:34:56.678674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:34:56.678674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:34:56.678674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:34:56.678674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:34:56.678674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:34:56.678674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:34:56.678674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:34:56.678674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:34:56.678674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:34:56.678674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:34:56.678674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:34:56.678674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:34:56.678674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:34:56.679867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:34:56.679867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:34:56.679867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:34:56.679867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:34:56.679867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:34:56.679867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:34:56.679867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:34:56.679867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:34:56.679867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:34:56.679867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:34:56.679867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:34:56.679867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:34:56.679867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:34:56.679867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:34:56.679867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:34:56.679867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:34:56.679867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:34:56.679867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:34:56.680960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:34:56.680960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:34:56.680960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:34:56.680960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:34:56.680960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:34:56.680960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:34:56.680960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:34:56.680960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:34:56.680960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 00:34:56.680960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:34:56.680960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 641/1253] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:34:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:34:56.686545 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c4fd4-aed4-4ead-94b3-206cee12e3ce None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:56.745624 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:56.792898 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c4fd4-aed4-4ead-94b3-206cee12e3ce None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:56.828643 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17312c99-c5a9-49aa-8c40-3dd079f5e5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:56.829291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17312c99-c5a9-49aa-8c40-3dd079f5e5af None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:56.829568 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17312c99-c5a9-49aa-8c40-3dd079f5e5af None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:56.829835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17312c99-c5a9-49aa-8c40-3dd079f5e5af None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:56.830561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17312c99-c5a9-49aa-8c40-3dd079f5e5af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:56.830863 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17312c99-c5a9-49aa-8c40-3dd079f5e5af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:56.832326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17312c99-c5a9-49aa-8c40-3dd079f5e5af None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:56.857632 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 613/1254] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Sep 15 00:34:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:34:56.858831 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029c51d-a155-4918-9f9f-5e686f7f2087 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:56.962763 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029c51d-a155-4918-9f9f-5e686f7f2087 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:56.998302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8325253-545f-4c92-a7df-f76960046c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:56.998820 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8325253-545f-4c92-a7df-f76960046c43 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:56.999094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8325253-545f-4c92-a7df-f76960046c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:56.999359 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8325253-545f-4c92-a7df-f76960046c43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:57.056628 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:57.072624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8325253-545f-4c92-a7df-f76960046c43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:57.074238 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8325253-545f-4c92-a7df-f76960046c43 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:57.180860 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 642/1255] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:34:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 00:34:57.186941 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17312c99-c5a9-49aa-8c40-3dd079f5e5af None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:57.287411 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17312c99-c5a9-49aa-8c40-3dd079f5e5af None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:57.299895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:57.321409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8ffad-dab7-4873-a80c-85fe69500410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:57.322027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8ffad-dab7-4873-a80c-85fe69500410 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:57.322302 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8ffad-dab7-4873-a80c-85fe69500410 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:57.322572 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8ffad-dab7-4873-a80c-85fe69500410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:57.332963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8ffad-dab7-4873-a80c-85fe69500410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:57.334440 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8ffad-dab7-4873-a80c-85fe69500410 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:57.349144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-0fe8ffad-dab7-4873-a80c-85fe69500410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:34:57.349144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:34:57.349144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:34:57.349144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:34:57.349144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:34:57.349144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:34:57.349144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:34:57.349144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:34:57.349144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:34:57.349144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:34:57.349144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:34:57.349144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:34:57.349144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:34:57.349144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:34:57.349144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:34:57.349144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:34:57.350238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:34:57.350238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:34:57.350238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:34:57.350238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:34:57.350238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:34:57.350238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:34:57.350238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:34:57.350238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:34:57.350238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:34:57.350238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:34:57.350238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:34:57.350238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:34:57.350238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:34:57.350238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:34:57.350238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:34:57.350238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:34:57.350238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:34:57.351315 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:34:57.351315 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:34:57.351315 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:34:57.351315 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 614/1256] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:34:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:34:57.357628 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8325253-545f-4c92-a7df-f76960046c43 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:57.441322 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:57.453534 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8325253-545f-4c92-a7df-f76960046c43 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:57.486202 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fe663-29da-4c34-bf54-76cefc91e753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:57.486783 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fe663-29da-4c34-bf54-76cefc91e753 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:57.487057 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fe663-29da-4c34-bf54-76cefc91e753 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:57.487321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fe663-29da-4c34-bf54-76cefc91e753 None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:57.487948 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fe663-29da-4c34-bf54-76cefc91e753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:57.488245 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fe663-29da-4c34-bf54-76cefc91e753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:57.489627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fe663-29da-4c34-bf54-76cefc91e753 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:57.500907 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 643/1257] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:34:57.506507 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8ffad-dab7-4873-a80c-85fe69500410 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:57.601927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8ffad-dab7-4873-a80c-85fe69500410 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:57.634153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81738797-1f2c-4f65-8e9e-a740b6866a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:57.634752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81738797-1f2c-4f65-8e9e-a740b6866a09 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:57.635025 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81738797-1f2c-4f65-8e9e-a740b6866a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:57.635293 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81738797-1f2c-4f65-8e9e-a740b6866a09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:57.642252 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81738797-1f2c-4f65-8e9e-a740b6866a09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:57.643669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81738797-1f2c-4f65-8e9e-a740b6866a09 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:57.654513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-81738797-1f2c-4f65-8e9e-a740b6866a09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:34:57.654513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:34:57.654513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:34:57.654513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:34:57.654513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:34:57.654513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:34:57.654513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:34:57.654513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:34:57.654513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:34:57.654513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:34:57.654513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:34:57.654513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:34:57.654513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:34:57.654513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:34:57.654513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:34:57.655606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:34:57.655606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:34:57.655606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:34:57.655606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:34:57.655606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:34:57.655606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:34:57.655606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:34:57.655606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:34:57.655606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:34:57.655606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:34:57.655606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:34:57.655606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:34:57.655606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:34:57.655606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:34:57.655606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:34:57.655606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:34:57.655606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:34:57.656952 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:34:57.656952 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:34:57.656952 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:34:57.656952 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:34:57.656952 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:34:57.656952 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:34:57.656952 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:34:57.656952 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:34:57.656952 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 615/1258] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:34:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:34:57.661341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fe663-29da-4c34-bf54-76cefc91e753 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:57.758451 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fe663-29da-4c34-bf54-76cefc91e753 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:57.790885 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f0a1d-22dd-47f2-9b26-34c5204acf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:57.791468 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f0a1d-22dd-47f2-9b26-34c5204acf06 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:57.791748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f0a1d-22dd-47f2-9b26-34c5204acf06 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:57.792021 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f0a1d-22dd-47f2-9b26-34c5204acf06 None admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:57.792699 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f0a1d-22dd-47f2-9b26-34c5204acf06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:57.793003 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f0a1d-22dd-47f2-9b26-34c5204acf06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:57.794458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f0a1d-22dd-47f2-9b26-34c5204acf06 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:57.805915 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 644/1259] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:34:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:34:57.812169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81738797-1f2c-4f65-8e9e-a740b6866a09 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:34:57.837323 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:34:57.909053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81738797-1f2c-4f65-8e9e-a740b6866a09 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:34:57.941683 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16106143-4f43-4272-b312-a2a63401232b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:34:57.942262 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16106143-4f43-4272-b312-a2a63401232b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:34:57.942538 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16106143-4f43-4272-b312-a2a63401232b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:34:57.942806 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16106143-4f43-4272-b312-a2a63401232b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:34:57.943514 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16106143-4f43-4272-b312-a2a63401232b None admin] RBAC: Adding query filter params (role.id=0ee2daa9cb3c41fb901603e3d8caf784, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=6ed987b44d934ac7b2dc64c0aab28099) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:34:57.943818 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16106143-4f43-4272-b312-a2a63401232b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:34:57.945264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16106143-4f43-4272-b312-a2a63401232b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:34:57.950422 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 616/1260] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:34:57 2022] GET /identity/v3/role_assignments?user.id=6ed987b44d934ac7b2dc64c0aab28099&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=0ee2daa9cb3c41fb901603e3d8caf784 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:35:00.078751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aab57d-b135-40d5-8383-2bf54d187fd4 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:00.079302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aab57d-b135-40d5-8383-2bf54d187fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:00.079399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aab57d-b135-40d5-8383-2bf54d187fd4 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:00.080826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 645/1261] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:35:00.086533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e3de1-175a-432e-b021-f41071642e3d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:00.086957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e3de1-175a-432e-b021-f41071642e3d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:00.087114 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e3de1-175a-432e-b021-f41071642e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:00.107487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c37e3de1-175a-432e-b021-f41071642e3d None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:35:00.108653 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c37e3de1-175a-432e-b021-f41071642e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:35:00.173761 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 617/1262] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:35:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:35:00.445391 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aab57d-b135-40d5-8383-2bf54d187fd4 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:00.456987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:00.545903 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aab57d-b135-40d5-8383-2bf54d187fd4 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:00.579332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201ace2-8734-43ce-ae11-c74063261150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:00.579933 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201ace2-8734-43ce-ae11-c74063261150 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:00.580210 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201ace2-8734-43ce-ae11-c74063261150 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:00.580477 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201ace2-8734-43ce-ae11-c74063261150 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:00.590196 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201ace2-8734-43ce-ae11-c74063261150 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:35:00.595039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-6201ace2-8734-43ce-ae11-c74063261150 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:35:00.595039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:35:00.595039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:35:00.595039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:35:00.595039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:35:00.595039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:35:00.595039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:35:00.595039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:35:00.595039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:35:00.595039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:35:00.595039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:35:00.595039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:35:00.595039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:35:00.595039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:35:00.595039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:35:00.595039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:35:00.596114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:35:00.596114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:35:00.596114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:35:00.596114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:35:00.596114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:35:00.596114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:35:00.596114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:35:00.596114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:35:00.596114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:35:00.596114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:35:00.596114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:35:00.596114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:35:00.596114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:35:00.596114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:35:00.596114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:35:00.596114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:35:00.597316 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:35:00.597316 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:35:00.597316 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:35:00.597316 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:35:00.597316 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:35:00.597316 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:35:00.597316 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:35:00.597316 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:35:00.597316 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:35:00.597316 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:35:00.597316 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:35:00.597316 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:35:00.597316 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 646/1263] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:35:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:35:00.601908 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e3de1-175a-432e-b021-f41071642e3d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:00.619617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:00.696262 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e3de1-175a-432e-b021-f41071642e3d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:00.729127 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ef670-db17-4bb6-a3c9-36d9ac6ca5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:00.729710 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ef670-db17-4bb6-a3c9-36d9ac6ca5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:00.729981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ef670-db17-4bb6-a3c9-36d9ac6ca5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:00.730244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ef670-db17-4bb6-a3c9-36d9ac6ca5d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:00.730886 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ef670-db17-4bb6-a3c9-36d9ac6ca5d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:35:00.731180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ef670-db17-4bb6-a3c9-36d9ac6ca5d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:00.732554 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ef670-db17-4bb6-a3c9-36d9ac6ca5d3 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:00.740100 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 618/1264] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:35:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:35:00.745744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201ace2-8734-43ce-ae11-c74063261150 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:00.811096 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:00.843962 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201ace2-8734-43ce-ae11-c74063261150 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:00.877687 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de940f8a-1533-4e34-9ce5-f39e1b1144f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:00.878227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de940f8a-1533-4e34-9ce5-f39e1b1144f0 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:00.878502 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de940f8a-1533-4e34-9ce5-f39e1b1144f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:00.878771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de940f8a-1533-4e34-9ce5-f39e1b1144f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:00.888419 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de940f8a-1533-4e34-9ce5-f39e1b1144f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:00.889849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de940f8a-1533-4e34-9ce5-f39e1b1144f0 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:00.903816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-de940f8a-1533-4e34-9ce5-f39e1b1144f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:35:00.903816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:35:00.903816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:35:00.903816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:35:00.903816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:35:00.903816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:35:00.903816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:35:00.903816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:35:00.903816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:35:00.903816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:35:00.903816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:35:00.903816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:35:00.903816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:35:00.903816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:35:00.903816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:35:00.903816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:35:00.904978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:35:00.904978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:35:00.904978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:35:00.904978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:35:00.904978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:35:00.904978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:35:00.904978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:35:00.904978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:35:00.904978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:35:00.904978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:35:00.904978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:35:00.904978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:35:00.904978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:35:00.904978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:35:00.904978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:35:00.904978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:35:00.904978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:35:00.906076 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:35:00.906076 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:35:00.906076 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:35:00.906076 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 647/1265] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:35:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:35:00.910631 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ef670-db17-4bb6-a3c9-36d9ac6ca5d3 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:00.988510 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:01.007561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ef670-db17-4bb6-a3c9-36d9ac6ca5d3 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:01.038927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47173402-edc3-497d-84fb-b95fe9443785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:01.039508 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47173402-edc3-497d-84fb-b95fe9443785 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:01.039782 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47173402-edc3-497d-84fb-b95fe9443785 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:01.040045 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47173402-edc3-497d-84fb-b95fe9443785 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:01.040668 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47173402-edc3-497d-84fb-b95fe9443785 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:35:01.040963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47173402-edc3-497d-84fb-b95fe9443785 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:01.042343 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47173402-edc3-497d-84fb-b95fe9443785 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:01.054364 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 619/1266] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:35:01.060928 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de940f8a-1533-4e34-9ce5-f39e1b1144f0 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:01.160257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de940f8a-1533-4e34-9ce5-f39e1b1144f0 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:01.179146 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:01.194192 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516cf27-ee4e-4f84-8c78-e969760314e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:01.194804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516cf27-ee4e-4f84-8c78-e969760314e1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:01.195077 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516cf27-ee4e-4f84-8c78-e969760314e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:01.195343 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516cf27-ee4e-4f84-8c78-e969760314e1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:01.202609 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516cf27-ee4e-4f84-8c78-e969760314e1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:01.204027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516cf27-ee4e-4f84-8c78-e969760314e1 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:01.214777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-c516cf27-ee4e-4f84-8c78-e969760314e1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 00:35:01.214777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:35:01.214777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:35:01.214777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:35:01.214777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:35:01.214777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:35:01.214777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:35:01.214777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:35:01.214777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:35:01.214777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:35:01.214777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:35:01.214777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:35:01.214777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:35:01.214777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:35:01.214777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:35:01.214777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:35:01.215856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:35:01.215856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:35:01.215856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:35:01.215856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:35:01.215856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:35:01.215856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:35:01.215856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:35:01.215856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:35:01.215856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:35:01.215856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:35:01.215856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:35:01.215856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:35:01.215856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:35:01.215856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:35:01.215856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:35:01.215856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:35:01.215856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:35:01.215856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:35:01.217403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:35:01.217403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:35:01.217403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:35:01.217403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:35:01.217403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:35:01.217403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:35:01.217403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:35:01.217403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:35:01.217403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 00:35:01.217403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:35:01.217403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 648/1267] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:35:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 00:35:01.222158 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47173402-edc3-497d-84fb-b95fe9443785 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:01.325824 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47173402-edc3-497d-84fb-b95fe9443785 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:01.360692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a674fdc-4b5e-4fde-8958-4b52f82f5421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:01.361325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a674fdc-4b5e-4fde-8958-4b52f82f5421 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:01.361609 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a674fdc-4b5e-4fde-8958-4b52f82f5421 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:01.361878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a674fdc-4b5e-4fde-8958-4b52f82f5421 None admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:01.362590 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a674fdc-4b5e-4fde-8958-4b52f82f5421 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:35:01.362896 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a674fdc-4b5e-4fde-8958-4b52f82f5421 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:01.364311 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a674fdc-4b5e-4fde-8958-4b52f82f5421 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:01.372606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:01.381238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 620/1268] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Sep 15 00:35:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:35:01.387107 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516cf27-ee4e-4f84-8c78-e969760314e1 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:01.485219 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516cf27-ee4e-4f84-8c78-e969760314e1 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:01.517427 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b51703-155c-4bf2-abaa-8fa8226f7f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:01.518025 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b51703-155c-4bf2-abaa-8fa8226f7f61 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:01.518298 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b51703-155c-4bf2-abaa-8fa8226f7f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:01.518564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b51703-155c-4bf2-abaa-8fa8226f7f61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:01.529211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b51703-155c-4bf2-abaa-8fa8226f7f61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:01.530630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b51703-155c-4bf2-abaa-8fa8226f7f61 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:01.544662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-b8b51703-155c-4bf2-abaa-8fa8226f7f61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:35:01.544662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:35:01.544662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:35:01.544662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:35:01.544662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:35:01.544662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:35:01.544662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:35:01.544662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:35:01.544662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:35:01.544662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:35:01.544662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:35:01.544662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:35:01.544662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:35:01.544662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:35:01.544662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:35:01.544662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:35:01.545774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:35:01.545774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:35:01.545774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:35:01.545774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:35:01.545774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:35:01.545774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:35:01.545774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:35:01.545774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:35:01.545774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:35:01.545774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:35:01.545774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:35:01.545774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:35:01.545774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:35:01.545774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:35:01.545774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:35:01.545774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:35:01.545774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:35:01.546868 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:35:01.546868 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:35:01.546868 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:35:01.546868 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 649/1269] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:35:01.551339 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a674fdc-4b5e-4fde-8958-4b52f82f5421 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:01.650423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a674fdc-4b5e-4fde-8958-4b52f82f5421 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:01.683349 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6156143-7b80-40ff-9860-8841a68674f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:01.683935 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6156143-7b80-40ff-9860-8841a68674f0 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:01.684214 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6156143-7b80-40ff-9860-8841a68674f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:01.684485 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6156143-7b80-40ff-9860-8841a68674f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:01.685764 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6156143-7b80-40ff-9860-8841a68674f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:35:01.686064 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6156143-7b80-40ff-9860-8841a68674f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:01.687424 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6156143-7b80-40ff-9860-8841a68674f0 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:01.698207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 621/1270] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:35:01.703820 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b51703-155c-4bf2-abaa-8fa8226f7f61 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:01.734645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:01.800916 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b51703-155c-4bf2-abaa-8fa8226f7f61 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:01.832930 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d39fc-7599-40a6-add3-86383929699c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:01.833560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d39fc-7599-40a6-add3-86383929699c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:01.833839 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d39fc-7599-40a6-add3-86383929699c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:01.834109 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d39fc-7599-40a6-add3-86383929699c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:01.840484 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d39fc-7599-40a6-add3-86383929699c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:01.841960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d39fc-7599-40a6-add3-86383929699c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:01.853103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-c09d39fc-7599-40a6-add3-86383929699c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:35:01.853103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:35:01.853103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:35:01.853103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:35:01.853103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:35:01.853103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:35:01.853103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:35:01.853103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:35:01.853103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:35:01.853103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:35:01.853103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:35:01.853103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:35:01.853103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:35:01.853103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:35:01.853103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:35:01.854125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:35:01.854125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:35:01.854125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:35:01.854125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:35:01.854125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:35:01.854125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:35:01.854125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:35:01.854125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:35:01.854125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:35:01.854125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:35:01.854125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:35:01.854125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:35:01.854125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:35:01.854125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:35:01.854125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:35:01.854125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:35:01.854125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:35:01.855197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:35:01.855197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:35:01.855197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:35:01.855197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:35:01.855197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:35:01.855197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:35:01.855197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:35:01.855197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:35:01.855197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 650/1271] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:35:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:35:01.860330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6156143-7b80-40ff-9860-8841a68674f0 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:01.915573 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:01.955954 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6156143-7b80-40ff-9860-8841a68674f0 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:01.988614 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba81456-809e-47e8-b376-0c4779f23adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:01.989231 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba81456-809e-47e8-b376-0c4779f23adf None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:01.989510 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba81456-809e-47e8-b376-0c4779f23adf None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:01.989779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba81456-809e-47e8-b376-0c4779f23adf None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:01.990458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba81456-809e-47e8-b376-0c4779f23adf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:35:01.990758 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba81456-809e-47e8-b376-0c4779f23adf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:01.992175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba81456-809e-47e8-b376-0c4779f23adf None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:02.003631 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 622/1272] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:35:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:35:02.009523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d39fc-7599-40a6-add3-86383929699c None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:02.101426 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:02.110710 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d39fc-7599-40a6-add3-86383929699c None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:02.142155 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c806d0f-c4b0-4b84-879a-6092529ac971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:02.142792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c806d0f-c4b0-4b84-879a-6092529ac971 None admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:02.143067 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c806d0f-c4b0-4b84-879a-6092529ac971 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:02.143334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c806d0f-c4b0-4b84-879a-6092529ac971 None admin] PATH_INFO: `/v3/projects/f25792dd210b42c4a3491096a735f909/users/6ed987b44d934ac7b2dc64c0aab28099/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:02.145192 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c806d0f-c4b0-4b84-879a-6092529ac971 None admin] RBAC: Authorizing `identity:create_grant(project_id=f25792dd210b42c4a3491096a735f909, user_id=6ed987b44d934ac7b2dc64c0aab28099, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:02.146592 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c806d0f-c4b0-4b84-879a-6092529ac971 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:02.158694 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 651/1273] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Sep 15 00:35:02 2022] PUT /identity/v3/projects/f25792dd210b42c4a3491096a735f909/users/6ed987b44d934ac7b2dc64c0aab28099/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:35:04.235521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743066a-fac7-4bc6-a9d9-90c71744def6 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:04.236090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743066a-fac7-4bc6-a9d9-90c71744def6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:04.236090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743066a-fac7-4bc6-a9d9-90c71744def6 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:04.237420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 623/1274] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:35:04.242457 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5524d4c-aec9-4310-b35e-9c6e6052b148 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:04.242832 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5524d4c-aec9-4310-b35e-9c6e6052b148 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:04.243003 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5524d4c-aec9-4310-b35e-9c6e6052b148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:04.261328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b5524d4c-aec9-4310-b35e-9c6e6052b148 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:35:04.262493 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b5524d4c-aec9-4310-b35e-9c6e6052b148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:35:04.326829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 652/1275] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:35:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:35:04.590097 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743066a-fac7-4bc6-a9d9-90c71744def6 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:04.688855 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743066a-fac7-4bc6-a9d9-90c71744def6 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:04.705275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:04.721467 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18134b-4ff1-42a0-b924-f3ba70d8723d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:04.722079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18134b-4ff1-42a0-b924-f3ba70d8723d None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:04.722358 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18134b-4ff1-42a0-b924-f3ba70d8723d None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:04.722630 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18134b-4ff1-42a0-b924-f3ba70d8723d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:04.733101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d18134b-4ff1-42a0-b924-f3ba70d8723d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 00:35:04.737829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-8d18134b-4ff1-42a0-b924-f3ba70d8723d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:35:04.737829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:35:04.737829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:35:04.737829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:35:04.737829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:35:04.737829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:35:04.737829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:35:04.737829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:35:04.737829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:35:04.737829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:35:04.737829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:35:04.737829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:35:04.737829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 00:35:04.737829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 00:35:04.737829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 00:35:04.737829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 00:35:04.738922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 00:35:04.738922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 00:35:04.738922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 00:35:04.738922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 00:35:04.738922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:35:04.738922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:35:04.738922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:35:04.738922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:35:04.738922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:35:04.738922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:35:04.738922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:35:04.738922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:35:04.738922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:35:04.738922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:35:04.738922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:35:04.738922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:35:04.739961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:35:04.739961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:35:04.739961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:35:04.739961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:35:04.739961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 00:35:04.739961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 00:35:04.739961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 00:35:04.739961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 00:35:04.739961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 00:35:04.739961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 00:35:04.739961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 00:35:04.739961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:35:04.739961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 624/1276] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Sep 15 00:35:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:35:04.744818 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5524d4c-aec9-4310-b35e-9c6e6052b148 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:04.822993 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:04.841225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5524d4c-aec9-4310-b35e-9c6e6052b148 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:04.874716 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210afbf-eea7-4acf-b243-a228744329d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:04.875311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210afbf-eea7-4acf-b243-a228744329d9 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:04.875592 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210afbf-eea7-4acf-b243-a228744329d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:04.875866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210afbf-eea7-4acf-b243-a228744329d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:04.876525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210afbf-eea7-4acf-b243-a228744329d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:35:04.876829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210afbf-eea7-4acf-b243-a228744329d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:04.878214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210afbf-eea7-4acf-b243-a228744329d9 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:04.885958 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 653/1277] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Sep 15 00:35:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:35:04.891641 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18134b-4ff1-42a0-b924-f3ba70d8723d None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:04.987882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18134b-4ff1-42a0-b924-f3ba70d8723d None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:05.020042 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5fe59-2500-4474-9204-24e577dd36fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:05.020637 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5fe59-2500-4474-9204-24e577dd36fa None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:05.020914 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5fe59-2500-4474-9204-24e577dd36fa None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:05.021213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5fe59-2500-4474-9204-24e577dd36fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:05.031449 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5fe59-2500-4474-9204-24e577dd36fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:05.032885 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5fe59-2500-4474-9204-24e577dd36fa None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:05.047823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-90f5fe59-2500-4474-9204-24e577dd36fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:35:05.047823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:35:05.047823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:35:05.047823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:35:05.047823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:35:05.047823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:35:05.047823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:35:05.047823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:35:05.047823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:35:05.047823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:35:05.047823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:35:05.047823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:35:05.047823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:35:05.047823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:35:05.047823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:35:05.047823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:35:05.049439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:35:05.049439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:35:05.049439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:35:05.049439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:35:05.049439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:35:05.049439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:35:05.049439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:35:05.049439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:35:05.049439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:35:05.049439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:35:05.049439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:35:05.049439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:35:05.049439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:35:05.049439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:35:05.049439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:35:05.049439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:35:05.049439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:35:05.050656 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:35:05.050656 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:35:05.050656 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:35:05.050656 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 625/1278] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:35:05.054771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210afbf-eea7-4acf-b243-a228744329d9 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:05.156349 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210afbf-eea7-4acf-b243-a228744329d9 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:05.188521 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181cf7c-b5a2-49ec-a95f-3fceeac1083c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:05.189129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181cf7c-b5a2-49ec-a95f-3fceeac1083c None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:05.189412 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181cf7c-b5a2-49ec-a95f-3fceeac1083c None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:05.189682 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181cf7c-b5a2-49ec-a95f-3fceeac1083c None admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:05.190316 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181cf7c-b5a2-49ec-a95f-3fceeac1083c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:35:05.190619 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181cf7c-b5a2-49ec-a95f-3fceeac1083c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:05.191962 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181cf7c-b5a2-49ec-a95f-3fceeac1083c None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:05.203228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 654/1279] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:35:05.208870 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5fe59-2500-4474-9204-24e577dd36fa None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:05.239747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:05.306284 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5fe59-2500-4474-9204-24e577dd36fa None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:05.338558 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ebe36-833b-4e3d-8938-aa1455e27c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:05.339167 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ebe36-833b-4e3d-8938-aa1455e27c4e None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:05.339443 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ebe36-833b-4e3d-8938-aa1455e27c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:05.339714 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ebe36-833b-4e3d-8938-aa1455e27c4e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:05.347509 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ebe36-833b-4e3d-8938-aa1455e27c4e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:05.348948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ebe36-833b-4e3d-8938-aa1455e27c4e None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:05.360032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-4b8ebe36-833b-4e3d-8938-aa1455e27c4e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 00:35:05.360032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:35:05.360032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:35:05.360032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:35:05.360032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:35:05.360032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:35:05.360032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:35:05.360032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:35:05.360032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:35:05.360032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:35:05.360032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:35:05.360032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:35:05.360032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 00:35:05.360032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 00:35:05.360032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 00:35:05.360032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 00:35:05.361190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:35:05.361190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:35:05.361190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 00:35:05.361190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:35:05.361190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 00:35:05.361190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 00:35:05.361190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:35:05.361190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:35:05.361190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:35:05.361190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:35:05.361190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:35:05.361190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:35:05.361190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:35:05.361190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:35:05.361190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:35:05.361190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:35:05.361190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:35:05.361190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:35:05.362381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:35:05.362381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:35:05.362381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 00:35:05.362381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 00:35:05.362381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 00:35:05.362381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 00:35:05.362381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 00:35:05.362381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 00:35:05.362381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 00:35:05.362381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:35:05.362381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 626/1280] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:35:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:35:05.366986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181cf7c-b5a2-49ec-a95f-3fceeac1083c None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:05.370769 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:05.464249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181cf7c-b5a2-49ec-a95f-3fceeac1083c None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:05.497265 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4ba7f-55ad-42ae-b8fd-813aa77c289f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:05.497850 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4ba7f-55ad-42ae-b8fd-813aa77c289f None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:05.498129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4ba7f-55ad-42ae-b8fd-813aa77c289f None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:05.498401 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4ba7f-55ad-42ae-b8fd-813aa77c289f None admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:05.499112 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4ba7f-55ad-42ae-b8fd-813aa77c289f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:35:05.499416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4ba7f-55ad-42ae-b8fd-813aa77c289f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:05.500809 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4ba7f-55ad-42ae-b8fd-813aa77c289f None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:05.517729 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 655/1281] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Sep 15 00:35:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:35:05.523442 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ebe36-833b-4e3d-8938-aa1455e27c4e None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:05.610387 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:05.620234 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ebe36-833b-4e3d-8938-aa1455e27c4e None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:05.652678 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d50f2-b259-4dda-b006-793ef5d7f31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:05.653818 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d50f2-b259-4dda-b006-793ef5d7f31b None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:05.654095 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d50f2-b259-4dda-b006-793ef5d7f31b None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:05.654364 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d50f2-b259-4dda-b006-793ef5d7f31b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:05.718404 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d50f2-b259-4dda-b006-793ef5d7f31b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:05.719779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d50f2-b259-4dda-b006-793ef5d7f31b None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:05.803682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:05.814304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 627/1282] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Sep 15 00:35:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 00:35:05.820041 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4ba7f-55ad-42ae-b8fd-813aa77c289f None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:05.879732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:05.916770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4ba7f-55ad-42ae-b8fd-813aa77c289f None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:05.949137 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a888d-86b2-4e14-a973-44bf38cd8c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:05.949748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a888d-86b2-4e14-a973-44bf38cd8c0a None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:05.950640 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a888d-86b2-4e14-a973-44bf38cd8c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:05.950910 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a888d-86b2-4e14-a973-44bf38cd8c0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:05.960492 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a888d-86b2-4e14-a973-44bf38cd8c0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:05.961939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a888d-86b2-4e14-a973-44bf38cd8c0a None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:05.976055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-f99a888d-86b2-4e14-a973-44bf38cd8c0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:35:05.976055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:35:05.976055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:35:05.976055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:35:05.976055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:35:05.976055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:35:05.976055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:35:05.976055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:35:05.976055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:35:05.976055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:35:05.976055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:35:05.976055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:35:05.976055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 00:35:05.976055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 00:35:05.976055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 00:35:05.976055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 00:35:05.977422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:35:05.977422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:35:05.977422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:35:05.977422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:35:05.977422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:35:05.977422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:35:05.977422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:35:05.977422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:35:05.977422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:35:05.977422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:35:05.977422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:35:05.977422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:35:05.977422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:35:05.977422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:35:05.977422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:35:05.977422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:35:05.977422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 00:35:05.978355 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 00:35:05.978355 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 00:35:05.978355 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:35:05.978355 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 656/1283] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:35:05.982967 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d50f2-b259-4dda-b006-793ef5d7f31b None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:06.081560 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d50f2-b259-4dda-b006-793ef5d7f31b None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:06.114424 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb905c87-43c6-4d56-b254-594c6f283055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:06.115012 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb905c87-43c6-4d56-b254-594c6f283055 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:06.115287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb905c87-43c6-4d56-b254-594c6f283055 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:06.115557 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb905c87-43c6-4d56-b254-594c6f283055 None admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:06.116185 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb905c87-43c6-4d56-b254-594c6f283055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:35:06.116482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb905c87-43c6-4d56-b254-594c6f283055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:06.117882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb905c87-43c6-4d56-b254-594c6f283055 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:06.129198 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 628/1284] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Sep 15 00:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:35:06.134840 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a888d-86b2-4e14-a973-44bf38cd8c0a None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:06.232403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a888d-86b2-4e14-a973-44bf38cd8c0a None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:06.245252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:06.265457 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e42b6-8476-43ea-94b7-c27d0843ef65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:06.266065 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e42b6-8476-43ea-94b7-c27d0843ef65 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:06.266341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e42b6-8476-43ea-94b7-c27d0843ef65 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:06.266608 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e42b6-8476-43ea-94b7-c27d0843ef65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:06.273054 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e42b6-8476-43ea-94b7-c27d0843ef65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:06.274483 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e42b6-8476-43ea-94b7-c27d0843ef65 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:06.285337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application [None req-484e42b6-8476-43ea-94b7-c27d0843ef65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:35:06.285337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:35:06.285337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:35:06.285337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:35:06.285337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:35:06.285337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:35:06.285337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:35:06.285337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:35:06.285337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:35:06.285337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:35:06.285337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:35:06.285337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:35:06.285337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 00:35:06.285337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 00:35:06.285337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 00:35:06.286227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 00:35:06.286227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:35:06.286227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:35:06.286227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:35:06.286227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:35:06.286227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:35:06.286227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:35:06.286227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:35:06.286227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application with Lock( Sep 15 00:35:06.286227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:35:06.286227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:35:06.286227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:35:06.286227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:35:06.286227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:35:06.286227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:35:06.286227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:35:06.286227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:35:06.287244 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 00:35:06.287244 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 00:35:06.287244 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 00:35:06.287244 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 00:35:06.287244 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 00:35:06.287244 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 00:35:06.287244 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 00:35:06.287244 dv-cinder-857528-2-smb devstack@keystone.service[81616]: ERROR keystone.server.flask.application Sep 15 00:35:06.287244 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 657/1285] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Sep 15 00:35:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:35:06.292052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb905c87-43c6-4d56-b254-594c6f283055 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:06.341108 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:06.391314 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb905c87-43c6-4d56-b254-594c6f283055 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:06.423525 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3cabf-85a3-496b-9d5d-770c0a94673a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:06.424111 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3cabf-85a3-496b-9d5d-770c0a94673a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:06.424388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3cabf-85a3-496b-9d5d-770c0a94673a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:06.424658 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3cabf-85a3-496b-9d5d-770c0a94673a None admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:06.425367 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3cabf-85a3-496b-9d5d-770c0a94673a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:35:06.425668 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3cabf-85a3-496b-9d5d-770c0a94673a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:06.427110 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3cabf-85a3-496b-9d5d-770c0a94673a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:06.439122 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 629/1286] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Sep 15 00:35:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:35:06.445228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e42b6-8476-43ea-94b7-c27d0843ef65 None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:06.541920 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e42b6-8476-43ea-94b7-c27d0843ef65 None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:06.574152 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00aeb2-91a3-4599-a883-3195828986ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:06.574733 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00aeb2-91a3-4599-a883-3195828986ce None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:06.575061 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00aeb2-91a3-4599-a883-3195828986ce None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:06.575367 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00aeb2-91a3-4599-a883-3195828986ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:06.576099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00aeb2-91a3-4599-a883-3195828986ce None admin] RBAC: Adding query filter params (role.id=0ee2daa9cb3c41fb901603e3d8caf784, scope.project.id=f25792dd210b42c4a3491096a735f909, user.id=6ed987b44d934ac7b2dc64c0aab28099) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:35:06.576399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00aeb2-91a3-4599-a883-3195828986ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:06.577821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00aeb2-91a3-4599-a883-3195828986ce None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:06.583343 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 658/1287] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Sep 15 00:35:06 2022] GET /identity/v3/role_assignments?user.id=6ed987b44d934ac7b2dc64c0aab28099&scope.project.id=f25792dd210b42c4a3491096a735f909&role.id=0ee2daa9cb3c41fb901603e3d8caf784 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:35:08.714240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a29b3-9ebf-4aa6-a65d-18c055c190b7 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:08.714777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a29b3-9ebf-4aa6-a65d-18c055c190b7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:08.714777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a29b3-9ebf-4aa6-a65d-18c055c190b7 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:08.716917 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 630/1288] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:35:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:35:08.722271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f09227-3ac2-4a5a-93b9-de8c2ecfa274 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:08.722644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f09227-3ac2-4a5a-93b9-de8c2ecfa274 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:08.722820 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f09227-3ac2-4a5a-93b9-de8c2ecfa274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:08.741408 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-23f09227-3ac2-4a5a-93b9-de8c2ecfa274 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:35:08.742584 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-23f09227-3ac2-4a5a-93b9-de8c2ecfa274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:35:08.770748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:08.807120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 659/1289] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:35:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:35:09.071363 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a29b3-9ebf-4aa6-a65d-18c055c190b7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:09.181964 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a29b3-9ebf-4aa6-a65d-18c055c190b7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:09.192420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:09.216863 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e203e-7d62-470e-ac05-54fc025a4eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:09.217505 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e203e-7d62-470e-ac05-54fc025a4eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:09.217787 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e203e-7d62-470e-ac05-54fc025a4eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:09.218060 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e203e-7d62-470e-ac05-54fc025a4eb1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:09.218637 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e203e-7d62-470e-ac05-54fc025a4eb1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:09.220001 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e203e-7d62-470e-ac05-54fc025a4eb1 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:09.232055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-cf1e203e-7d62-470e-ac05-54fc025a4eb1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 00:35:09.232055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:35:09.232055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:35:09.232055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:35:09.232055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:35:09.232055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:35:09.232055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:35:09.232055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:35:09.232055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 00:35:09.232055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:35:09.232055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:35:09.232055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:35:09.232055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:35:09.232055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:35:09.232055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:35:09.232055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:35:09.232055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:35:09.233279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:35:09.233279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:35:09.233279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:35:09.233279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:35:09.233279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:35:09.233279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:35:09.233279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:35:09.233279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:35:09.233279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:35:09.233279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:35:09.233279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:35:09.233279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:35:09.233279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:35:09.233279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:35:09.233279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:35:09.233279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:35:09.234305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:35:09.234305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:35:09.234305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:35:09.234305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:35:09.234305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:35:09.234305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:35:09.234305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:35:09.234305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:35:09.234305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:35:09.234305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:35:09.234305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:35:09.234305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:35:09.234305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 00:35:09.234305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:35:09.234305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 631/1290] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Sep 15 00:35:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:35:09.240252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f09227-3ac2-4a5a-93b9-de8c2ecfa274 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:09.338345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f09227-3ac2-4a5a-93b9-de8c2ecfa274 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:09.371232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c098da-3d50-4a19-9db9-edb162073186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:09.371860 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c098da-3d50-4a19-9db9-edb162073186 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:09.372136 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c098da-3d50-4a19-9db9-edb162073186 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:09.372405 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c098da-3d50-4a19-9db9-edb162073186 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:09.373019 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c098da-3d50-4a19-9db9-edb162073186 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:35:09.373344 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c098da-3d50-4a19-9db9-edb162073186 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:09.374674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c098da-3d50-4a19-9db9-edb162073186 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:09.379269 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 660/1291] 10.222.0.52 () {56 vars in 1116 bytes} [Thu Sep 15 00:35:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:35:09.384924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e203e-7d62-470e-ac05-54fc025a4eb1 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:09.481491 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e203e-7d62-470e-ac05-54fc025a4eb1 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:09.513637 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb7525-c236-4cf9-a9fd-351d3ff3679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:09.514202 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb7525-c236-4cf9-a9fd-351d3ff3679c None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:09.514479 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb7525-c236-4cf9-a9fd-351d3ff3679c None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:09.514744 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb7525-c236-4cf9-a9fd-351d3ff3679c None admin] PATH_INFO: `/v3/services` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:09.515348 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb7525-c236-4cf9-a9fd-351d3ff3679c None admin] RBAC: Adding query filter params (type=placement) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:35:09.515644 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb7525-c236-4cf9-a9fd-351d3ff3679c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:09.516983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb7525-c236-4cf9-a9fd-351d3ff3679c None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:09.521178 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 632/1292] 10.222.0.52 () {56 vars in 1116 bytes} [Thu Sep 15 00:35:09 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:35:11.642643 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba3356-20ac-44be-a4d3-08fa390d78c9 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:11.643147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba3356-20ac-44be-a4d3-08fa390d78c9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:11.643147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba3356-20ac-44be-a4d3-08fa390d78c9 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:11.644432 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 661/1293] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:35:11.649657 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4fdea-04d1-4140-b891-2c53a2062156 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:11.650072 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4fdea-04d1-4140-b891-2c53a2062156 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:11.650195 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4fdea-04d1-4140-b891-2c53a2062156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:11.668467 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d5f4fdea-04d1-4140-b891-2c53a2062156 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:35:11.669665 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d5f4fdea-04d1-4140-b891-2c53a2062156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:35:11.697499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:11.734756 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 633/1294] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:35:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:35:12.005328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba3356-20ac-44be-a4d3-08fa390d78c9 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:12.035987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:12.113041 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba3356-20ac-44be-a4d3-08fa390d78c9 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:12.146536 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb16e22-c00b-4031-9250-b560f512541e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:12.147131 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb16e22-c00b-4031-9250-b560f512541e None admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:12.147407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb16e22-c00b-4031-9250-b560f512541e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:12.147672 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb16e22-c00b-4031-9250-b560f512541e None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:12.148322 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb16e22-c00b-4031-9250-b560f512541e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:12.149701 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb16e22-c00b-4031-9250-b560f512541e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:12.162821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 662/1295] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Sep 15 00:35:12 2022] POST /identity/v3/services => generated 246 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:35:14.278820 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90a455-286d-424a-aa68-e2b8116aa58e None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:14.279373 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90a455-286d-424a-aa68-e2b8116aa58e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:14.279373 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90a455-286d-424a-aa68-e2b8116aa58e None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:14.280727 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 634/1296] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:35:14.285920 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a49f2-04cf-4cff-a9ae-607e800bea62 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:14.286322 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a49f2-04cf-4cff-a9ae-607e800bea62 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:14.286465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a49f2-04cf-4cff-a9ae-607e800bea62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:14.304669 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-0e5a49f2-04cf-4cff-a9ae-607e800bea62 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:35:14.305873 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0e5a49f2-04cf-4cff-a9ae-607e800bea62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:35:14.377140 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 663/1297] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:35:14 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:35:14.645436 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90a455-286d-424a-aa68-e2b8116aa58e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:14.741761 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90a455-286d-424a-aa68-e2b8116aa58e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:14.774137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8d87f-430f-4fba-bf73-14ce139dffb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:14.774739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8d87f-430f-4fba-bf73-14ce139dffb9 None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:14.775010 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8d87f-430f-4fba-bf73-14ce139dffb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:14.775275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8d87f-430f-4fba-bf73-14ce139dffb9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:14.775845 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8d87f-430f-4fba-bf73-14ce139dffb9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:14.777219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8d87f-430f-4fba-bf73-14ce139dffb9 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:14.785628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-06b8d87f-430f-4fba-bf73-14ce139dffb9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 00:35:14.785628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:35:14.785628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:35:14.785628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:35:14.785628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:35:14.785628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:35:14.785628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:35:14.785628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:35:14.785628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 00:35:14.785628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:35:14.785628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:35:14.785628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:35:14.785628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:35:14.785628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:35:14.785628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:35:14.785628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:35:14.785628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:35:14.786827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:35:14.786827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:35:14.786827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:35:14.786827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:35:14.786827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:35:14.786827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:35:14.786827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:35:14.786827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:35:14.786827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:35:14.786827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:35:14.786827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:35:14.786827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:35:14.786827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:35:14.786827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:35:14.786827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:35:14.786827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:35:14.787943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:35:14.787943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:35:14.787943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:35:14.787943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:35:14.787943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:35:14.787943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:35:14.787943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:35:14.787943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:35:14.787943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:35:14.787943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:35:14.787943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:35:14.787943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:35:14.787943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 00:35:14.787943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:35:14.787943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 635/1298] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Sep 15 00:35:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:35:14.792407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a49f2-04cf-4cff-a9ae-607e800bea62 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:14.810036 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:14.890123 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a49f2-04cf-4cff-a9ae-607e800bea62 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:14.922411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbbe48-a70a-4e24-8754-f153de653a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:14.922939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbbe48-a70a-4e24-8754-f153de653a8e None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:14.923215 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbbe48-a70a-4e24-8754-f153de653a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:14.923483 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbbe48-a70a-4e24-8754-f153de653a8e None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:14.924097 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbbe48-a70a-4e24-8754-f153de653a8e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:35:14.924395 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbbe48-a70a-4e24-8754-f153de653a8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:14.925764 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbbe48-a70a-4e24-8754-f153de653a8e None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:14.930616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 664/1299] 10.222.0.52 () {56 vars in 1116 bytes} [Thu Sep 15 00:35:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:35:14.937110 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8d87f-430f-4fba-bf73-14ce139dffb9 None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:14.967856 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:15.033630 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8d87f-430f-4fba-bf73-14ce139dffb9 None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:15.068510 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032563f-f4e7-4a52-a657-b298f00313ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:15.069134 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032563f-f4e7-4a52-a657-b298f00313ec None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:15.069429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032563f-f4e7-4a52-a657-b298f00313ec None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:15.069741 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032563f-f4e7-4a52-a657-b298f00313ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:15.070434 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032563f-f4e7-4a52-a657-b298f00313ec None admin] RBAC: Adding query filter params (interface=public, service_id=e50ceb7d6dd644f79a1cba93d66fc151, region_id=RegionOne) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:35:15.070777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032563f-f4e7-4a52-a657-b298f00313ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:15.072108 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032563f-f4e7-4a52-a657-b298f00313ec None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:15.077160 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 636/1300] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Sep 15 00:35:14 2022] GET /identity/v3/endpoints?service_id=e50ceb7d6dd644f79a1cba93d66fc151&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:35:15.083735 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbbe48-a70a-4e24-8754-f153de653a8e None admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:15.174801 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:15.193466 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbbe48-a70a-4e24-8754-f153de653a8e None admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:15.226018 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11bc34-b049-4341-a4d6-7344422c65e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:15.226612 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11bc34-b049-4341-a4d6-7344422c65e1 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:15.227146 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11bc34-b049-4341-a4d6-7344422c65e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:15.227418 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11bc34-b049-4341-a4d6-7344422c65e1 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:15.228018 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11bc34-b049-4341-a4d6-7344422c65e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:15.229393 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11bc34-b049-4341-a4d6-7344422c65e1 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:15.236490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 665/1301] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Sep 15 00:35:15 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:35:17.345471 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ec7d2-74e1-4d46-a917-c58c148db950 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:17.345878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ec7d2-74e1-4d46-a917-c58c148db950 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:17.346015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ec7d2-74e1-4d46-a917-c58c148db950 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:17.347352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 637/1302] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:35:17.352932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fb7aa-9d8a-4563-a759-4c6efec1fa55 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:17.353396 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fb7aa-9d8a-4563-a759-4c6efec1fa55 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:17.353488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fb7aa-9d8a-4563-a759-4c6efec1fa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:17.371091 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-123fb7aa-9d8a-4563-a759-4c6efec1fa55 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:35:17.372250 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-123fb7aa-9d8a-4563-a759-4c6efec1fa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:35:17.435823 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 666/1303] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:35:17 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 00:35:17.703180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ec7d2-74e1-4d46-a917-c58c148db950 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:17.794881 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:17.801889 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ec7d2-74e1-4d46-a917-c58c148db950 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:17.835917 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36674810-3eef-4b2c-b7e1-ea5f8208dd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:17.836523 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36674810-3eef-4b2c-b7e1-ea5f8208dd7a None admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:17.836798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36674810-3eef-4b2c-b7e1-ea5f8208dd7a None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:17.837064 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36674810-3eef-4b2c-b7e1-ea5f8208dd7a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:17.837664 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36674810-3eef-4b2c-b7e1-ea5f8208dd7a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:17.839022 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36674810-3eef-4b2c-b7e1-ea5f8208dd7a None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:17.847588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application [None req-36674810-3eef-4b2c-b7e1-ea5f8208dd7a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 00:35:17.847588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:35:17.847588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 00:35:17.847588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 00:35:17.847588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 00:35:17.847588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 00:35:17.847588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 00:35:17.847588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:35:17.847588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 00:35:17.847588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:35:17.847588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 00:35:17.847588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:35:17.847588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 00:35:17.847588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 00:35:17.847588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 00:35:17.847588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 00:35:17.847588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 00:35:17.853274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 00:35:17.853274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 00:35:17.853274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 00:35:17.853274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 00:35:17.853274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 00:35:17.853274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 00:35:17.853274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 00:35:17.853274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 00:35:17.853274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 00:35:17.853274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 00:35:17.853274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 00:35:17.853274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 00:35:17.853274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 00:35:17.853274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 00:35:17.853274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 00:35:17.853274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 00:35:17.854254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 00:35:17.854254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application with Lock( Sep 15 00:35:17.854254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 00:35:17.854254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self._enter() Sep 15 00:35:17.854254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 00:35:17.854254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 00:35:17.854254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 00:35:17.854254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application return self.creator() Sep 15 00:35:17.854254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 00:35:17.854254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application created_value = creator( Sep 15 00:35:17.854254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 00:35:17.854254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 00:35:17.854254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 00:35:17.854254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: ERROR keystone.server.flask.application Sep 15 00:35:17.854254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 638/1304] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Sep 15 00:35:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 00:35:17.855212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fb7aa-9d8a-4563-a759-4c6efec1fa55 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:17.934280 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:17.962297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fb7aa-9d8a-4563-a759-4c6efec1fa55 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:17.998175 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0a071-5032-4fdc-b1a2-b0f268071261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:17.998770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0a071-5032-4fdc-b1a2-b0f268071261 None admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:17.999052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0a071-5032-4fdc-b1a2-b0f268071261 None admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:17.999324 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0a071-5032-4fdc-b1a2-b0f268071261 None admin] PATH_INFO: `/v3/services` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:17.999949 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0a071-5032-4fdc-b1a2-b0f268071261 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:35:18.000251 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0a071-5032-4fdc-b1a2-b0f268071261 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:18.001631 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0a071-5032-4fdc-b1a2-b0f268071261 None admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:18.006596 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 667/1305] 10.222.0.52 () {56 vars in 1116 bytes} [Thu Sep 15 00:35:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:35:18.012407 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36674810-3eef-4b2c-b7e1-ea5f8208dd7a None admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:35:18.112422 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36674810-3eef-4b2c-b7e1-ea5f8208dd7a None admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:35:18.145333 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d1a04-afad-4dd4-a8a4-49c8d2ae48f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:35:18.145926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d1a04-afad-4dd4-a8a4-49c8d2ae48f7 None admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:35:18.146200 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d1a04-afad-4dd4-a8a4-49c8d2ae48f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:35:18.146466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d1a04-afad-4dd4-a8a4-49c8d2ae48f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:35:18.147115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d1a04-afad-4dd4-a8a4-49c8d2ae48f7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:35:18.148471 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d1a04-afad-4dd4-a8a4-49c8d2ae48f7 None admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:35:18.167600 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 639/1306] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:35:18 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:35:28.003797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=30 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:35:28.163423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:21.446762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91b7ac-69c2-4507-a5e9-682f2de63339 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:21.447240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91b7ac-69c2-4507-a5e9-682f2de63339 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:21.447334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91b7ac-69c2-4507-a5e9-682f2de63339 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:21.452537 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 668/1307] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:36:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:36:21.454560 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a0620-a39b-47f3-b0e3-61ae9eba9fb8 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:21.455603 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a0620-a39b-47f3-b0e3-61ae9eba9fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:21.456181 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a0620-a39b-47f3-b0e3-61ae9eba9fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:21.604884 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e15a0620-a39b-47f3-b0e3-61ae9eba9fb8 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:36:21.606605 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e15a0620-a39b-47f3-b0e3-61ae9eba9fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:21.752265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 640/1308] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:36:22.050930 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929e751-fe92-4c38-a32b-6bed8c08f7b2 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:22.051246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929e751-fe92-4c38-a32b-6bed8c08f7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:22.051480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929e751-fe92-4c38-a32b-6bed8c08f7b2 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:22.053111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 669/1309] 10.222.0.52 () {54 vars in 965 bytes} [Thu Sep 15 00:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:36:22.060598 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6a0eb-74cc-4d83-a536-4960a0ea1088 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:22.061202 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6a0eb-74cc-4d83-a536-4960a0ea1088 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:22.061572 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6a0eb-74cc-4d83-a536-4960a0ea1088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:22.146913 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-90b6a0eb-74cc-4d83-a536-4960a0ea1088 None None] MFA Rules not processed for user `50ec251be76543b4ad97442664db6858`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:36:22.148185 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-90b6a0eb-74cc-4d83-a536-4960a0ea1088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:22.171314 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:22.235774 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 641/1310] 10.222.0.52 () {58 vars in 1062 bytes} [Thu Sep 15 00:36:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:36:22.244178 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929e751-fe92-4c38-a32b-6bed8c08f7b2 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:36:22.246114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e929e751-fe92-4c38-a32b-6bed8c08f7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:22.370314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929e751-fe92-4c38-a32b-6bed8c08f7b2 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:36:22.459818 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc7379-089f-4cad-be86-c769b062c50e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:36:22.460448 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc7379-089f-4cad-be86-c769b062c50e service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:22.461601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc7379-089f-4cad-be86-c769b062c50e service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:22.462068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc7379-089f-4cad-be86-c769b062c50e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:22.463729 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0bbc7379-089f-4cad-be86-c769b062c50e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:22.521999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:22.581450 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc7379-089f-4cad-be86-c769b062c50e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:36:22.582885 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc7379-089f-4cad-be86-c769b062c50e service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:36:22.602893 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 670/1311] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:36:25.016811 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751dada-8bce-4fc8-b3fe-507f860ed90d None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:25.017389 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751dada-8bce-4fc8-b3fe-507f860ed90d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:25.017389 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751dada-8bce-4fc8-b3fe-507f860ed90d None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:25.018781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 642/1312] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:36:25.024575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ced9c-1cae-48ed-b9dc-6b03531b67d0 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:25.024998 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ced9c-1cae-48ed-b9dc-6b03531b67d0 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:25.025120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ced9c-1cae-48ed-b9dc-6b03531b67d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:25.104832 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-350ced9c-1cae-48ed-b9dc-6b03531b67d0 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:36:25.106047 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-350ced9c-1cae-48ed-b9dc-6b03531b67d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:25.199870 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 671/1313] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:36:25.479806 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751dada-8bce-4fc8-b3fe-507f860ed90d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:36:25.481356 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a751dada-8bce-4fc8-b3fe-507f860ed90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:25.583586 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751dada-8bce-4fc8-b3fe-507f860ed90d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:36:25.660721 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:25.663188 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d245c-8d54-4ad0-8537-9236e9267ae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:36:25.663792 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d245c-8d54-4ad0-8537-9236e9267ae6 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:25.664083 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d245c-8d54-4ad0-8537-9236e9267ae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:25.664739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d245c-8d54-4ad0-8537-9236e9267ae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:25.666978 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-669d245c-8d54-4ad0-8537-9236e9267ae6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:25.775681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d245c-8d54-4ad0-8537-9236e9267ae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:36:25.777409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d245c-8d54-4ad0-8537-9236e9267ae6 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:36:25.795268 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 643/1314] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:36:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:36:28.253417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee3eec-61d2-42fc-99ef-869786135a4c None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:28.253977 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee3eec-61d2-42fc-99ef-869786135a4c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:28.253977 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee3eec-61d2-42fc-99ef-869786135a4c None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:28.255319 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 672/1315] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:36:28.260739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1157e-c1e8-4748-a0dd-463801366635 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:28.261177 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1157e-c1e8-4748-a0dd-463801366635 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:28.261311 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1157e-c1e8-4748-a0dd-463801366635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:28.325264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-79f1157e-c1e8-4748-a0dd-463801366635 None None] MFA Rules not processed for user `95fe5fa6bbd741e3ae8e9bdeafe3d64c`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:36:28.326454 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-79f1157e-c1e8-4748-a0dd-463801366635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:28.383894 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:28.427694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 644/1316] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:36:28 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:36:28.713021 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee3eec-61d2-42fc-99ef-869786135a4c None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:36:28.714575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e5ee3eec-61d2-42fc-99ef-869786135a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:28.724460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:28.819030 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee3eec-61d2-42fc-99ef-869786135a4c None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:36:28.890093 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23214c-50e5-425b-89dd-009761a8bbc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:36:28.890686 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23214c-50e5-425b-89dd-009761a8bbc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:28.890960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23214c-50e5-425b-89dd-009761a8bbc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:28.891251 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23214c-50e5-425b-89dd-009761a8bbc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:28.892814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9d23214c-50e5-425b-89dd-009761a8bbc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:28.953211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:28.999949 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23214c-50e5-425b-89dd-009761a8bbc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:36:29.001315 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23214c-50e5-425b-89dd-009761a8bbc9 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:36:29.019680 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 673/1317] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:36:28 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:36:31.707078 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36915d7-6666-4773-9b9d-53cdf72c61d4 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:31.707598 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36915d7-6666-4773-9b9d-53cdf72c61d4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:31.707598 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36915d7-6666-4773-9b9d-53cdf72c61d4 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:31.708942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 645/1318] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:36:31.714200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e077c24-18b1-43ed-b744-135c38746f2d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:31.714675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e077c24-18b1-43ed-b744-135c38746f2d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:31.714783 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e077c24-18b1-43ed-b744-135c38746f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:31.780265 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2e077c24-18b1-43ed-b744-135c38746f2d None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:36:31.781519 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2e077c24-18b1-43ed-b744-135c38746f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:31.876256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 674/1319] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:36:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:36:32.161477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36915d7-6666-4773-9b9d-53cdf72c61d4 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:36:32.163588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e36915d7-6666-4773-9b9d-53cdf72c61d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:32.264210 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36915d7-6666-4773-9b9d-53cdf72c61d4 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:36:32.335630 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0059d-5f18-4af3-9ffe-d9189327ff57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:36:32.336219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0059d-5f18-4af3-9ffe-d9189327ff57 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:32.336493 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0059d-5f18-4af3-9ffe-d9189327ff57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:32.336760 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0059d-5f18-4af3-9ffe-d9189327ff57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:32.338368 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-46b0059d-5f18-4af3-9ffe-d9189327ff57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:32.345255 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:32.447569 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0059d-5f18-4af3-9ffe-d9189327ff57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:36:32.448933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0059d-5f18-4af3-9ffe-d9189327ff57 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:36:32.466916 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 646/1320] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:36:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:36:35.222768 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91efa1-2fed-4adf-bcad-457e6502c1e4 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:35.223325 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91efa1-2fed-4adf-bcad-457e6502c1e4 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:35.223325 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91efa1-2fed-4adf-bcad-457e6502c1e4 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:35.224643 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 675/1321] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:36:35.230035 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4b268-23c6-4b5b-ad3d-5face52784eb None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:35.230425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4b268-23c6-4b5b-ad3d-5face52784eb None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:35.230589 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4b268-23c6-4b5b-ad3d-5face52784eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:35.299909 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-32b4b268-23c6-4b5b-ad3d-5face52784eb None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:36:35.301166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-32b4b268-23c6-4b5b-ad3d-5face52784eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:35.367987 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:35.410062 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 647/1322] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:36:35.695690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91efa1-2fed-4adf-bcad-457e6502c1e4 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:36:35.697324 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-df91efa1-2fed-4adf-bcad-457e6502c1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:35.717524 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:35.800874 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91efa1-2fed-4adf-bcad-457e6502c1e4 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:36:35.874866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adca91e-d7dd-4512-8b62-b34a0c53e2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:36:35.875472 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adca91e-d7dd-4512-8b62-b34a0c53e2ca service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:35.875753 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adca91e-d7dd-4512-8b62-b34a0c53e2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:35.876043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adca91e-d7dd-4512-8b62-b34a0c53e2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:35.877636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3adca91e-d7dd-4512-8b62-b34a0c53e2ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:35.949576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:35.987869 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adca91e-d7dd-4512-8b62-b34a0c53e2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:36:35.989337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adca91e-d7dd-4512-8b62-b34a0c53e2ca service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:36:36.007543 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 676/1323] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:36:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:36:38.225622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d5ad1-553a-4120-9755-816c1f496cd4 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:38.226185 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d5ad1-553a-4120-9755-816c1f496cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:38.226185 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d5ad1-553a-4120-9755-816c1f496cd4 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:38.227515 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 648/1324] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:36:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:36:38.232785 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47b7b8-3f9b-4d51-a9af-9d9e26c58e5e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:38.233243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47b7b8-3f9b-4d51-a9af-9d9e26c58e5e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:38.233390 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47b7b8-3f9b-4d51-a9af-9d9e26c58e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:38.299824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ac47b7b8-3f9b-4d51-a9af-9d9e26c58e5e None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:36:38.301053 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ac47b7b8-3f9b-4d51-a9af-9d9e26c58e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:38.411147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 677/1325] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:36:38.704194 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d5ad1-553a-4120-9755-816c1f496cd4 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:36:38.705758 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-166d5ad1-553a-4120-9755-816c1f496cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:38.810886 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d5ad1-553a-4120-9755-816c1f496cd4 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:36:38.884355 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46337ebe-686e-4e5a-96a9-b29a1391fa84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:36:38.884955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46337ebe-686e-4e5a-96a9-b29a1391fa84 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:38.885275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46337ebe-686e-4e5a-96a9-b29a1391fa84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:38.885540 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46337ebe-686e-4e5a-96a9-b29a1391fa84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:38.887113 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-46337ebe-686e-4e5a-96a9-b29a1391fa84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:38.904086 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:39.002351 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46337ebe-686e-4e5a-96a9-b29a1391fa84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:36:39.003715 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46337ebe-686e-4e5a-96a9-b29a1391fa84 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:36:39.025455 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 649/1326] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:36:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:36:41.236728 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222407a-b190-421a-aa0f-9be8640ff347 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:41.237310 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222407a-b190-421a-aa0f-9be8640ff347 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:41.237813 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222407a-b190-421a-aa0f-9be8640ff347 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:41.240305 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 678/1327] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:36:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:36:41.246531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e431f81-eb23-451e-885b-96ff3de645ba None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:41.246989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e431f81-eb23-451e-885b-96ff3de645ba None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:41.247631 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e431f81-eb23-451e-885b-96ff3de645ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:41.314002 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5e431f81-eb23-451e-885b-96ff3de645ba None None] MFA Rules not processed for user `95fe5fa6bbd741e3ae8e9bdeafe3d64c`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:36:41.315141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5e431f81-eb23-451e-885b-96ff3de645ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:41.382387 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:41.413572 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 650/1328] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:36:41 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:36:41.696234 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222407a-b190-421a-aa0f-9be8640ff347 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:36:41.697814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7222407a-b190-421a-aa0f-9be8640ff347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:41.731156 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:41.809060 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222407a-b190-421a-aa0f-9be8640ff347 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:36:41.885358 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb84683-c513-41cd-84b7-cda3ed1c1cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:36:41.885966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb84683-c513-41cd-84b7-cda3ed1c1cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:41.886246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb84683-c513-41cd-84b7-cda3ed1c1cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:41.886519 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb84683-c513-41cd-84b7-cda3ed1c1cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:41.888101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9fb84683-c513-41cd-84b7-cda3ed1c1cb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:41.965029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:41.997179 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb84683-c513-41cd-84b7-cda3ed1c1cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:36:41.998612 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb84683-c513-41cd-84b7-cda3ed1c1cb5 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:36:42.017427 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 679/1329] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:36:41 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:36:44.406428 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e11a7-3ff3-4225-8e0b-205b1cdf45ca None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:44.406942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e11a7-3ff3-4225-8e0b-205b1cdf45ca None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:44.406942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e11a7-3ff3-4225-8e0b-205b1cdf45ca None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:44.408290 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 651/1330] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:36:44.413987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805400e6-18b2-4edd-a5a0-6cfef59cd39a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:44.414403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805400e6-18b2-4edd-a5a0-6cfef59cd39a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:44.414527 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805400e6-18b2-4edd-a5a0-6cfef59cd39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:44.479071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-805400e6-18b2-4edd-a5a0-6cfef59cd39a None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:36:44.480254 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-805400e6-18b2-4edd-a5a0-6cfef59cd39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:44.575797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 680/1331] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:36:44.861191 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e11a7-3ff3-4225-8e0b-205b1cdf45ca None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:36:44.862759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5e6e11a7-3ff3-4225-8e0b-205b1cdf45ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:44.968596 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e11a7-3ff3-4225-8e0b-205b1cdf45ca None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:36:45.040711 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8205c3-5e31-4485-8ac4-adcd4444fe8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:36:45.041327 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8205c3-5e31-4485-8ac4-adcd4444fe8f service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:45.041608 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8205c3-5e31-4485-8ac4-adcd4444fe8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:45.041879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8205c3-5e31-4485-8ac4-adcd4444fe8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:45.043472 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4d8205c3-5e31-4485-8ac4-adcd4444fe8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:45.071597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:45.152803 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8205c3-5e31-4485-8ac4-adcd4444fe8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:36:45.154265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8205c3-5e31-4485-8ac4-adcd4444fe8f service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:36:45.171995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 652/1332] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:36:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:36:47.371086 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b138fb-ca79-4753-8426-b30591af3443 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:47.371540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b138fb-ca79-4753-8426-b30591af3443 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:47.371634 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b138fb-ca79-4753-8426-b30591af3443 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:47.372997 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 681/1333] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:36:47.378117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd920a-de3f-4bef-ab97-5de3d2df8caa None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:47.378490 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd920a-de3f-4bef-ab97-5de3d2df8caa None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:47.378658 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd920a-de3f-4bef-ab97-5de3d2df8caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:47.442743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3ccd920a-de3f-4bef-ab97-5de3d2df8caa None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:36:47.443934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3ccd920a-de3f-4bef-ab97-5de3d2df8caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:47.515462 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:47.537995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 653/1334] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:36:47.824886 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b138fb-ca79-4753-8426-b30591af3443 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:36:47.826590 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c1b138fb-ca79-4753-8426-b30591af3443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:47.866406 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:47.928496 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b138fb-ca79-4753-8426-b30591af3443 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:36:47.999789 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d34c42-582c-4b30-96fe-041e55513efc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:36:48.000371 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d34c42-582c-4b30-96fe-041e55513efc service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:48.000647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d34c42-582c-4b30-96fe-041e55513efc service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:48.000915 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d34c42-582c-4b30-96fe-041e55513efc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:48.002496 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-16d34c42-582c-4b30-96fe-041e55513efc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:48.086108 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:48.111912 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d34c42-582c-4b30-96fe-041e55513efc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:36:48.113374 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d34c42-582c-4b30-96fe-041e55513efc service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:36:48.132153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 682/1335] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:36:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:36:50.574050 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9483a87-761d-4c9a-b3c9-6f3e827f063a None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:50.574562 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9483a87-761d-4c9a-b3c9-6f3e827f063a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:50.574656 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9483a87-761d-4c9a-b3c9-6f3e827f063a None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:50.575932 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 654/1336] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:36:50.581162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1c967-f66d-4748-9ced-bdec63a9cf10 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:50.581563 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1c967-f66d-4748-9ced-bdec63a9cf10 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:50.581715 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1c967-f66d-4748-9ced-bdec63a9cf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:50.647356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-7ac1c967-f66d-4748-9ced-bdec63a9cf10 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:36:50.648551 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7ac1c967-f66d-4748-9ced-bdec63a9cf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:50.744100 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 683/1337] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:36:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:36:51.024274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9483a87-761d-4c9a-b3c9-6f3e827f063a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:36:51.025906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f9483a87-761d-4c9a-b3c9-6f3e827f063a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:51.131555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9483a87-761d-4c9a-b3c9-6f3e827f063a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:36:51.205588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576f62d-d376-448d-9dc2-c2b9b06ec820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:36:51.206187 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576f62d-d376-448d-9dc2-c2b9b06ec820 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:51.206467 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576f62d-d376-448d-9dc2-c2b9b06ec820 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:51.206740 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576f62d-d376-448d-9dc2-c2b9b06ec820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:51.208828 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d576f62d-d376-448d-9dc2-c2b9b06ec820 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:51.243960 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:51.317074 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576f62d-d376-448d-9dc2-c2b9b06ec820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:36:51.318510 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576f62d-d376-448d-9dc2-c2b9b06ec820 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:36:51.337289 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 655/1338] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:36:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:36:55.372678 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767814f-8c00-4f7b-8c04-0bee8360bba7 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:55.373277 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767814f-8c00-4f7b-8c04-0bee8360bba7 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:55.373277 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767814f-8c00-4f7b-8c04-0bee8360bba7 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:55.374766 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 684/1339] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:36:55.381103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f64719-bfa7-4cf5-9fb4-8146dd6d9a13 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:55.381103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f64719-bfa7-4cf5-9fb4-8146dd6d9a13 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:55.381103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f64719-bfa7-4cf5-9fb4-8146dd6d9a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:55.456506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b2f64719-bfa7-4cf5-9fb4-8146dd6d9a13 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:36:55.459099 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b2f64719-bfa7-4cf5-9fb4-8146dd6d9a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:55.555438 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:55.573180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 656/1340] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:36:55.851529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767814f-8c00-4f7b-8c04-0bee8360bba7 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:36:55.853032 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2767814f-8c00-4f7b-8c04-0bee8360bba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:55.901588 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:55.959765 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767814f-8c00-4f7b-8c04-0bee8360bba7 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:36:56.032010 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc81b6-f008-4ed6-b61e-278d5fffece0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:36:56.032610 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc81b6-f008-4ed6-b61e-278d5fffece0 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:56.032885 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc81b6-f008-4ed6-b61e-278d5fffece0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:56.033185 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc81b6-f008-4ed6-b61e-278d5fffece0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:56.034739 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-75cc81b6-f008-4ed6-b61e-278d5fffece0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:56.128384 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:56.146430 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc81b6-f008-4ed6-b61e-278d5fffece0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:36:56.147910 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc81b6-f008-4ed6-b61e-278d5fffece0 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:36:56.166239 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 685/1341] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:36:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:36:58.978164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09297e6c-438c-487d-b0a5-3378676bce4f None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:58.978725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09297e6c-438c-487d-b0a5-3378676bce4f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:58.978725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09297e6c-438c-487d-b0a5-3378676bce4f None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:58.980044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 657/1342] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:36:58.985423 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5142cb4-14fd-4ab2-832b-bdb783bab3d5 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:58.985830 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5142cb4-14fd-4ab2-832b-bdb783bab3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:58.986104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5142cb4-14fd-4ab2-832b-bdb783bab3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:59.052633 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-a5142cb4-14fd-4ab2-832b-bdb783bab3d5 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:36:59.053903 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a5142cb4-14fd-4ab2-832b-bdb783bab3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:59.151564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 686/1343] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:36:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:36:59.439448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09297e6c-438c-487d-b0a5-3378676bce4f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:36:59.440995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-09297e6c-438c-487d-b0a5-3378676bce4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:59.559845 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09297e6c-438c-487d-b0a5-3378676bce4f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:36:59.635151 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924c356-95f2-4da5-9b76-f080e6018f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:36:59.635743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924c356-95f2-4da5-9b76-f080e6018f0d service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:36:59.636017 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924c356-95f2-4da5-9b76-f080e6018f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:36:59.636285 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924c356-95f2-4da5-9b76-f080e6018f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:36:59.637888 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4924c356-95f2-4da5-9b76-f080e6018f0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:36:59.682039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:36:59.749166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924c356-95f2-4da5-9b76-f080e6018f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:36:59.750698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924c356-95f2-4da5-9b76-f080e6018f0d service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:36:59.769522 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 658/1344] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:36:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:37:03.871770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf29be5-a85f-4706-a4fc-f435dbdf0d7a None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:03.872195 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf29be5-a85f-4706-a4fc-f435dbdf0d7a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:03.872376 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf29be5-a85f-4706-a4fc-f435dbdf0d7a None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:03.873665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 687/1345] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:03.879766 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ed5d5-6fa9-4a40-8722-e8d330acc72a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:03.880272 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ed5d5-6fa9-4a40-8722-e8d330acc72a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:03.880381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ed5d5-6fa9-4a40-8722-e8d330acc72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:03.949813 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-164ed5d5-6fa9-4a40-8722-e8d330acc72a None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:03.951004 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-164ed5d5-6fa9-4a40-8722-e8d330acc72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:04.042129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:04.044420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 659/1346] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:37:04.344716 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5b771-149b-4f7f-8619-b72b1108632d None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:04.344995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5b771-149b-4f7f-8619-b72b1108632d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:04.345288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5b771-149b-4f7f-8619-b72b1108632d None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:04.346888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 688/1347] 10.222.0.52 () {54 vars in 965 bytes} [Thu Sep 15 00:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:04.353340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4c710-28d2-482c-9f1a-cfa377a33f05 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:04.353621 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4c710-28d2-482c-9f1a-cfa377a33f05 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:04.353890 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4c710-28d2-482c-9f1a-cfa377a33f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:04.428410 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-11d4c710-28d2-482c-9f1a-cfa377a33f05 None None] MFA Rules not processed for user `50ec251be76543b4ad97442664db6858`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:04.429650 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-11d4c710-28d2-482c-9f1a-cfa377a33f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:04.503108 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 660/1348] 10.222.0.52 () {58 vars in 1062 bytes} [Thu Sep 15 00:37:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:37:04.512241 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5b771-149b-4f7f-8619-b72b1108632d None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:37:04.513762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e4b5b771-149b-4f7f-8619-b72b1108632d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:04.571061 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:04.616676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5b771-149b-4f7f-8619-b72b1108632d None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:37:04.688381 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11196d-768b-445b-9e61-1aedcf97c306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:37:04.688984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11196d-768b-445b-9e61-1aedcf97c306 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:04.689291 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11196d-768b-445b-9e61-1aedcf97c306 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:04.689569 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11196d-768b-445b-9e61-1aedcf97c306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:04.691150 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-fd11196d-768b-445b-9e61-1aedcf97c306 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:04.798893 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:04.803267 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11196d-768b-445b-9e61-1aedcf97c306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:37:04.804700 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11196d-768b-445b-9e61-1aedcf97c306 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:37:04.823201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 689/1349] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:37:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:37:10.036976 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f28b3-fd55-48ea-ba9e-b8e10c2dafe1 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:10.037528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f28b3-fd55-48ea-ba9e-b8e10c2dafe1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:10.037528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f28b3-fd55-48ea-ba9e-b8e10c2dafe1 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:10.039632 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 661/1350] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 15 00:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:10.047170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f3bcc-6614-478d-bd38-0ef001a87656 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:10.047170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f3bcc-6614-478d-bd38-0ef001a87656 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:10.047170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f3bcc-6614-478d-bd38-0ef001a87656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:10.224438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-061f3bcc-6614-478d-bd38-0ef001a87656 None None] MFA Rules not processed for user `6ed987b44d934ac7b2dc64c0aab28099`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:10.228988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-061f3bcc-6614-478d-bd38-0ef001a87656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:10.387612 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 690/1351] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 15 00:37:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:37:14.501620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=59 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:14.535878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c0ee2-9220-42c5-aaf3-3bd6cbcde6ac None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:14.536510 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c0ee2-9220-42c5-aaf3-3bd6cbcde6ac None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:14.536998 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c0ee2-9220-42c5-aaf3-3bd6cbcde6ac None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:14.538852 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 662/1352] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 15 00:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:14.543741 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdc3f0-5c1f-4ad5-bec4-ce3365b66b25 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:14.544202 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdc3f0-5c1f-4ad5-bec4-ce3365b66b25 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:14.544296 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdc3f0-5c1f-4ad5-bec4-ce3365b66b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:14.600474 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:14.625155 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-c8bdc3f0-5c1f-4ad5-bec4-ce3365b66b25 None None] MFA Rules not processed for user `6ed987b44d934ac7b2dc64c0aab28099`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:14.626363 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c8bdc3f0-5c1f-4ad5-bec4-ce3365b66b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:14.746400 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 691/1353] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 15 00:37:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:37:15.923512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95dbd7-f9bc-4d8b-9e79-5fb6bf77b12b None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:15.924011 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95dbd7-f9bc-4d8b-9e79-5fb6bf77b12b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:15.924011 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95dbd7-f9bc-4d8b-9e79-5fb6bf77b12b None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:15.925377 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 663/1354] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 15 00:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:15.930388 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d4ec9-3c3c-42a0-8b3f-451771a4b2e4 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:15.930837 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d4ec9-3c3c-42a0-8b3f-451771a4b2e4 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:15.931112 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d4ec9-3c3c-42a0-8b3f-451771a4b2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:16.009882 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-d93d4ec9-3c3c-42a0-8b3f-451771a4b2e4 None None] MFA Rules not processed for user `6ed987b44d934ac7b2dc64c0aab28099`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:16.011103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d93d4ec9-3c3c-42a0-8b3f-451771a4b2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:16.055505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:16.124198 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 692/1355] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 15 00:37:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:37:19.753227 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b3213-a707-4b25-99a9-b9cd35c7f431 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:19.754177 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b3213-a707-4b25-99a9-b9cd35c7f431 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:19.754688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b3213-a707-4b25-99a9-b9cd35c7f431 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:19.758880 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 664/1356] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:37:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:19.762591 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde43bc-00bc-4718-8a38-e34d2882a7a2 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:19.763055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde43bc-00bc-4718-8a38-e34d2882a7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:19.763135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde43bc-00bc-4718-8a38-e34d2882a7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:19.847798 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ddde43bc-00bc-4718-8a38-e34d2882a7a2 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:19.849005 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ddde43bc-00bc-4718-8a38-e34d2882a7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:19.954210 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 693/1357] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:37:20.256959 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35063b7c-4d6e-4430-9bf1-6ff6d4820273 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:20.257501 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35063b7c-4d6e-4430-9bf1-6ff6d4820273 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:20.257962 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35063b7c-4d6e-4430-9bf1-6ff6d4820273 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:20.259736 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 665/1358] 10.222.0.52 () {54 vars in 962 bytes} [Thu Sep 15 00:37:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:20.286532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e6227-6f87-4282-bbc8-c224a4bc8ba0 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:20.287476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e6227-6f87-4282-bbc8-c224a4bc8ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:20.288066 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e6227-6f87-4282-bbc8-c224a4bc8ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:20.309493 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:20.401392 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-e11e6227-6f87-4282-bbc8-c224a4bc8ba0 None None] MFA Rules not processed for user `bfcfcf8061f24231858b9b0205a8abaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:20.402631 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e11e6227-6f87-4282-bbc8-c224a4bc8ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:20.526883 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 694/1359] 10.222.0.52 () {58 vars in 1059 bytes} [Thu Sep 15 00:37:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:37:20.535182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35063b7c-4d6e-4430-9bf1-6ff6d4820273 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:37:20.536689 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-35063b7c-4d6e-4430-9bf1-6ff6d4820273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:20.699841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35063b7c-4d6e-4430-9bf1-6ff6d4820273 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:37:20.777378 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:20.825741 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362ac9a-8b74-48f3-b228-6c7a715376cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:37:20.826997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362ac9a-8b74-48f3-b228-6c7a715376cd service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:20.827279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362ac9a-8b74-48f3-b228-6c7a715376cd service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:20.827551 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362ac9a-8b74-48f3-b228-6c7a715376cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:20.829313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6362ac9a-8b74-48f3-b228-6c7a715376cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:20.940677 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362ac9a-8b74-48f3-b228-6c7a715376cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:37:20.942296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362ac9a-8b74-48f3-b228-6c7a715376cd service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:37:20.963704 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 666/1360] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:37:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:37:23.359854 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02c643-cbc2-48d4-af02-fae40f301d90 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:23.359854 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02c643-cbc2-48d4-af02-fae40f301d90 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:23.360886 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02c643-cbc2-48d4-af02-fae40f301d90 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:23.366853 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e24c8-6530-4c1b-8dc4-660395834e66 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:23.367469 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e24c8-6530-4c1b-8dc4-660395834e66 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:23.367469 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e24c8-6530-4c1b-8dc4-660395834e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:23.373900 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 695/1361] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:37:23 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:23.436839 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f29e24c8-6530-4c1b-8dc4-660395834e66 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:23.438076 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f29e24c8-6530-4c1b-8dc4-660395834e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:23.481925 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:23.545352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 667/1362] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:37:23.827861 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02c643-cbc2-48d4-af02-fae40f301d90 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:37:23.829655 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8c02c643-cbc2-48d4-af02-fae40f301d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:23.902403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:24.008342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02c643-cbc2-48d4-af02-fae40f301d90 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:37:24.158460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca4c6c-7bad-4aee-b97d-61b2306a5a01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:37:24.159068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca4c6c-7bad-4aee-b97d-61b2306a5a01 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:24.159346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca4c6c-7bad-4aee-b97d-61b2306a5a01 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:24.159903 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca4c6c-7bad-4aee-b97d-61b2306a5a01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:24.161275 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-69ca4c6c-7bad-4aee-b97d-61b2306a5a01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:24.185355 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:24.257742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca4c6c-7bad-4aee-b97d-61b2306a5a01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:37:24.259344 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca4c6c-7bad-4aee-b97d-61b2306a5a01 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:37:24.277579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 696/1363] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:37:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:37:26.793049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724844d9-c183-4020-979b-f498f2219abe None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:26.793596 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724844d9-c183-4020-979b-f498f2219abe None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:26.793596 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724844d9-c183-4020-979b-f498f2219abe None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:26.795252 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 668/1364] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:26.801213 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61d2eb-bbbd-45f0-8259-14927f0c6f41 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:26.801973 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61d2eb-bbbd-45f0-8259-14927f0c6f41 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:26.802404 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61d2eb-bbbd-45f0-8259-14927f0c6f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:26.874442 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-fc61d2eb-bbbd-45f0-8259-14927f0c6f41 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:26.875682 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-fc61d2eb-bbbd-45f0-8259-14927f0c6f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:26.981808 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:26.989486 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 697/1365] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:37:27.282220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6e284-a0f3-4252-9456-3ee67545ed76 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:27.282602 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6e284-a0f3-4252-9456-3ee67545ed76 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:27.282973 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6e284-a0f3-4252-9456-3ee67545ed76 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:27.284448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 669/1366] 10.222.0.52 () {54 vars in 962 bytes} [Thu Sep 15 00:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:27.289711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b9983-ca69-436b-9dc0-eb5c1275fc2d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:27.290005 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b9983-ca69-436b-9dc0-eb5c1275fc2d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:27.290282 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b9983-ca69-436b-9dc0-eb5c1275fc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:27.372462 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ad1b9983-ca69-436b-9dc0-eb5c1275fc2d None None] MFA Rules not processed for user `bfcfcf8061f24231858b9b0205a8abaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:27.373701 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ad1b9983-ca69-436b-9dc0-eb5c1275fc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:27.498970 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 698/1367] 10.222.0.52 () {58 vars in 1059 bytes} [Thu Sep 15 00:37:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:37:27.507571 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6e284-a0f3-4252-9456-3ee67545ed76 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:37:27.509092 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1ca6e284-a0f3-4252-9456-3ee67545ed76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:27.664715 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6e284-a0f3-4252-9456-3ee67545ed76 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:37:27.687586 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:27.786896 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735de95b-c897-4684-ab0e-3c67a511abac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:37:27.787514 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735de95b-c897-4684-ab0e-3c67a511abac service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:27.787781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735de95b-c897-4684-ab0e-3c67a511abac service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:27.788063 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735de95b-c897-4684-ab0e-3c67a511abac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:27.789664 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-735de95b-c897-4684-ab0e-3c67a511abac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:27.887842 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735de95b-c897-4684-ab0e-3c67a511abac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:37:27.889708 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735de95b-c897-4684-ab0e-3c67a511abac service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:37:27.911091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 670/1368] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:37:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:37:27.989772 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508639ef-8004-44e4-a4ba-596fccadb02c None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:27.990340 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508639ef-8004-44e4-a4ba-596fccadb02c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:27.990340 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508639ef-8004-44e4-a4ba-596fccadb02c None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:27.991644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 699/1369] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:27.997048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d6ee0-a089-456a-96a9-5de232aa55e6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:27.997370 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d6ee0-a089-456a-96a9-5de232aa55e6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:27.997648 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d6ee0-a089-456a-96a9-5de232aa55e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:28.038186 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:28.083815 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9b1d6ee0-a089-456a-96a9-5de232aa55e6 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:28.085104 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9b1d6ee0-a089-456a-96a9-5de232aa55e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:28.211500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 671/1370] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:37:28.546363 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b099b-276b-4b55-801f-d69ad099bd7f None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:28.546363 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b099b-276b-4b55-801f-d69ad099bd7f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:28.546363 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b099b-276b-4b55-801f-d69ad099bd7f None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:28.549617 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 700/1371] 10.222.0.52 () {54 vars in 964 bytes} [Thu Sep 15 00:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:28.553071 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66baad-96eb-4e1f-a633-0a1a1c4e5037 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:28.553397 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66baad-96eb-4e1f-a633-0a1a1c4e5037 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:28.553673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66baad-96eb-4e1f-a633-0a1a1c4e5037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:28.634190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ce66baad-96eb-4e1f-a633-0a1a1c4e5037 None None] MFA Rules not processed for user `a8e11feaab0c4d29b78b2e9273e5d2ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:28.635399 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ce66baad-96eb-4e1f-a633-0a1a1c4e5037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:28.687946 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:28.727652 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 672/1372] 10.222.0.52 () {58 vars in 1061 bytes} [Thu Sep 15 00:37:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:37:28.735298 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b099b-276b-4b55-801f-d69ad099bd7f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:37:28.736868 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-741b099b-276b-4b55-801f-d69ad099bd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:28.797707 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:28.870405 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b099b-276b-4b55-801f-d69ad099bd7f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:37:28.956201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104b3d8-b668-4f74-8c3c-21c7e88da2c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:37:28.956816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104b3d8-b668-4f74-8c3c-21c7e88da2c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:28.957123 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104b3d8-b668-4f74-8c3c-21c7e88da2c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:28.957403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104b3d8-b668-4f74-8c3c-21c7e88da2c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:28.959307 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8104b3d8-b668-4f74-8c3c-21c7e88da2c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:29.075752 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:29.095039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104b3d8-b668-4f74-8c3c-21c7e88da2c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:37:29.097001 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104b3d8-b668-4f74-8c3c-21c7e88da2c0 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:37:29.129581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 701/1373] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:37:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:37:30.153344 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba38de4-58ab-4445-a122-e2a969182e04 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:30.153910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba38de4-58ab-4445-a122-e2a969182e04 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:30.154036 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba38de4-58ab-4445-a122-e2a969182e04 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:30.155288 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 673/1374] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:30.161296 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8e7df-ed2b-4fe9-b3fa-a12e8a64aa59 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:30.161715 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8e7df-ed2b-4fe9-b3fa-a12e8a64aa59 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:30.161898 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8e7df-ed2b-4fe9-b3fa-a12e8a64aa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:30.227716 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8ab8e7df-ed2b-4fe9-b3fa-a12e8a64aa59 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:30.228919 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8ab8e7df-ed2b-4fe9-b3fa-a12e8a64aa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:30.331334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 702/1375] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:37:30.618718 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba38de4-58ab-4445-a122-e2a969182e04 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:37:30.620262 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0ba38de4-58ab-4445-a122-e2a969182e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:30.786545 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba38de4-58ab-4445-a122-e2a969182e04 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:37:30.842776 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:30.908016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7949d-178b-4dc5-a08a-3b94aa23c9d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:37:30.908613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7949d-178b-4dc5-a08a-3b94aa23c9d9 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:30.908887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7949d-178b-4dc5-a08a-3b94aa23c9d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:30.909186 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7949d-178b-4dc5-a08a-3b94aa23c9d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:30.910762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fda7949d-178b-4dc5-a08a-3b94aa23c9d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:31.002839 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7949d-178b-4dc5-a08a-3b94aa23c9d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:37:31.004473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7949d-178b-4dc5-a08a-3b94aa23c9d9 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:37:31.024186 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 674/1376] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:37:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:37:33.247475 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea472a-bd8d-4327-bd01-9db28d9c6f12 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:33.248029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea472a-bd8d-4327-bd01-9db28d9c6f12 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:33.248029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea472a-bd8d-4327-bd01-9db28d9c6f12 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:33.249561 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 703/1377] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:33.254563 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2401a-5050-48a7-aa22-7172bbb0b850 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:33.255033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2401a-5050-48a7-aa22-7172bbb0b850 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:33.255148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2401a-5050-48a7-aa22-7172bbb0b850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:33.327170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-89e2401a-5050-48a7-aa22-7172bbb0b850 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:33.328793 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-89e2401a-5050-48a7-aa22-7172bbb0b850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:33.336876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:33.442134 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 675/1378] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:37:33.727538 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea472a-bd8d-4327-bd01-9db28d9c6f12 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:37:33.729246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-fdea472a-bd8d-4327-bd01-9db28d9c6f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:33.797488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:33.899227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea472a-bd8d-4327-bd01-9db28d9c6f12 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:37:34.025038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d592b55-0644-4968-b55a-2f580d7240b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:37:34.025851 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d592b55-0644-4968-b55a-2f580d7240b2 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:34.026235 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d592b55-0644-4968-b55a-2f580d7240b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:34.026709 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d592b55-0644-4968-b55a-2f580d7240b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:34.028534 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7d592b55-0644-4968-b55a-2f580d7240b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:34.050878 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:34.143855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d592b55-0644-4968-b55a-2f580d7240b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:37:34.145521 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d592b55-0644-4968-b55a-2f580d7240b2 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:37:34.165225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 704/1379] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:37:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:37:36.386948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b1f9d-138f-4a21-b6b9-91886cddb6b7 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:36.387500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b1f9d-138f-4a21-b6b9-91886cddb6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:36.387500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b1f9d-138f-4a21-b6b9-91886cddb6b7 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:36.388995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 676/1380] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:36.394216 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4862e-b343-4f39-93b3-b2f839066596 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:36.394647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4862e-b343-4f39-93b3-b2f839066596 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:36.394822 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4862e-b343-4f39-93b3-b2f839066596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:36.464500 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-59f4862e-b343-4f39-93b3-b2f839066596 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:36.465833 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-59f4862e-b343-4f39-93b3-b2f839066596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:36.568632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:36.581334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 705/1381] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:37:36.866110 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b1f9d-138f-4a21-b6b9-91886cddb6b7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:37:36.867656 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-514b1f9d-138f-4a21-b6b9-91886cddb6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:37.001003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:37.011785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b1f9d-138f-4a21-b6b9-91886cddb6b7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:37:37.143244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5600c-f7b2-443b-a252-73ad4cb3843a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:37:37.143767 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5600c-f7b2-443b-a252-73ad4cb3843a service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:37.144044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5600c-f7b2-443b-a252-73ad4cb3843a service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:37.144310 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5600c-f7b2-443b-a252-73ad4cb3843a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:37.146323 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b4d5600c-f7b2-443b-a252-73ad4cb3843a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:37.242123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5600c-f7b2-443b-a252-73ad4cb3843a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:37:37.244039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5600c-f7b2-443b-a252-73ad4cb3843a service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:37:37.255052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:37.264219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 677/1382] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:37:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:37:39.432838 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57408f4-fd4a-4c6f-bfe6-c0133eff56c2 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:39.433495 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57408f4-fd4a-4c6f-bfe6-c0133eff56c2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:39.433495 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57408f4-fd4a-4c6f-bfe6-c0133eff56c2 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:39.434781 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 706/1383] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:39.441107 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96c405-e6e6-47d9-bbbe-2bf9fa0cc83b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:39.441582 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96c405-e6e6-47d9-bbbe-2bf9fa0cc83b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:39.441698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96c405-e6e6-47d9-bbbe-2bf9fa0cc83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:39.509014 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2e96c405-e6e6-47d9-bbbe-2bf9fa0cc83b None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:39.510288 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2e96c405-e6e6-47d9-bbbe-2bf9fa0cc83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:39.613222 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 678/1384] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:37:39.900903 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57408f4-fd4a-4c6f-bfe6-c0133eff56c2 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:37:39.902445 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d57408f4-fd4a-4c6f-bfe6-c0133eff56c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:40.055159 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57408f4-fd4a-4c6f-bfe6-c0133eff56c2 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:37:40.130891 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:40.182735 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908ece4-abee-4ea0-94a1-4a9e71163cf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:37:40.183374 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908ece4-abee-4ea0-94a1-4a9e71163cf7 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:40.183733 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908ece4-abee-4ea0-94a1-4a9e71163cf7 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:40.184065 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908ece4-abee-4ea0-94a1-4a9e71163cf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:40.185824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4908ece4-abee-4ea0-94a1-4a9e71163cf7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:40.295435 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908ece4-abee-4ea0-94a1-4a9e71163cf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:37:40.297989 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908ece4-abee-4ea0-94a1-4a9e71163cf7 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:37:40.317828 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 707/1385] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:37:42.472708 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c4591-a2c3-4f1d-9e72-8cd3f5698fe7 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:42.473293 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c4591-a2c3-4f1d-9e72-8cd3f5698fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:42.473293 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c4591-a2c3-4f1d-9e72-8cd3f5698fe7 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:42.474628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 679/1386] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:42.480108 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2fdd4-8710-4a06-a5da-99711e870808 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:42.480558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2fdd4-8710-4a06-a5da-99711e870808 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:42.480716 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2fdd4-8710-4a06-a5da-99711e870808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:42.552558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-53a2fdd4-8710-4a06-a5da-99711e870808 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:42.554030 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-53a2fdd4-8710-4a06-a5da-99711e870808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:42.589518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:42.659676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 708/1387] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:37:42.947198 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c4591-a2c3-4f1d-9e72-8cd3f5698fe7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:37:42.948906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f79c4591-a2c3-4f1d-9e72-8cd3f5698fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:43.031046 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:43.102366 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c4591-a2c3-4f1d-9e72-8cd3f5698fe7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:37:43.221951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca6332-015f-44f0-b410-bdf0369f05e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:37:43.222509 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca6332-015f-44f0-b410-bdf0369f05e6 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:43.222747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca6332-015f-44f0-b410-bdf0369f05e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:43.223020 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca6332-015f-44f0-b410-bdf0369f05e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:43.224633 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-80ca6332-015f-44f0-b410-bdf0369f05e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:43.264761 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:43.322511 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca6332-015f-44f0-b410-bdf0369f05e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:37:43.326282 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca6332-015f-44f0-b410-bdf0369f05e6 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:37:43.352021 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 680/1388] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:37:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:37:45.988613 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9d54a-df1a-4aa9-b01c-335773ea7619 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:45.989196 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9d54a-df1a-4aa9-b01c-335773ea7619 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:45.989326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9d54a-df1a-4aa9-b01c-335773ea7619 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:45.990568 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 709/1389] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:45.997078 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11dea1-0e04-4cfc-8497-b5acea51d91e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:45.997516 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11dea1-0e04-4cfc-8497-b5acea51d91e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:45.997794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11dea1-0e04-4cfc-8497-b5acea51d91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:46.071238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9d11dea1-0e04-4cfc-8497-b5acea51d91e None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:46.072455 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9d11dea1-0e04-4cfc-8497-b5acea51d91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:46.171376 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 681/1390] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:37:46.543750 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9d54a-df1a-4aa9-b01c-335773ea7619 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:37:46.545307 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-41e9d54a-df1a-4aa9-b01c-335773ea7619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:46.704774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9d54a-df1a-4aa9-b01c-335773ea7619 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:37:46.726062 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:46.834026 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e651b91-d75d-473f-9ea0-8362cdda0817 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:37:46.834606 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e651b91-d75d-473f-9ea0-8362cdda0817 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:46.834889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e651b91-d75d-473f-9ea0-8362cdda0817 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:46.835161 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e651b91-d75d-473f-9ea0-8362cdda0817 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:46.836764 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7e651b91-d75d-473f-9ea0-8362cdda0817 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:46.939525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e651b91-d75d-473f-9ea0-8362cdda0817 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:37:46.941595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e651b91-d75d-473f-9ea0-8362cdda0817 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:37:46.964548 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 710/1391] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:37:49.206301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849a162-bd11-4d1c-80d2-9258afae3031 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:49.206870 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849a162-bd11-4d1c-80d2-9258afae3031 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:49.206870 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849a162-bd11-4d1c-80d2-9258afae3031 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:49.208114 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 682/1392] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:49.213254 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b79c9f-7256-44db-b89f-252fdb42dd57 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:49.213673 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b79c9f-7256-44db-b89f-252fdb42dd57 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:49.213798 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b79c9f-7256-44db-b89f-252fdb42dd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:49.239834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:49.282409 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b0b79c9f-7256-44db-b89f-252fdb42dd57 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:49.283594 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b0b79c9f-7256-44db-b89f-252fdb42dd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:49.389497 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 711/1393] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:37:49.440438 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deee302-e7c2-40bb-8f0d-61a9fd47644c None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:49.440764 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deee302-e7c2-40bb-8f0d-61a9fd47644c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:49.441065 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deee302-e7c2-40bb-8f0d-61a9fd47644c None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:49.442423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 683/1394] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:49.447730 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a196bf6-b246-42cb-8325-8749ad2f005d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:49.448018 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a196bf6-b246-42cb-8325-8749ad2f005d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:49.448410 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a196bf6-b246-42cb-8325-8749ad2f005d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:49.515853 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-6a196bf6-b246-42cb-8325-8749ad2f005d None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:49.516965 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6a196bf6-b246-42cb-8325-8749ad2f005d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:49.570940 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:49.618657 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 712/1395] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:37:49.679140 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deee302-e7c2-40bb-8f0d-61a9fd47644c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:37:49.680645 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4deee302-e7c2-40bb-8f0d-61a9fd47644c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:49.694016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:49.825061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deee302-e7c2-40bb-8f0d-61a9fd47644c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:37:49.921576 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:49.922690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e52de-4a1d-4b00-8b6d-014aaabc3384 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:49.922990 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e52de-4a1d-4b00-8b6d-014aaabc3384 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:49.923366 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e52de-4a1d-4b00-8b6d-014aaabc3384 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:49.924957 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 713/1396] 10.222.0.52 () {54 vars in 962 bytes} [Thu Sep 15 00:37:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:37:49.930177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac7639-3985-41ed-a8da-5c43770e7e08 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:49.930454 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac7639-3985-41ed-a8da-5c43770e7e08 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:49.930724 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac7639-3985-41ed-a8da-5c43770e7e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:49.949117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5720d6-48fa-465e-a7d6-231c778b5faa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:37:49.949717 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5720d6-48fa-465e-a7d6-231c778b5faa service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:49.949995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5720d6-48fa-465e-a7d6-231c778b5faa service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:49.950266 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5720d6-48fa-465e-a7d6-231c778b5faa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:49.951856 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-af5720d6-48fa-465e-a7d6-231c778b5faa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:50.009249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-beac7639-3985-41ed-a8da-5c43770e7e08 None None] MFA Rules not processed for user `f12ce70a7c4f4396ab3fbb635dfc548b`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:50.010453 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-beac7639-3985-41ed-a8da-5c43770e7e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:50.045421 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5720d6-48fa-465e-a7d6-231c778b5faa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:37:50.047068 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5720d6-48fa-465e-a7d6-231c778b5faa service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:37:50.065840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 684/1397] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:37:50.091056 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 714/1398] 10.222.0.52 () {58 vars in 1059 bytes} [Thu Sep 15 00:37:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:37:50.101182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5720d6-48fa-465e-a7d6-231c778b5faa service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:37:50.102388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-af5720d6-48fa-465e-a7d6-231c778b5faa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:50.184818 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5720d6-48fa-465e-a7d6-231c778b5faa service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:37:50.218971 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:50.272044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ad39c-8cd6-446d-aa9a-41afe06321d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12ce70a7c4f4396ab3fbb635dfc548b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:37:50.273018 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ad39c-8cd6-446d-aa9a-41afe06321d5 service glance] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:50.273322 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ad39c-8cd6-446d-aa9a-41afe06321d5 service glance] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:50.273604 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ad39c-8cd6-446d-aa9a-41afe06321d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:50.275387 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-eb5ad39c-8cd6-446d-aa9a-41afe06321d5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:50.398133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ad39c-8cd6-446d-aa9a-41afe06321d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:37:50.399563 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ad39c-8cd6-446d-aa9a-41afe06321d5 service glance] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:37:50.417629 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 685/1399] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:37:51.158815 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e1baf-1577-47b2-b53a-d5b4ee723e02 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:51.159265 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e1baf-1577-47b2-b53a-d5b4ee723e02 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:51.159508 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e1baf-1577-47b2-b53a-d5b4ee723e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:51.219106 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:51.229000 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-561e1baf-1577-47b2-b53a-d5b4ee723e02 None None] MFA Rules not processed for user `ed49a596f15542a29ce331bae4640274`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:51.230260 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-561e1baf-1577-47b2-b53a-d5b4ee723e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:51.317794 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 715/1400] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 15 00:37:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:37:51.360480 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53fc52-9629-42a2-960a-6ccaa47746e6 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:51.360995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53fc52-9629-42a2-960a-6ccaa47746e6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:51.361177 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53fc52-9629-42a2-960a-6ccaa47746e6 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:51.362792 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 686/1401] 10.222.0.52 () {54 vars in 943 bytes} [Thu Sep 15 00:37:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:51.368887 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c1dde-c4f2-4265-bca1-7bcc29741ee8 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:51.369211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c1dde-c4f2-4265-bca1-7bcc29741ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:51.369491 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c1dde-c4f2-4265-bca1-7bcc29741ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:51.446673 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-146c1dde-c4f2-4265-bca1-7bcc29741ee8 None None] MFA Rules not processed for user `5fb248b85aba45b39132d0f92ede0b68`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:51.447780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-146c1dde-c4f2-4265-bca1-7bcc29741ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:51.520956 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:51.558382 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 716/1402] 10.222.0.52 () {58 vars in 1040 bytes} [Thu Sep 15 00:37:51 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:37:51.568109 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53fc52-9629-42a2-960a-6ccaa47746e6 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:37:51.569782 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3a53fc52-9629-42a2-960a-6ccaa47746e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:51.631488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:51.707553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53fc52-9629-42a2-960a-6ccaa47746e6 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:37:51.812681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9436d-d8dd-4330-9bb9-58898a37cf56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb248b85aba45b39132d0f92ede0b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:37:51.813318 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9436d-d8dd-4330-9bb9-58898a37cf56 service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:51.813596 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9436d-d8dd-4330-9bb9-58898a37cf56 service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:51.813866 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9436d-d8dd-4330-9bb9-58898a37cf56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:51.815471 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-efa9436d-d8dd-4330-9bb9-58898a37cf56 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:51.861879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:51.900824 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9436d-d8dd-4330-9bb9-58898a37cf56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:37:51.902465 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9436d-d8dd-4330-9bb9-58898a37cf56 service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:37:51.911452 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 687/1403] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 15 00:37:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 00:37:52.271801 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0904713-d957-4a48-ad24-885ed6ce0bc6 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:52.272330 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0904713-d957-4a48-ad24-885ed6ce0bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:52.272330 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0904713-d957-4a48-ad24-885ed6ce0bc6 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:52.273774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 717/1404] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:52.279100 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dd963-dabd-49a5-84e4-6accedfd8e76 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:52.279388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dd963-dabd-49a5-84e4-6accedfd8e76 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:52.279659 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dd963-dabd-49a5-84e4-6accedfd8e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:52.359094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3d0dd963-dabd-49a5-84e4-6accedfd8e76 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:52.360469 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3d0dd963-dabd-49a5-84e4-6accedfd8e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:52.469219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 688/1405] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:37:52.758407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0904713-d957-4a48-ad24-885ed6ce0bc6 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:37:52.759920 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a0904713-d957-4a48-ad24-885ed6ce0bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:52.920353 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0904713-d957-4a48-ad24-885ed6ce0bc6 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:37:52.972860 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:53.072841 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667da1e2-3691-46ff-b6cb-4be55e020374 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:37:53.075346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667da1e2-3691-46ff-b6cb-4be55e020374 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:53.085118 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667da1e2-3691-46ff-b6cb-4be55e020374 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:53.085118 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667da1e2-3691-46ff-b6cb-4be55e020374 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:53.085118 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-667da1e2-3691-46ff-b6cb-4be55e020374 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:53.207883 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667da1e2-3691-46ff-b6cb-4be55e020374 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:37:53.209640 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667da1e2-3691-46ff-b6cb-4be55e020374 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:37:53.229780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 718/1406] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:37:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:37:55.451576 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7382f-7ece-45ad-aee7-4abe32b5cb70 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:55.452131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7382f-7ece-45ad-aee7-4abe32b5cb70 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:55.452131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7382f-7ece-45ad-aee7-4abe32b5cb70 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:55.453549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 689/1407] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:37:55.458784 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401e6c9-f821-425f-a502-e1800ec54522 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:55.459189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401e6c9-f821-425f-a502-e1800ec54522 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:55.459328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401e6c9-f821-425f-a502-e1800ec54522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:55.530931 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-7401e6c9-f821-425f-a502-e1800ec54522 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:37:55.532168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7401e6c9-f821-425f-a502-e1800ec54522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:55.535480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:55.643782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 719/1408] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:37:55.940073 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7382f-7ece-45ad-aee7-4abe32b5cb70 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:37:55.941645 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d2b7382f-7ece-45ad-aee7-4abe32b5cb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:55.984081 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:56.102143 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7382f-7ece-45ad-aee7-4abe32b5cb70 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:37:56.227500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:37:56.230135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440b58e-4dc8-4adc-88eb-57bf8ad7050c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:37:56.230983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440b58e-4dc8-4adc-88eb-57bf8ad7050c service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:37:56.231423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440b58e-4dc8-4adc-88eb-57bf8ad7050c service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:37:56.231886 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440b58e-4dc8-4adc-88eb-57bf8ad7050c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:37:56.234064 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6440b58e-4dc8-4adc-88eb-57bf8ad7050c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:37:56.333747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440b58e-4dc8-4adc-88eb-57bf8ad7050c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:37:56.335684 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440b58e-4dc8-4adc-88eb-57bf8ad7050c service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:37:56.356677 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 690/1409] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:37:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:05.642386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=41 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:06.355090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=46 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:14.493759 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb328a2-4221-48cb-a205-552986f21f39 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:14.494354 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb328a2-4221-48cb-a205-552986f21f39 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:14.494354 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb328a2-4221-48cb-a205-552986f21f39 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:14.495689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 720/1410] 10.222.0.52 () {54 vars in 918 bytes} [Thu Sep 15 00:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:38:14.501511 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7141e00-2c67-42bd-ac7b-6b1de3cb5ea5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:14.501975 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7141e00-2c67-42bd-ac7b-6b1de3cb5ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:14.502090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7141e00-2c67-42bd-ac7b-6b1de3cb5ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:14.577445 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f7141e00-2c67-42bd-ac7b-6b1de3cb5ea5 None None] MFA Rules not processed for user `6ed987b44d934ac7b2dc64c0aab28099`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:38:14.578630 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f7141e00-2c67-42bd-ac7b-6b1de3cb5ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:14.681146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 691/1411] 10.222.0.52 () {58 vars in 1015 bytes} [Thu Sep 15 00:38:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:38:14.695766 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f5ae3-4a48-45c8-b8d0-9b113e032aae None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:14.696054 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f5ae3-4a48-45c8-b8d0-9b113e032aae None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:14.696334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f5ae3-4a48-45c8-b8d0-9b113e032aae None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:14.697757 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 721/1412] 10.222.0.52 () {54 vars in 918 bytes} [Thu Sep 15 00:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:38:14.702839 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a097238-37d9-4d1f-a192-91197f8ebc7f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:14.703124 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a097238-37d9-4d1f-a192-91197f8ebc7f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:14.703393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a097238-37d9-4d1f-a192-91197f8ebc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:14.775136 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:14.777697 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-7a097238-37d9-4d1f-a192-91197f8ebc7f None None] MFA Rules not processed for user `bfcfcf8061f24231858b9b0205a8abaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:38:14.779419 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7a097238-37d9-4d1f-a192-91197f8ebc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:14.896304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 692/1413] 10.222.0.52 () {58 vars in 1015 bytes} [Thu Sep 15 00:38:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:38:17.444111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971ac6f-42db-43c7-969c-f6faa65230a7 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:17.444668 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971ac6f-42db-43c7-969c-f6faa65230a7 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:17.444668 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971ac6f-42db-43c7-969c-f6faa65230a7 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:17.446013 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 722/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 00:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:38:17.451371 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efca7db-1b02-4ac1-be6d-b401ead43e09 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:17.451756 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efca7db-1b02-4ac1-be6d-b401ead43e09 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:17.452438 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efca7db-1b02-4ac1-be6d-b401ead43e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:17.518785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-4efca7db-1b02-4ac1-be6d-b401ead43e09 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:38:17.519983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4efca7db-1b02-4ac1-be6d-b401ead43e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:17.573367 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:17.614714 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 693/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 00:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:38:17.902533 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971ac6f-42db-43c7-969c-f6faa65230a7 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:38:17.904123 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3971ac6f-42db-43c7-969c-f6faa65230a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:18.047205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971ac6f-42db-43c7-969c-f6faa65230a7 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:38:18.121577 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:18.161371 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0846cac-e8e9-4a50-a2bf-ec637e9e969a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:38:18.161904 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0846cac-e8e9-4a50-a2bf-ec637e9e969a service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:18.162184 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0846cac-e8e9-4a50-a2bf-ec637e9e969a service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:18.162456 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0846cac-e8e9-4a50-a2bf-ec637e9e969a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:18.164034 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d0846cac-e8e9-4a50-a2bf-ec637e9e969a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:18.256962 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0846cac-e8e9-4a50-a2bf-ec637e9e969a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:38:18.258590 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0846cac-e8e9-4a50-a2bf-ec637e9e969a service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:38:18.276330 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 723/1416] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:38:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:19.406372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286d702-6549-40aa-b838-ec599511b3a1 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:19.406899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286d702-6549-40aa-b838-ec599511b3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:19.406899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286d702-6549-40aa-b838-ec599511b3a1 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:19.408233 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 694/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 00:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:38:19.414728 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be9e14-ab3b-44ec-972b-8ed52df5ae17 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:19.415173 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be9e14-ab3b-44ec-972b-8ed52df5ae17 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:19.415290 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be9e14-ab3b-44ec-972b-8ed52df5ae17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:19.491157 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f2be9e14-ab3b-44ec-972b-8ed52df5ae17 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:38:19.492354 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f2be9e14-ab3b-44ec-972b-8ed52df5ae17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:19.519768 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:19.593453 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 724/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 00:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:38:19.741212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286d702-6549-40aa-b838-ec599511b3a1 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:38:19.742706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1286d702-6549-40aa-b838-ec599511b3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:19.890148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286d702-6549-40aa-b838-ec599511b3a1 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:38:19.930129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:20.001864 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11627263-4aa8-4ec8-b78a-90f256d57141 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:38:20.002462 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11627263-4aa8-4ec8-b78a-90f256d57141 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:20.002738 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11627263-4aa8-4ec8-b78a-90f256d57141 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:20.003007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11627263-4aa8-4ec8-b78a-90f256d57141 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:20.004596 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-11627263-4aa8-4ec8-b78a-90f256d57141 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:20.093525 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11627263-4aa8-4ec8-b78a-90f256d57141 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:38:20.095129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11627263-4aa8-4ec8-b78a-90f256d57141 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:38:20.114759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 695/1419] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:21.250641 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9faae-f61e-4b81-be58-382548442499 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:21.251203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9faae-f61e-4b81-be58-382548442499 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:21.251203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9faae-f61e-4b81-be58-382548442499 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:21.252444 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 725/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 00:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:38:21.258846 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d4b71-f600-4d4f-91f8-131d69b10ed2 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:21.259269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d4b71-f600-4d4f-91f8-131d69b10ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:21.259531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d4b71-f600-4d4f-91f8-131d69b10ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:21.320894 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:21.460606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-487d4b71-f600-4d4f-91f8-131d69b10ed2 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:38:21.461858 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-487d4b71-f600-4d4f-91f8-131d69b10ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:21.571726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 696/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 00:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:38:21.729120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9faae-f61e-4b81-be58-382548442499 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:38:21.730701 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-45e9faae-f61e-4b81-be58-382548442499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:21.878985 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9faae-f61e-4b81-be58-382548442499 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:38:21.890998 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:21.990786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48091f2-0516-459e-a671-aec913917bb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:38:21.991381 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48091f2-0516-459e-a671-aec913917bb2 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:21.991655 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48091f2-0516-459e-a671-aec913917bb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:21.991922 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48091f2-0516-459e-a671-aec913917bb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:21.993516 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c48091f2-0516-459e-a671-aec913917bb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:22.082336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48091f2-0516-459e-a671-aec913917bb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:38:22.083917 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48091f2-0516-459e-a671-aec913917bb2 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:38:22.101677 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 726/1422] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:38:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:23.198360 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833b80e-9f0a-443b-971f-170376f6293f None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:23.198853 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833b80e-9f0a-443b-971f-170376f6293f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:23.198988 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833b80e-9f0a-443b-971f-170376f6293f None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:23.200222 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 697/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 00:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:38:23.207299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85a8aa-6e15-4774-8013-a52a21da71cb None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:23.207725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85a8aa-6e15-4774-8013-a52a21da71cb None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:23.207833 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85a8aa-6e15-4774-8013-a52a21da71cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:23.227559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:23.285535 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-6e85a8aa-6e15-4774-8013-a52a21da71cb None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:38:23.286729 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6e85a8aa-6e15-4774-8013-a52a21da71cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:23.500458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 727/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 00:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:38:23.647695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833b80e-9f0a-443b-971f-170376f6293f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:38:23.649207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0833b80e-9f0a-443b-971f-170376f6293f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:23.758309 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:23.793138 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833b80e-9f0a-443b-971f-170376f6293f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:38:23.902429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac6581-524d-460c-88a0-ec48afd78b15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:38:23.903042 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac6581-524d-460c-88a0-ec48afd78b15 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:23.903318 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac6581-524d-460c-88a0-ec48afd78b15 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:23.903586 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac6581-524d-460c-88a0-ec48afd78b15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:23.905741 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-81ac6581-524d-460c-88a0-ec48afd78b15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:23.980318 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:23.994447 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac6581-524d-460c-88a0-ec48afd78b15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:38:23.996039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac6581-524d-460c-88a0-ec48afd78b15 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:38:24.013959 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 698/1425] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:38:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:25.111537 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4698a4-7844-4308-ab07-832beabccd82 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:25.112076 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4698a4-7844-4308-ab07-832beabccd82 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:25.112076 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4698a4-7844-4308-ab07-832beabccd82 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:25.113443 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 728/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 00:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:38:25.119743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965a980-c242-4b48-b312-313803894bdf None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:25.120160 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965a980-c242-4b48-b312-313803894bdf None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:25.120278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965a980-c242-4b48-b312-313803894bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:25.195570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8965a980-c242-4b48-b312-313803894bdf None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:38:25.196758 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8965a980-c242-4b48-b312-313803894bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:25.289703 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 699/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 00:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:38:25.439026 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4698a4-7844-4308-ab07-832beabccd82 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:38:25.440463 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-af4698a4-7844-4308-ab07-832beabccd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:25.524293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:25.585859 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4698a4-7844-4308-ab07-832beabccd82 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:38:25.696472 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ab5f7-f285-4b58-bb47-572ddb9df7ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:38:25.696996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ab5f7-f285-4b58-bb47-572ddb9df7ac service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:25.697301 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ab5f7-f285-4b58-bb47-572ddb9df7ac service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:25.697569 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ab5f7-f285-4b58-bb47-572ddb9df7ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:25.699132 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ca2ab5f7-f285-4b58-bb47-572ddb9df7ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:25.746748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:25.787414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ab5f7-f285-4b58-bb47-572ddb9df7ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:38:25.788988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ab5f7-f285-4b58-bb47-572ddb9df7ac service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:38:25.807267 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 729/1428] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:26.847593 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3589a1b-8060-48b4-93ee-f1787bcb6d3b None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:26.848137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3589a1b-8060-48b4-93ee-f1787bcb6d3b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:26.848137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3589a1b-8060-48b4-93ee-f1787bcb6d3b None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:26.849497 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 700/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 00:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:38:26.855729 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bab66-177e-4c5d-a878-b2aa0f4107db None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:26.856259 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bab66-177e-4c5d-a878-b2aa0f4107db None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:26.856259 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bab66-177e-4c5d-a878-b2aa0f4107db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:26.933452 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-976bab66-177e-4c5d-a878-b2aa0f4107db None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:38:26.934657 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-976bab66-177e-4c5d-a878-b2aa0f4107db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:27.030757 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 730/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 00:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:38:27.182698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3589a1b-8060-48b4-93ee-f1787bcb6d3b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:38:27.184113 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b3589a1b-8060-48b4-93ee-f1787bcb6d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:27.233169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:27.329660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3589a1b-8060-48b4-93ee-f1787bcb6d3b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:38:27.444315 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971e376-1d1a-4317-8074-6fa7d3978ab8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:38:27.444835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971e376-1d1a-4317-8074-6fa7d3978ab8 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:27.445135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971e376-1d1a-4317-8074-6fa7d3978ab8 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:27.445410 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971e376-1d1a-4317-8074-6fa7d3978ab8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:27.446997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7971e376-1d1a-4317-8074-6fa7d3978ab8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:27.453759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:27.536662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971e376-1d1a-4317-8074-6fa7d3978ab8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:38:27.538280 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971e376-1d1a-4317-8074-6fa7d3978ab8 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:38:27.556158 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 701/1431] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:38:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:28.601578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d6978-e7b8-4a72-a7ad-4d1630c07ccd None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:28.602106 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d6978-e7b8-4a72-a7ad-4d1630c07ccd None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:28.602106 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d6978-e7b8-4a72-a7ad-4d1630c07ccd None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:28.603363 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 731/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 00:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:38:28.609949 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca556a69-b101-459e-814b-610ffd794e91 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:28.610400 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca556a69-b101-459e-814b-610ffd794e91 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:28.610496 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca556a69-b101-459e-814b-610ffd794e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:28.683835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ca556a69-b101-459e-814b-610ffd794e91 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:38:28.685011 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ca556a69-b101-459e-814b-610ffd794e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:28.752480 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:28.781054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 702/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 00:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:38:28.931618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d6978-e7b8-4a72-a7ad-4d1630c07ccd None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:38:28.933153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4d6d6978-e7b8-4a72-a7ad-4d1630c07ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:28.950370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:29.079911 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d6978-e7b8-4a72-a7ad-4d1630c07ccd None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:38:29.167170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:29.192976 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d3a49-90d4-4a50-94ee-fa407c2bfdf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:38:29.193611 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d3a49-90d4-4a50-94ee-fa407c2bfdf8 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:29.193891 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d3a49-90d4-4a50-94ee-fa407c2bfdf8 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:29.194163 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d3a49-90d4-4a50-94ee-fa407c2bfdf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:29.195754 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-903d3a49-90d4-4a50-94ee-fa407c2bfdf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:29.288569 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d3a49-90d4-4a50-94ee-fa407c2bfdf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:38:29.290181 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d3a49-90d4-4a50-94ee-fa407c2bfdf8 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:38:29.308285 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 732/1434] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:38:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:30.365999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab287e01-9712-44f4-9e26-27341dbc6294 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:30.366472 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab287e01-9712-44f4-9e26-27341dbc6294 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:30.366566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab287e01-9712-44f4-9e26-27341dbc6294 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:30.367890 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 703/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 00:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:38:30.374257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5dda8-87e8-4abe-baed-d64134e1712d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:30.374657 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5dda8-87e8-4abe-baed-d64134e1712d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:30.374804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5dda8-87e8-4abe-baed-d64134e1712d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:30.450567 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-43b5dda8-87e8-4abe-baed-d64134e1712d None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:38:30.451756 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-43b5dda8-87e8-4abe-baed-d64134e1712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:30.493035 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:30.547841 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 733/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 00:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:38:30.696763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab287e01-9712-44f4-9e26-27341dbc6294 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:38:30.698334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ab287e01-9712-44f4-9e26-27341dbc6294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:30.838325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab287e01-9712-44f4-9e26-27341dbc6294 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:38:30.892800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:30.950089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686a6c4-1cf1-457e-86d8-21e6ca8731ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:38:30.950678 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686a6c4-1cf1-457e-86d8-21e6ca8731ba service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:30.950950 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686a6c4-1cf1-457e-86d8-21e6ca8731ba service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:30.951212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686a6c4-1cf1-457e-86d8-21e6ca8731ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:30.952788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5686a6c4-1cf1-457e-86d8-21e6ca8731ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:31.039840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686a6c4-1cf1-457e-86d8-21e6ca8731ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:38:31.041466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686a6c4-1cf1-457e-86d8-21e6ca8731ba service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:38:31.059145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 704/1437] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:38:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:32.108131 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b453b-dafc-4a65-b39d-d4e139c4cb34 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:32.108733 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b453b-dafc-4a65-b39d-d4e139c4cb34 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:32.108733 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b453b-dafc-4a65-b39d-d4e139c4cb34 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:32.110067 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 734/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 00:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:38:32.116159 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea886e5a-b63d-467a-8d2c-0a4f3446b64e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:32.116580 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea886e5a-b63d-467a-8d2c-0a4f3446b64e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:32.116726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea886e5a-b63d-467a-8d2c-0a4f3446b64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:32.192427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ea886e5a-b63d-467a-8d2c-0a4f3446b64e None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:38:32.193644 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ea886e5a-b63d-467a-8d2c-0a4f3446b64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:32.195643 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:32.293486 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 705/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 00:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:38:32.443204 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b453b-dafc-4a65-b39d-d4e139c4cb34 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:38:32.444622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-487b453b-dafc-4a65-b39d-d4e139c4cb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:32.588236 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b453b-dafc-4a65-b39d-d4e139c4cb34 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:38:32.615238 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:32.700330 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711503ab-60ee-444a-86a9-6a2c1362ccf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:38:32.700862 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711503ab-60ee-444a-86a9-6a2c1362ccf8 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:32.701199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711503ab-60ee-444a-86a9-6a2c1362ccf8 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:32.701469 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711503ab-60ee-444a-86a9-6a2c1362ccf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:32.703698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-711503ab-60ee-444a-86a9-6a2c1362ccf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:32.790968 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711503ab-60ee-444a-86a9-6a2c1362ccf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:38:32.792540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711503ab-60ee-444a-86a9-6a2c1362ccf8 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:38:32.809982 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 735/1440] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:38:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:34.882619 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526121e4-584f-4699-a33a-3ce2432670d7 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:34.883099 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526121e4-584f-4699-a33a-3ce2432670d7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:34.883201 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526121e4-584f-4699-a33a-3ce2432670d7 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:34.884582 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 706/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 00:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:38:34.889760 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3439da-22fe-4225-9c36-24c8bb72487f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:34.890702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3439da-22fe-4225-9c36-24c8bb72487f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:34.890895 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3439da-22fe-4225-9c36-24c8bb72487f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:34.932742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:34.960978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-3f3439da-22fe-4225-9c36-24c8bb72487f None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:38:34.962222 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3f3439da-22fe-4225-9c36-24c8bb72487f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:35.058312 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 736/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 00:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:38:35.350858 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526121e4-584f-4699-a33a-3ce2432670d7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:38:35.352387 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-526121e4-584f-4699-a33a-3ce2432670d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:35.456542 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526121e4-584f-4699-a33a-3ce2432670d7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:38:35.489010 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:35.530084 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251877ec-975c-4e4f-bc6e-517ef2975477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:38:35.530678 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251877ec-975c-4e4f-bc6e-517ef2975477 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:35.530955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251877ec-975c-4e4f-bc6e-517ef2975477 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:35.531225 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251877ec-975c-4e4f-bc6e-517ef2975477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:35.532808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-251877ec-975c-4e4f-bc6e-517ef2975477 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:35.641734 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251877ec-975c-4e4f-bc6e-517ef2975477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:38:35.643098 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251877ec-975c-4e4f-bc6e-517ef2975477 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:38:35.661091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 707/1443] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:38.004195 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7e79c-684e-44a7-9559-f7aa2c87cdd2 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:38.004782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7e79c-684e-44a7-9559-f7aa2c87cdd2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:38.004782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7e79c-684e-44a7-9559-f7aa2c87cdd2 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:38.006144 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 737/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 00:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:38:38.011538 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033baf63-204b-43d5-b38d-bd94d163f1fb None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:38.011962 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033baf63-204b-43d5-b38d-bd94d163f1fb None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:38.012107 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033baf63-204b-43d5-b38d-bd94d163f1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:38.077578 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-033baf63-204b-43d5-b38d-bd94d163f1fb None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:38:38.078776 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-033baf63-204b-43d5-b38d-bd94d163f1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:38.091183 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:38.175540 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 708/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 00:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:38:38.463257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7e79c-684e-44a7-9559-f7aa2c87cdd2 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:38:38.464817 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-17b7e79c-684e-44a7-9559-f7aa2c87cdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:38.568736 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7e79c-684e-44a7-9559-f7aa2c87cdd2 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:38:38.581484 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:38.642184 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c349a-90f4-4500-9edb-d47e1d59a2fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:38:38.642708 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c349a-90f4-4500-9edb-d47e1d59a2fa service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:38.642980 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c349a-90f4-4500-9edb-d47e1d59a2fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:38.643246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c349a-90f4-4500-9edb-d47e1d59a2fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:38.644803 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7f0c349a-90f4-4500-9edb-d47e1d59a2fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:38.752254 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c349a-90f4-4500-9edb-d47e1d59a2fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:38:38.753703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c349a-90f4-4500-9edb-d47e1d59a2fa service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:38:38.771163 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 738/1446] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:38:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:41.313641 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3960c-5ebf-4a62-9cb5-91b32958fb01 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:41.314195 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3960c-5ebf-4a62-9cb5-91b32958fb01 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:41.314195 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3960c-5ebf-4a62-9cb5-91b32958fb01 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:41.315498 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 709/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 00:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:38:41.321014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210eb9d-f5c7-4e89-8b1a-4d87e57ef313 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:41.321476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210eb9d-f5c7-4e89-8b1a-4d87e57ef313 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:41.321577 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210eb9d-f5c7-4e89-8b1a-4d87e57ef313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:41.372386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:41.390914 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-e210eb9d-f5c7-4e89-8b1a-4d87e57ef313 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:38:41.392123 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e210eb9d-f5c7-4e89-8b1a-4d87e57ef313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:41.490227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 739/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 00:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:38:41.784628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3960c-5ebf-4a62-9cb5-91b32958fb01 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:38:41.786209 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4ba3960c-5ebf-4a62-9cb5-91b32958fb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:41.886578 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3960c-5ebf-4a62-9cb5-91b32958fb01 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:38:41.925689 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:41.960391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b3969-d63c-4a1d-a134-b7497e29be07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:38:41.960914 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b3969-d63c-4a1d-a134-b7497e29be07 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:41.961218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b3969-d63c-4a1d-a134-b7497e29be07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:41.961489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b3969-d63c-4a1d-a134-b7497e29be07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:41.963082 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-369b3969-d63c-4a1d-a134-b7497e29be07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:42.070172 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b3969-d63c-4a1d-a134-b7497e29be07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:38:42.071630 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b3969-d63c-4a1d-a134-b7497e29be07 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:38:42.088974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 710/1449] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:38:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:44.364299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6eef61-f4a1-4aee-94d1-6fc866a2f0a3 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:44.365173 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6eef61-f4a1-4aee-94d1-6fc866a2f0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:44.365173 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6eef61-f4a1-4aee-94d1-6fc866a2f0a3 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:44.366237 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 740/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 00:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:38:44.372385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8750d8-517c-4300-bcfc-0eb51f2cffa6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:44.372901 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8750d8-517c-4300-bcfc-0eb51f2cffa6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:44.373149 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8750d8-517c-4300-bcfc-0eb51f2cffa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:44.443667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8a8750d8-517c-4300-bcfc-0eb51f2cffa6 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:38:44.444887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8a8750d8-517c-4300-bcfc-0eb51f2cffa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:44.465880 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:44.541379 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 711/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 00:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:38:44.829561 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6eef61-f4a1-4aee-94d1-6fc866a2f0a3 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:38:44.831073 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1d6eef61-f4a1-4aee-94d1-6fc866a2f0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:44.934079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6eef61-f4a1-4aee-94d1-6fc866a2f0a3 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:38:44.955309 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:45.008248 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83895ad-a4f8-41f5-aaf7-24ebe611a2ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:38:45.008844 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83895ad-a4f8-41f5-aaf7-24ebe611a2ae service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:45.009145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83895ad-a4f8-41f5-aaf7-24ebe611a2ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:45.009420 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83895ad-a4f8-41f5-aaf7-24ebe611a2ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:45.010998 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a83895ad-a4f8-41f5-aaf7-24ebe611a2ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:45.120369 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83895ad-a4f8-41f5-aaf7-24ebe611a2ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:38:45.121756 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83895ad-a4f8-41f5-aaf7-24ebe611a2ae service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:38:45.140019 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 741/1452] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:38:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:47.409302 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf3270-d4bd-45d6-962c-22aacc466e11 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:47.409811 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf3270-d4bd-45d6-962c-22aacc466e11 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:47.409924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf3270-d4bd-45d6-962c-22aacc466e11 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:47.411183 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 712/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 00:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:38:47.416398 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589dc24-bbf8-4f4a-82af-060ad4fa0a53 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:47.416848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589dc24-bbf8-4f4a-82af-060ad4fa0a53 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:47.416954 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589dc24-bbf8-4f4a-82af-060ad4fa0a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:47.483770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:47.487170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b589dc24-bbf8-4f4a-82af-060ad4fa0a53 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:38:47.488875 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b589dc24-bbf8-4f4a-82af-060ad4fa0a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:47.583570 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 742/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 00:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:38:47.870634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf3270-d4bd-45d6-962c-22aacc466e11 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:38:47.872150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3dcf3270-d4bd-45d6-962c-22aacc466e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:47.973859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf3270-d4bd-45d6-962c-22aacc466e11 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:38:48.022081 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:48.045391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443738e6-a3c5-40f8-8336-04d863441c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:38:48.045986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443738e6-a3c5-40f8-8336-04d863441c4b service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:48.046264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443738e6-a3c5-40f8-8336-04d863441c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:48.047044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443738e6-a3c5-40f8-8336-04d863441c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:48.048634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-443738e6-a3c5-40f8-8336-04d863441c4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:48.154853 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443738e6-a3c5-40f8-8336-04d863441c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:38:48.156285 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443738e6-a3c5-40f8-8336-04d863441c4b service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:38:48.175978 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 713/1455] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:38:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:50.351154 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a6214-c131-49db-8013-ac57cb5b28ac None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:50.351590 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a6214-c131-49db-8013-ac57cb5b28ac None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:50.351825 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a6214-c131-49db-8013-ac57cb5b28ac None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:50.353081 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 743/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 00:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:38:50.358308 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6681b-ca24-45f8-9eac-bb5023a18cb1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:50.358720 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6681b-ca24-45f8-9eac-bb5023a18cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:50.358849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6681b-ca24-45f8-9eac-bb5023a18cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:50.425220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-36c6681b-ca24-45f8-9eac-bb5023a18cb1 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:38:50.426416 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-36c6681b-ca24-45f8-9eac-bb5023a18cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:50.455584 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:50.523430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 714/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 00:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:38:50.809463 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a6214-c131-49db-8013-ac57cb5b28ac None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:38:50.810963 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7b7a6214-c131-49db-8013-ac57cb5b28ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:50.913248 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a6214-c131-49db-8013-ac57cb5b28ac None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:38:50.941355 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:50.985647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887dba09-690a-41a7-8e15-f9fed68bd1e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:38:50.986276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dba09-690a-41a7-8e15-f9fed68bd1e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:50.986550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dba09-690a-41a7-8e15-f9fed68bd1e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:50.986817 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dba09-690a-41a7-8e15-f9fed68bd1e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:50.988373 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-887dba09-690a-41a7-8e15-f9fed68bd1e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:51.095656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887dba09-690a-41a7-8e15-f9fed68bd1e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:38:51.097069 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887dba09-690a-41a7-8e15-f9fed68bd1e4 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:38:51.114963 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 744/1458] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:38:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:53.293296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea867b-c8b4-4508-a41c-0de9740bd722 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:53.293828 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea867b-c8b4-4508-a41c-0de9740bd722 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:53.293828 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea867b-c8b4-4508-a41c-0de9740bd722 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:53.295706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 715/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 00:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:38:53.301113 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098345cc-61e9-45cb-ad4e-c94ce7bf4b96 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:53.301500 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098345cc-61e9-45cb-ad4e-c94ce7bf4b96 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:53.301684 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098345cc-61e9-45cb-ad4e-c94ce7bf4b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:53.371770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-098345cc-61e9-45cb-ad4e-c94ce7bf4b96 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:38:53.372958 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-098345cc-61e9-45cb-ad4e-c94ce7bf4b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:53.381293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:53.469698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 745/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 00:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:38:53.748042 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea867b-c8b4-4508-a41c-0de9740bd722 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:38:53.749599 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b5ea867b-c8b4-4508-a41c-0de9740bd722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:53.851850 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea867b-c8b4-4508-a41c-0de9740bd722 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:38:53.906316 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:53.924089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3905422-636e-49dd-815f-b2dfeb36f7b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:38:53.924705 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3905422-636e-49dd-815f-b2dfeb36f7b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:53.924981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3905422-636e-49dd-815f-b2dfeb36f7b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:53.925276 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3905422-636e-49dd-815f-b2dfeb36f7b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:53.926853 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a3905422-636e-49dd-815f-b2dfeb36f7b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:54.032885 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3905422-636e-49dd-815f-b2dfeb36f7b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:38:54.034273 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3905422-636e-49dd-815f-b2dfeb36f7b9 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:38:54.052104 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 716/1461] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:38:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:56.222969 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb3f58-eb15-4415-b958-20f8bda4365f None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:56.223546 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb3f58-eb15-4415-b958-20f8bda4365f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:56.223546 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb3f58-eb15-4415-b958-20f8bda4365f None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:56.224915 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 746/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 00:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:38:56.230086 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf98b84-6d80-4bc3-b90d-e2a6131f4599 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:56.230527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf98b84-6d80-4bc3-b90d-e2a6131f4599 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:56.230635 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf98b84-6d80-4bc3-b90d-e2a6131f4599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:56.297540 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1cf98b84-6d80-4bc3-b90d-e2a6131f4599 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:38:56.298734 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1cf98b84-6d80-4bc3-b90d-e2a6131f4599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:56.336054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:56.393493 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 717/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 00:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:38:56.674371 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb3f58-eb15-4415-b958-20f8bda4365f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:38:56.675879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6cdb3f58-eb15-4415-b958-20f8bda4365f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:56.778891 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb3f58-eb15-4415-b958-20f8bda4365f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:38:56.815593 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:56.850547 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326eac50-21a7-4e92-a81d-74743f6e5117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:38:56.851135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eac50-21a7-4e92-a81d-74743f6e5117 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:56.851408 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eac50-21a7-4e92-a81d-74743f6e5117 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:56.851671 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eac50-21a7-4e92-a81d-74743f6e5117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:56.853246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-326eac50-21a7-4e92-a81d-74743f6e5117 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:56.959717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326eac50-21a7-4e92-a81d-74743f6e5117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:38:56.961050 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326eac50-21a7-4e92-a81d-74743f6e5117 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:38:56.978732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 747/1464] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:38:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:38:59.120721 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676d967-3cc0-46f5-b80f-9ffe7b21f074 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:59.121326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676d967-3cc0-46f5-b80f-9ffe7b21f074 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:59.121326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676d967-3cc0-46f5-b80f-9ffe7b21f074 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:59.122703 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 718/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 00:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:38:59.128317 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d644f63-e9d6-47d6-aace-cf79e09222fe None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:59.128715 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d644f63-e9d6-47d6-aace-cf79e09222fe None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:59.128825 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d644f63-e9d6-47d6-aace-cf79e09222fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:59.194960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-6d644f63-e9d6-47d6-aace-cf79e09222fe None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:38:59.196164 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6d644f63-e9d6-47d6-aace-cf79e09222fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:59.213847 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:59.292303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 748/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 00:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:38:59.581192 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676d967-3cc0-46f5-b80f-9ffe7b21f074 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:38:59.582704 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7676d967-3cc0-46f5-b80f-9ffe7b21f074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:59.690392 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676d967-3cc0-46f5-b80f-9ffe7b21f074 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:38:59.755334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:38:59.762301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c844a77-32be-484e-b3cf-dd886dbedbfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:38:59.762901 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c844a77-32be-484e-b3cf-dd886dbedbfe service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:38:59.763178 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c844a77-32be-484e-b3cf-dd886dbedbfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:38:59.763450 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c844a77-32be-484e-b3cf-dd886dbedbfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:38:59.765034 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3c844a77-32be-484e-b3cf-dd886dbedbfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:38:59.871807 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c844a77-32be-484e-b3cf-dd886dbedbfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:38:59.873179 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c844a77-32be-484e-b3cf-dd886dbedbfe service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:38:59.891897 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 719/1467] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:38:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:39:02.020729 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87682e6-ead3-43a1-8a91-1848e5b9dd7d None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:02.021329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87682e6-ead3-43a1-8a91-1848e5b9dd7d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:02.021329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87682e6-ead3-43a1-8a91-1848e5b9dd7d None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:02.022694 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 749/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 00:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:39:02.028063 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a378c-b7c8-4dcc-88ac-a5624ef46dcb None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:02.028447 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a378c-b7c8-4dcc-88ac-a5624ef46dcb None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:02.028622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a378c-b7c8-4dcc-88ac-a5624ef46dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:02.094448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-bd9a378c-b7c8-4dcc-88ac-a5624ef46dcb None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:39:02.095910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bd9a378c-b7c8-4dcc-88ac-a5624ef46dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:02.143697 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:39:02.191915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 720/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 00:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:39:02.477047 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87682e6-ead3-43a1-8a91-1848e5b9dd7d None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:39:02.478634 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c87682e6-ead3-43a1-8a91-1848e5b9dd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:02.581495 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87682e6-ead3-43a1-8a91-1848e5b9dd7d None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:39:02.628782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:39:02.654606 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6306ce5-e233-4e43-ac25-91febef80004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:39:02.655200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6306ce5-e233-4e43-ac25-91febef80004 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:02.655709 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6306ce5-e233-4e43-ac25-91febef80004 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:02.656134 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6306ce5-e233-4e43-ac25-91febef80004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:02.659174 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d6306ce5-e233-4e43-ac25-91febef80004 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:02.770082 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6306ce5-e233-4e43-ac25-91febef80004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:39:02.771489 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6306ce5-e233-4e43-ac25-91febef80004 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:39:02.788985 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 750/1470] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:39:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:39:12.190469 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=22 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:39:12.786787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=66 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:39:22.778055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe61ea-d2a1-48ce-a8a8-d93776aa3ead None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:22.778612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe61ea-d2a1-48ce-a8a8-d93776aa3ead None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:22.778612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe61ea-d2a1-48ce-a8a8-d93776aa3ead None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:22.779969 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 721/1471] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:39:22.785164 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0993e5e-4654-4181-9e79-56b019b24e2f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:22.785576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0993e5e-4654-4181-9e79-56b019b24e2f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:22.785693 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0993e5e-4654-4181-9e79-56b019b24e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:22.850632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f0993e5e-4654-4181-9e79-56b019b24e2f None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:39:22.851813 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f0993e5e-4654-4181-9e79-56b019b24e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:22.948173 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 751/1472] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:39:23.247526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e5e05-fc78-43f2-88a0-b4999e292130 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:23.247808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e5e05-fc78-43f2-88a0-b4999e292130 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:23.248079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e5e05-fc78-43f2-88a0-b4999e292130 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:23.249454 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 722/1473] 10.222.0.52 () {54 vars in 962 bytes} [Thu Sep 15 00:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:39:23.254641 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e02563-4b4c-4460-857a-8eb53ad662d9 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:23.254953 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e02563-4b4c-4460-857a-8eb53ad662d9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:23.255231 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e02563-4b4c-4460-857a-8eb53ad662d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:23.336280 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-93e02563-4b4c-4460-857a-8eb53ad662d9 None None] MFA Rules not processed for user `f12ce70a7c4f4396ab3fbb635dfc548b`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:39:23.337540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-93e02563-4b4c-4460-857a-8eb53ad662d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:23.358988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:39:23.413710 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 752/1474] 10.222.0.52 () {58 vars in 1059 bytes} [Thu Sep 15 00:39:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:39:23.421416 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e5e05-fc78-43f2-88a0-b4999e292130 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:39:23.422904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b61e5e05-fc78-43f2-88a0-b4999e292130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:23.527514 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e5e05-fc78-43f2-88a0-b4999e292130 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:39:23.599733 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a9290-fd4f-442c-a1bb-d8663acf8f17 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12ce70a7c4f4396ab3fbb635dfc548b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:39:23.600324 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a9290-fd4f-442c-a1bb-d8663acf8f17 service glance] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:23.600601 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a9290-fd4f-442c-a1bb-d8663acf8f17 service glance] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:23.600870 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a9290-fd4f-442c-a1bb-d8663acf8f17 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:23.602473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a26a9290-fd4f-442c-a1bb-d8663acf8f17 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:23.655459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:39:23.709370 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a9290-fd4f-442c-a1bb-d8663acf8f17 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:39:23.710807 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a9290-fd4f-442c-a1bb-d8663acf8f17 service glance] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:39:23.729413 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 723/1475] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:39:25.939975 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cef6c-f02e-4656-8843-2795eb73282e None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:25.940555 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cef6c-f02e-4656-8843-2795eb73282e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:25.940555 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cef6c-f02e-4656-8843-2795eb73282e None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:25.941935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 753/1476] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:39:25.947195 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e040f-f387-4cda-bb95-f87a68856aca None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:25.947614 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e040f-f387-4cda-bb95-f87a68856aca None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:25.947734 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e040f-f387-4cda-bb95-f87a68856aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:26.012217 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-da3e040f-f387-4cda-bb95-f87a68856aca None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:39:26.013430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-da3e040f-f387-4cda-bb95-f87a68856aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:26.111412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 724/1477] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:39:26.382935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cef6c-f02e-4656-8843-2795eb73282e None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:39:26.384435 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5b0cef6c-f02e-4656-8843-2795eb73282e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:26.507780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cef6c-f02e-4656-8843-2795eb73282e None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:39:26.556688 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:39:26.601736 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f54c41-2bdc-45bb-862a-c6a1d5e0a9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:39:26.602268 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f54c41-2bdc-45bb-862a-c6a1d5e0a9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:26.602572 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f54c41-2bdc-45bb-862a-c6a1d5e0a9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:26.602843 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f54c41-2bdc-45bb-862a-c6a1d5e0a9d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:26.603472 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f54c41-2bdc-45bb-862a-c6a1d5e0a9d1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:39:26.605234 dv-cinder-857528-2-smb devstack@keystone.service[81616]: WARNING py.warnings [None req-c8f54c41-2bdc-45bb-862a-c6a1d5e0a9d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 00:39:26.605234 dv-cinder-857528-2-smb devstack@keystone.service[81616]: warnings.warn(msg) Sep 15 00:39:26.605234 dv-cinder-857528-2-smb devstack@keystone.service[81616]: Sep 15 00:39:26.606398 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f54c41-2bdc-45bb-862a-c6a1d5e0a9d1 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:39:26.625620 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 754/1478] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Sep 15 00:39:26 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:39:28.791639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f3969-1993-455d-82be-c9e7abba0259 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:28.792163 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f3969-1993-455d-82be-c9e7abba0259 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:28.792163 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f3969-1993-455d-82be-c9e7abba0259 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:28.793552 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 725/1479] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:39:28.798772 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9026a38-ccdc-4592-8c72-d23a68ff2ac8 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:28.799207 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9026a38-ccdc-4592-8c72-d23a68ff2ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:28.799320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9026a38-ccdc-4592-8c72-d23a68ff2ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:28.864200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-a9026a38-ccdc-4592-8c72-d23a68ff2ac8 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:39:28.865419 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a9026a38-ccdc-4592-8c72-d23a68ff2ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:28.963782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 755/1480] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:39:29.255679 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f3969-1993-455d-82be-c9e7abba0259 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:39:29.257309 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f95f3969-1993-455d-82be-c9e7abba0259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:29.267496 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:39:29.403317 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f3969-1993-455d-82be-c9e7abba0259 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:39:29.486280 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:39:29.519008 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70798305-4a54-4962-9327-969a76933c6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:39:29.519558 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70798305-4a54-4962-9327-969a76933c6d service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:29.519830 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70798305-4a54-4962-9327-969a76933c6d service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:29.520191 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70798305-4a54-4962-9327-969a76933c6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:29.521794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-70798305-4a54-4962-9327-969a76933c6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:29.608991 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70798305-4a54-4962-9327-969a76933c6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:39:29.611173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70798305-4a54-4962-9327-969a76933c6d service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:39:29.629125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 726/1481] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:39:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:39:31.970940 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a516e4-51e4-4e15-959f-629f5c2aef3d None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:31.971511 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a516e4-51e4-4e15-959f-629f5c2aef3d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:31.971511 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a516e4-51e4-4e15-959f-629f5c2aef3d None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:31.973096 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 756/1482] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:39:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:39:31.978353 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacab095-4ed1-466d-afd4-c7db373f4443 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:31.978794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacab095-4ed1-466d-afd4-c7db373f4443 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:31.978895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacab095-4ed1-466d-afd4-c7db373f4443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:32.043213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-bacab095-4ed1-466d-afd4-c7db373f4443 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:39:32.044406 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bacab095-4ed1-466d-afd4-c7db373f4443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:32.091088 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:39:32.142302 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 727/1483] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:39:32.430036 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a516e4-51e4-4e15-959f-629f5c2aef3d None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:39:32.431653 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-38a516e4-51e4-4e15-959f-629f5c2aef3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:32.457251 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:39:32.536650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a516e4-51e4-4e15-959f-629f5c2aef3d None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:39:32.609420 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9050c-f4c8-4b95-9200-9ed97d46d315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:39:32.609957 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9050c-f4c8-4b95-9200-9ed97d46d315 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:32.610236 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9050c-f4c8-4b95-9200-9ed97d46d315 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:32.610506 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9050c-f4c8-4b95-9200-9ed97d46d315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:32.612135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-65c9050c-f4c8-4b95-9200-9ed97d46d315 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:32.685665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:39:32.721664 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9050c-f4c8-4b95-9200-9ed97d46d315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:39:32.723348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9050c-f4c8-4b95-9200-9ed97d46d315 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:39:32.741029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 757/1484] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:39:34.933326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836b76e-79fc-4fc3-b272-b29637a5e63e None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:34.934247 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836b76e-79fc-4fc3-b272-b29637a5e63e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:34.934247 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836b76e-79fc-4fc3-b272-b29637a5e63e None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:34.935223 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 728/1485] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:39:34.941139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fb2ad-3758-44c6-bf9b-8699c2b79a42 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:34.941580 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fb2ad-3758-44c6-bf9b-8699c2b79a42 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:34.941685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fb2ad-3758-44c6-bf9b-8699c2b79a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:35.006347 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-9e7fb2ad-3758-44c6-bf9b-8699c2b79a42 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:39:35.007519 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9e7fb2ad-3758-44c6-bf9b-8699c2b79a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:35.103065 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 758/1486] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:39:35.395883 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836b76e-79fc-4fc3-b272-b29637a5e63e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:39:35.397435 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e836b76e-79fc-4fc3-b272-b29637a5e63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:35.499239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836b76e-79fc-4fc3-b272-b29637a5e63e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:39:35.571265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:39:35.572937 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631223c1-aa8b-42c8-b2d9-a98baaf48f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:39:35.573615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631223c1-aa8b-42c8-b2d9-a98baaf48f41 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:35.574132 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631223c1-aa8b-42c8-b2d9-a98baaf48f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:35.574572 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631223c1-aa8b-42c8-b2d9-a98baaf48f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:35.576334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-631223c1-aa8b-42c8-b2d9-a98baaf48f41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:35.688891 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631223c1-aa8b-42c8-b2d9-a98baaf48f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:39:35.690279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631223c1-aa8b-42c8-b2d9-a98baaf48f41 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:39:35.709002 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 729/1487] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:39:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:39:37.953117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3999001-a86e-4bde-b620-4a16984e8440 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:37.954299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3999001-a86e-4bde-b620-4a16984e8440 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:37.954299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3999001-a86e-4bde-b620-4a16984e8440 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:37.955654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 759/1488] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:39:37.961037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d58ba-80e6-4896-8a1c-d9b191bd8e32 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:37.961466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d58ba-80e6-4896-8a1c-d9b191bd8e32 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:37.961679 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d58ba-80e6-4896-8a1c-d9b191bd8e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:38.026853 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-888d58ba-80e6-4896-8a1c-d9b191bd8e32 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:39:38.028209 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-888d58ba-80e6-4896-8a1c-d9b191bd8e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:38.082417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:39:38.125830 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 730/1489] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:39:38.415999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3999001-a86e-4bde-b620-4a16984e8440 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:39:38.417576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a3999001-a86e-4bde-b620-4a16984e8440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:38.457041 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:39:38.525215 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3999001-a86e-4bde-b620-4a16984e8440 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:39:38.598055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41dad9-c8b7-4665-907b-01facc4163e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:39:38.598581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41dad9-c8b7-4665-907b-01facc4163e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:38.598856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41dad9-c8b7-4665-907b-01facc4163e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:38.599124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41dad9-c8b7-4665-907b-01facc4163e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:38.600676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6f41dad9-c8b7-4665-907b-01facc4163e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:38.679423 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:39:38.709356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41dad9-c8b7-4665-907b-01facc4163e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:39:38.710773 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41dad9-c8b7-4665-907b-01facc4163e9 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:39:38.728720 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 760/1490] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:39:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:39:41.159653 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d2c1a-c021-45c9-9209-eccac1abcb32 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:41.160170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d2c1a-c021-45c9-9209-eccac1abcb32 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:41.160170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d2c1a-c021-45c9-9209-eccac1abcb32 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:41.161483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 731/1491] 10.222.0.52 () {54 vars in 927 bytes} [Thu Sep 15 00:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:39:41.166779 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f46ed-895d-46b1-9e92-03234f5a98f8 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:41.167225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f46ed-895d-46b1-9e92-03234f5a98f8 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:41.167336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f46ed-895d-46b1-9e92-03234f5a98f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:41.232581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-1c5f46ed-895d-46b1-9e92-03234f5a98f8 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:39:41.233805 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1c5f46ed-895d-46b1-9e92-03234f5a98f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:41.330125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 761/1492] 10.222.0.52 () {58 vars in 1024 bytes} [Thu Sep 15 00:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:39:41.622428 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d2c1a-c021-45c9-9209-eccac1abcb32 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:39:41.623951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-365d2c1a-c021-45c9-9209-eccac1abcb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:41.725563 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d2c1a-c021-45c9-9209-eccac1abcb32 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:39:41.796242 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d1e07-d0f1-471e-a03e-cb664a465827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:39:41.796761 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d1e07-d0f1-471e-a03e-cb664a465827 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:39:41.797038 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d1e07-d0f1-471e-a03e-cb664a465827 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:39:41.797938 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d1e07-d0f1-471e-a03e-cb664a465827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:39:41.799516 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c37d1e07-d0f1-471e-a03e-cb664a465827 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:39:41.808537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:39:41.907806 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d1e07-d0f1-471e-a03e-cb664a465827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:39:41.909267 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d1e07-d0f1-471e-a03e-cb664a465827 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:39:41.927117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 732/1493] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:39:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:39:51.328587 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=82 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:39:51.924904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=50 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:40:58.112005 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001b3c1-f9ea-4a22-8960-d815255b1fe4 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:40:58.112604 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001b3c1-f9ea-4a22-8960-d815255b1fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:40:58.112604 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001b3c1-f9ea-4a22-8960-d815255b1fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:40:58.188576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-a001b3c1-f9ea-4a22-8960-d815255b1fe4 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:40:58.189793 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a001b3c1-f9ea-4a22-8960-d815255b1fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:40:58.285632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 762/1494] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:40:58.293510 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d13d70-7092-4c7c-b9a6-6f0447760664 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:40:58.294014 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d13d70-7092-4c7c-b9a6-6f0447760664 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:40:58.294116 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d13d70-7092-4c7c-b9a6-6f0447760664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:40:58.370868 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e5d13d70-7092-4c7c-b9a6-6f0447760664 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:40:58.372011 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e5d13d70-7092-4c7c-b9a6-6f0447760664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:40:58.467212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 733/1495] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:40:58.472353 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001b3c1-f9ea-4a22-8960-d815255b1fe4 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:40:58.473589 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a001b3c1-f9ea-4a22-8960-d815255b1fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:40:58.485895 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001b3c1-f9ea-4a22-8960-d815255b1fe4 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:40:58.545965 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:40:58.580840 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53826c82-7ee7-446a-ad78-409d226953f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:40:58.581470 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53826c82-7ee7-446a-ad78-409d226953f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:40:58.581752 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53826c82-7ee7-446a-ad78-409d226953f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:40:58.582024 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53826c82-7ee7-446a-ad78-409d226953f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:40:58.582660 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53826c82-7ee7-446a-ad78-409d226953f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:40:58.582969 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53826c82-7ee7-446a-ad78-409d226953f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:40:58.583960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: WARNING py.warnings [None req-53826c82-7ee7-446a-ad78-409d226953f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 00:40:58.583960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: warnings.warn(msg) Sep 15 00:40:58.583960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: Sep 15 00:40:58.584844 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53826c82-7ee7-446a-ad78-409d226953f2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:40:58.596492 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 763/1496] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:40:58.604989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d13d70-7092-4c7c-b9a6-6f0447760664 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:40:58.614071 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d13d70-7092-4c7c-b9a6-6f0447760664 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:40:58.674475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:40:58.707740 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d198e2-57d2-4096-a240-a3a571ba422f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:40:58.708334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d198e2-57d2-4096-a240-a3a571ba422f admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:40:58.708610 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d198e2-57d2-4096-a240-a3a571ba422f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:40:58.708878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d198e2-57d2-4096-a240-a3a571ba422f admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:40:58.709545 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d198e2-57d2-4096-a240-a3a571ba422f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:40:58.711283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: WARNING py.warnings [None req-c5d198e2-57d2-4096-a240-a3a571ba422f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 00:40:58.711283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: warnings.warn(msg) Sep 15 00:40:58.711283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: Sep 15 00:40:58.712518 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d198e2-57d2-4096-a240-a3a571ba422f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:40:58.767875 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 734/1497] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:40:58 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:40:58.772060 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53826c82-7ee7-446a-ad78-409d226953f2 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:40:58.773631 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-53826c82-7ee7-446a-ad78-409d226953f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:40:58.808166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53826c82-7ee7-446a-ad78-409d226953f2 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:40:58.900463 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58296e2a-4405-4497-907f-f1717b23089f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:40:58.901052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58296e2a-4405-4497-907f-f1717b23089f admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:40:58.901366 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58296e2a-4405-4497-907f-f1717b23089f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:40:58.901629 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58296e2a-4405-4497-907f-f1717b23089f admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:40:58.902256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58296e2a-4405-4497-907f-f1717b23089f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:40:58.903241 dv-cinder-857528-2-smb devstack@keystone.service[81616]: WARNING py.warnings [None req-58296e2a-4405-4497-907f-f1717b23089f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 00:40:58.903241 dv-cinder-857528-2-smb devstack@keystone.service[81616]: warnings.warn(msg) Sep 15 00:40:58.903241 dv-cinder-857528-2-smb devstack@keystone.service[81616]: Sep 15 00:40:58.904442 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58296e2a-4405-4497-907f-f1717b23089f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:40:58.948075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 764/1498] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:40:58 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:40:58.949410 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d198e2-57d2-4096-a240-a3a571ba422f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:40:58.950949 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c5d198e2-57d2-4096-a240-a3a571ba422f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:40:59.012368 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d198e2-57d2-4096-a240-a3a571ba422f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:40:59.096138 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:40:59.107388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191139c6-8b9c-4827-a972-373526a36e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:40:59.107979 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191139c6-8b9c-4827-a972-373526a36e0d admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:40:59.108251 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191139c6-8b9c-4827-a972-373526a36e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:40:59.108516 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191139c6-8b9c-4827-a972-373526a36e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:40:59.109171 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191139c6-8b9c-4827-a972-373526a36e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:40:59.110179 dv-cinder-857528-2-smb devstack@keystone.service[81615]: WARNING py.warnings [None req-191139c6-8b9c-4827-a972-373526a36e0d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 00:40:59.110179 dv-cinder-857528-2-smb devstack@keystone.service[81615]: warnings.warn(msg) Sep 15 00:40:59.110179 dv-cinder-857528-2-smb devstack@keystone.service[81615]: Sep 15 00:40:59.111088 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191139c6-8b9c-4827-a972-373526a36e0d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:40:59.123151 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 735/1499] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:40:59.127749 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58296e2a-4405-4497-907f-f1717b23089f admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:40:59.129277 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-58296e2a-4405-4497-907f-f1717b23089f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:40:59.140443 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58296e2a-4405-4497-907f-f1717b23089f admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:40:59.165453 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:40:59.239822 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84046d6a-7cac-42aa-b7b1-41d585b5acbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:40:59.240343 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84046d6a-7cac-42aa-b7b1-41d585b5acbb admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:40:59.240616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84046d6a-7cac-42aa-b7b1-41d585b5acbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:40:59.240878 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84046d6a-7cac-42aa-b7b1-41d585b5acbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:40:59.241539 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84046d6a-7cac-42aa-b7b1-41d585b5acbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:40:59.242534 dv-cinder-857528-2-smb devstack@keystone.service[81616]: WARNING py.warnings [None req-84046d6a-7cac-42aa-b7b1-41d585b5acbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 00:40:59.242534 dv-cinder-857528-2-smb devstack@keystone.service[81616]: warnings.warn(msg) Sep 15 00:40:59.242534 dv-cinder-857528-2-smb devstack@keystone.service[81616]: Sep 15 00:40:59.243412 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84046d6a-7cac-42aa-b7b1-41d585b5acbb admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:40:59.255516 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 765/1500] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:40:59.259660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191139c6-8b9c-4827-a972-373526a36e0d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:40:59.261252 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-191139c6-8b9c-4827-a972-373526a36e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:40:59.295973 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191139c6-8b9c-4827-a972-373526a36e0d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:40:59.390795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75025cd7-bbb5-43f8-9e3f-e40929794d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:40:59.391442 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75025cd7-bbb5-43f8-9e3f-e40929794d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:40:59.391716 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75025cd7-bbb5-43f8-9e3f-e40929794d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:40:59.392539 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75025cd7-bbb5-43f8-9e3f-e40929794d6b admin admin] PATH_INFO: `/v3/projects/f8bdf65376bb417c901f9877c1cc4946/users/3aa3f57255414636be75824b6c411e6b/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:40:59.414663 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75025cd7-bbb5-43f8-9e3f-e40929794d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8bdf65376bb417c901f9877c1cc4946, user_id=3aa3f57255414636be75824b6c411e6b, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:40:59.415689 dv-cinder-857528-2-smb devstack@keystone.service[81615]: WARNING py.warnings [None req-75025cd7-bbb5-43f8-9e3f-e40929794d6b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 00:40:59.415689 dv-cinder-857528-2-smb devstack@keystone.service[81615]: warnings.warn(msg) Sep 15 00:40:59.415689 dv-cinder-857528-2-smb devstack@keystone.service[81615]: Sep 15 00:40:59.417790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75025cd7-bbb5-43f8-9e3f-e40929794d6b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:40:59.442284 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 736/1501] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:40:59 2022] PUT /identity/v3/projects/f8bdf65376bb417c901f9877c1cc4946/users/3aa3f57255414636be75824b6c411e6b/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:40:59.454918 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e24d1-a320-47d5-a47d-7d805ea371f4 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:40:59.455212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e24d1-a320-47d5-a47d-7d805ea371f4 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:40:59.455531 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e24d1-a320-47d5-a47d-7d805ea371f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:40:59.515492 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-171e24d1-a320-47d5-a47d-7d805ea371f4 None None] MFA Rules not processed for user `3aa3f57255414636be75824b6c411e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:40:59.516617 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-171e24d1-a320-47d5-a47d-7d805ea371f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:40:59.592561 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 766/1502] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:40:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:40:59.606544 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c8877-d1b2-497a-9aa9-031444ed0730 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:40:59.606826 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c8877-d1b2-497a-9aa9-031444ed0730 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:40:59.607098 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c8877-d1b2-497a-9aa9-031444ed0730 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:40:59.608443 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 737/1503] 10.222.0.52 () {54 vars in 964 bytes} [Thu Sep 15 00:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:40:59.613498 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185a11b-0534-4c0d-ad71-344499ecb83a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:40:59.613792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185a11b-0534-4c0d-ad71-344499ecb83a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:40:59.614071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185a11b-0534-4c0d-ad71-344499ecb83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:40:59.646231 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:40:59.691270 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2185a11b-0534-4c0d-ad71-344499ecb83a None None] MFA Rules not processed for user `a8e11feaab0c4d29b78b2e9273e5d2ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:40:59.692515 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2185a11b-0534-4c0d-ad71-344499ecb83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:40:59.766711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 767/1504] 10.222.0.52 () {58 vars in 1061 bytes} [Thu Sep 15 00:40:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:40:59.775224 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c8877-d1b2-497a-9aa9-031444ed0730 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:40:59.776713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cb5c8877-d1b2-497a-9aa9-031444ed0730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:40:59.825366 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:40:59.881134 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c8877-d1b2-497a-9aa9-031444ed0730 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:40:59.955118 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6d3e9-4236-422c-b2cf-5b07b82a3477 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:40:59.955717 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6d3e9-4236-422c-b2cf-5b07b82a3477 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:40:59.955995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6d3e9-4236-422c-b2cf-5b07b82a3477 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:40:59.956267 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6d3e9-4236-422c-b2cf-5b07b82a3477 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:40:59.957889 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-adb6d3e9-4236-422c-b2cf-5b07b82a3477 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:41:00.054467 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6d3e9-4236-422c-b2cf-5b07b82a3477 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:41:00.055833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6d3e9-4236-422c-b2cf-5b07b82a3477 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:41:00.059306 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:41:00.074686 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 738/1505] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:40:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:41:00.120230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235864fc-5174-4dd3-a0e7-31a2fe8e9246 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:41:00.120517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235864fc-5174-4dd3-a0e7-31a2fe8e9246 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:41:00.120792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235864fc-5174-4dd3-a0e7-31a2fe8e9246 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:41:00.122079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 768/1506] 10.222.0.52 () {52 vars in 830 bytes} [Thu Sep 15 00:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:41:00.125592 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6d3e9-4236-422c-b2cf-5b07b82a3477 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:41:00.127437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-adb6d3e9-4236-422c-b2cf-5b07b82a3477 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:41:00.222786 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6d3e9-4236-422c-b2cf-5b07b82a3477 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:41:00.317849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dc4dc-7af2-4cfa-8793-a82fc24dde2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:41:00.318512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dc4dc-7af2-4cfa-8793-a82fc24dde2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:41:00.318743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dc4dc-7af2-4cfa-8793-a82fc24dde2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:41:00.319024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dc4dc-7af2-4cfa-8793-a82fc24dde2b admin admin] PATH_INFO: `/v3/users/3aa3f57255414636be75824b6c411e6b` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:41:00.333057 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751dc4dc-7af2-4cfa-8793-a82fc24dde2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aa3f57255414636be75824b6c411e6b)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:41:00.334131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: WARNING py.warnings [None req-751dc4dc-7af2-4cfa-8793-a82fc24dde2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 00:41:00.334131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: warnings.warn(msg) Sep 15 00:41:00.334131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: Sep 15 00:41:00.335381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751dc4dc-7af2-4cfa-8793-a82fc24dde2b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:41:00.345296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:41:00.401982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-751dc4dc-7af2-4cfa-8793-a82fc24dde2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aa3f57255414636be75824b6c411e6b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:41:00.411425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-751dc4dc-7af2-4cfa-8793-a82fc24dde2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aa3f57255414636be75824b6c411e6b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:41:00.411927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-751dc4dc-7af2-4cfa-8793-a82fc24dde2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aa3f57255414636be75824b6c411e6b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:41:00.412434 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-751dc4dc-7af2-4cfa-8793-a82fc24dde2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aa3f57255414636be75824b6c411e6b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:41:00.426875 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-751dc4dc-7af2-4cfa-8793-a82fc24dde2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aa3f57255414636be75824b6c411e6b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:41:00.453793 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 739/1507] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:41:00 2022] DELETE /identity/v3/users/3aa3f57255414636be75824b6c411e6b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:41:00.458149 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f6746-4a06-4281-8aad-c4f6340d518a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:41:00.458654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f6746-4a06-4281-8aad-c4f6340d518a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:41:00.458766 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f6746-4a06-4281-8aad-c4f6340d518a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:41:00.516338 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8f4f6746-4a06-4281-8aad-c4f6340d518a None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:41:00.517665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8f4f6746-4a06-4281-8aad-c4f6340d518a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:41:00.592703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:41:00.606373 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 769/1508] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:41:00.617198 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dc4dc-7af2-4cfa-8793-a82fc24dde2b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:41:00.618388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-751dc4dc-7af2-4cfa-8793-a82fc24dde2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:41:00.718009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dc4dc-7af2-4cfa-8793-a82fc24dde2b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:41:00.772520 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:41:00.793276 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945fa89-13ff-47d1-9579-f76a6846fc10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:41:00.793974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945fa89-13ff-47d1-9579-f76a6846fc10 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:41:00.794159 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945fa89-13ff-47d1-9579-f76a6846fc10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:41:00.794428 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945fa89-13ff-47d1-9579-f76a6846fc10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:41:00.795997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9945fa89-13ff-47d1-9579-f76a6846fc10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:41:00.904817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945fa89-13ff-47d1-9579-f76a6846fc10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:41:00.906234 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945fa89-13ff-47d1-9579-f76a6846fc10 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:41:00.924765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 740/1509] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:41:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:41:01.271753 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f6746-4a06-4281-8aad-c4f6340d518a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:41:01.272996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8f4f6746-4a06-4281-8aad-c4f6340d518a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:41:01.284393 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f6746-4a06-4281-8aad-c4f6340d518a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:41:01.385550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6c683-3bc9-4360-8edd-16680bfa9394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:41:01.386179 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6c683-3bc9-4360-8edd-16680bfa9394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:41:01.386458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6c683-3bc9-4360-8edd-16680bfa9394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:41:01.386726 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6c683-3bc9-4360-8edd-16680bfa9394 admin admin] PATH_INFO: `/v3/projects/f8bdf65376bb417c901f9877c1cc4946` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:41:01.397142 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6c683-3bc9-4360-8edd-16680bfa9394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8bdf65376bb417c901f9877c1cc4946)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:41:01.398150 dv-cinder-857528-2-smb devstack@keystone.service[81616]: WARNING py.warnings [None req-4fc6c683-3bc9-4360-8edd-16680bfa9394 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 00:41:01.398150 dv-cinder-857528-2-smb devstack@keystone.service[81616]: warnings.warn(msg) Sep 15 00:41:01.398150 dv-cinder-857528-2-smb devstack@keystone.service[81616]: Sep 15 00:41:01.399350 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6c683-3bc9-4360-8edd-16680bfa9394 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:41:01.457214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4fc6c683-3bc9-4360-8edd-16680bfa9394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8bdf65376bb417c901f9877c1cc4946', 'request_id': 'req-4fc6c683-3bc9-4360-8edd-16680bfa9394'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:41:01.463049 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4fc6c683-3bc9-4360-8edd-16680bfa9394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8bdf65376bb417c901f9877c1cc4946', 'request_id': 'req-4fc6c683-3bc9-4360-8edd-16680bfa9394'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:41:01.472975 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4fc6c683-3bc9-4360-8edd-16680bfa9394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8bdf65376bb417c901f9877c1cc4946', 'request_id': 'req-4fc6c683-3bc9-4360-8edd-16680bfa9394'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:41:01.502921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4fc6c683-3bc9-4360-8edd-16680bfa9394 admin admin] The token cache is being invalidate because project f8bdf65376bb417c901f9877c1cc4946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:41:01.503208 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4fc6c683-3bc9-4360-8edd-16680bfa9394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:41:01.503636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4fc6c683-3bc9-4360-8edd-16680bfa9394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:41:01.517515 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 770/1510] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:41:01 2022] DELETE /identity/v3/projects/f8bdf65376bb417c901f9877c1cc4946 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:41:10.922564 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=62 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:41:11.500311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:42:35.433243 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d73ac-9bd3-4b61-8b19-453968133a6d None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:35.433821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d73ac-9bd3-4b61-8b19-453968133a6d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:35.433821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d73ac-9bd3-4b61-8b19-453968133a6d None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:35.435149 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 741/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 00:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:42:35.440505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761a46a-e9fe-4242-aa44-66acc5fba252 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:35.440956 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761a46a-e9fe-4242-aa44-66acc5fba252 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:35.441061 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761a46a-e9fe-4242-aa44-66acc5fba252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:35.520634 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-3761a46a-e9fe-4242-aa44-66acc5fba252 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:42:35.521864 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3761a46a-e9fe-4242-aa44-66acc5fba252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:42:35.624956 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 771/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 00:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:42:35.776939 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d73ac-9bd3-4b61-8b19-453968133a6d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:42:35.779018 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-542d73ac-9bd3-4b61-8b19-453968133a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:42:35.898174 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d73ac-9bd3-4b61-8b19-453968133a6d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:42:35.903487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5503c-dae9-4a45-9928-f3dbf9d27d94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:42:35.904083 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5503c-dae9-4a45-9928-f3dbf9d27d94 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:35.904368 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5503c-dae9-4a45-9928-f3dbf9d27d94 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:35.904644 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5503c-dae9-4a45-9928-f3dbf9d27d94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:35.913834 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5503c-dae9-4a45-9928-f3dbf9d27d94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:42:35.915448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5503c-dae9-4a45-9928-f3dbf9d27d94 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:42:35.926439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 742/1513] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:42:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:42:36.999210 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ce5f4-8381-4bfc-8bdb-7eff867bc02f None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:36.999627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ce5f4-8381-4bfc-8bdb-7eff867bc02f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:36.999759 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ce5f4-8381-4bfc-8bdb-7eff867bc02f None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:37.001168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 772/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 00:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:42:37.007483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b9e04-e03d-439f-a098-5536a8bde6d7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:37.008109 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b9e04-e03d-439f-a098-5536a8bde6d7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:37.008109 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b9e04-e03d-439f-a098-5536a8bde6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:37.028179 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-830b9e04-e03d-439f-a098-5536a8bde6d7 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:42:37.029649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-830b9e04-e03d-439f-a098-5536a8bde6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:42:37.042067 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 743/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 00:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:42:37.194549 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ce5f4-8381-4bfc-8bdb-7eff867bc02f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:42:37.209223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ce5f4-8381-4bfc-8bdb-7eff867bc02f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:42:37.214482 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6c959-f214-4104-9ed0-cc423599df01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:42:37.215072 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6c959-f214-4104-9ed0-cc423599df01 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:37.215349 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6c959-f214-4104-9ed0-cc423599df01 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:37.215620 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6c959-f214-4104-9ed0-cc423599df01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:37.223982 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6c959-f214-4104-9ed0-cc423599df01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:42:37.225837 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6c959-f214-4104-9ed0-cc423599df01 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:42:37.235830 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 773/1516] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:42:37.274350 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477444e4-4ba6-41d8-aebc-849221527051 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:37.274636 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477444e4-4ba6-41d8-aebc-849221527051 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:37.274911 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477444e4-4ba6-41d8-aebc-849221527051 None None] PATH_INFO: `/v3` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:37.276273 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 744/1517] 10.222.0.55 () {54 vars in 925 bytes} [Thu Sep 15 00:42:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:42:37.284155 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae48a41-e58c-40a4-a761-21c5e208c28c None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:37.284436 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae48a41-e58c-40a4-a761-21c5e208c28c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:37.284711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae48a41-e58c-40a4-a761-21c5e208c28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:37.355887 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8ae48a41-e58c-40a4-a761-21c5e208c28c None None] MFA Rules not processed for user `6ed987b44d934ac7b2dc64c0aab28099`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:42:37.357160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8ae48a41-e58c-40a4-a761-21c5e208c28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:42:37.376622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:42:37.433295 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 774/1518] 10.222.0.55 () {58 vars in 1015 bytes} [Thu Sep 15 00:42:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:42:46.277185 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76d29e-e6f1-4573-8b06-0b72156ce477 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:46.277653 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76d29e-e6f1-4573-8b06-0b72156ce477 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:46.277758 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76d29e-e6f1-4573-8b06-0b72156ce477 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:46.279058 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 745/1519] 10.222.0.52 () {54 vars in 961 bytes} [Thu Sep 15 00:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:42:46.285182 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb28d08-a515-4c45-bfda-d214fb0b117c None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:46.285675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb28d08-a515-4c45-bfda-d214fb0b117c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:46.286164 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb28d08-a515-4c45-bfda-d214fb0b117c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:46.307656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-fcb28d08-a515-4c45-bfda-d214fb0b117c None None] MFA Rules not processed for user `6ed987b44d934ac7b2dc64c0aab28099`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:42:46.308857 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-fcb28d08-a515-4c45-bfda-d214fb0b117c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:42:46.317511 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 775/1520] 10.222.0.52 () {58 vars in 1058 bytes} [Thu Sep 15 00:42:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:42:46.325079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76d29e-e6f1-4573-8b06-0b72156ce477 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:42:46.338646 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76d29e-e6f1-4573-8b06-0b72156ce477 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:42:46.343697 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d2bfc-2289-4ec9-afc2-170c4d64fb2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed987b44d934ac7b2dc64c0aab28099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:42:46.344796 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d2bfc-2289-4ec9-afc2-170c4d64fb2f service placement] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:46.345075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d2bfc-2289-4ec9-afc2-170c4d64fb2f service placement] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:46.345377 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d2bfc-2289-4ec9-afc2-170c4d64fb2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:46.353873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d2bfc-2289-4ec9-afc2-170c4d64fb2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:42:46.355463 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d2bfc-2289-4ec9-afc2-170c4d64fb2f service placement] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:42:46.365864 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 746/1521] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:42:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:42:48.706967 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d91ef1-3dc1-4a85-adba-65df16b14340 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:48.707560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d91ef1-3dc1-4a85-adba-65df16b14340 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:48.707560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d91ef1-3dc1-4a85-adba-65df16b14340 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:48.708837 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 776/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 00:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:42:48.714821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16388e-b26d-4059-beb2-9e2893655ca6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:48.715303 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16388e-b26d-4059-beb2-9e2893655ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:48.715412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16388e-b26d-4059-beb2-9e2893655ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:48.735520 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-dc16388e-b26d-4059-beb2-9e2893655ca6 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:42:48.736701 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-dc16388e-b26d-4059-beb2-9e2893655ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:42:48.744382 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 747/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 00:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:42:48.896816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d91ef1-3dc1-4a85-adba-65df16b14340 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:42:48.911122 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d91ef1-3dc1-4a85-adba-65df16b14340 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:42:48.916477 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e694bc-2249-4488-a82f-f2be43eb7201 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:42:48.917068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e694bc-2249-4488-a82f-f2be43eb7201 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:48.917375 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e694bc-2249-4488-a82f-f2be43eb7201 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:48.917644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e694bc-2249-4488-a82f-f2be43eb7201 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:48.926041 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e694bc-2249-4488-a82f-f2be43eb7201 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:42:48.927595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e694bc-2249-4488-a82f-f2be43eb7201 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:42:48.936778 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 777/1524] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:42:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:42:50.007252 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff26d8-68a7-4c14-aa18-2b77c464d644 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:50.007820 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff26d8-68a7-4c14-aa18-2b77c464d644 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:50.007820 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff26d8-68a7-4c14-aa18-2b77c464d644 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:50.009186 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 748/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 00:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:42:50.015129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6a2c1-c4c4-40b3-9d29-cb6bcbe0e121 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:50.015626 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6a2c1-c4c4-40b3-9d29-cb6bcbe0e121 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:50.016251 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6a2c1-c4c4-40b3-9d29-cb6bcbe0e121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:50.035362 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-05e6a2c1-c4c4-40b3-9d29-cb6bcbe0e121 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:42:50.036562 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-05e6a2c1-c4c4-40b3-9d29-cb6bcbe0e121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:42:50.044372 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 778/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 00:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:42:50.202515 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff26d8-68a7-4c14-aa18-2b77c464d644 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:42:50.217363 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff26d8-68a7-4c14-aa18-2b77c464d644 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:42:50.222710 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b6a9c-5d6a-4055-ba7d-6e6be5c35fc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:42:50.223294 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b6a9c-5d6a-4055-ba7d-6e6be5c35fc0 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:50.223568 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b6a9c-5d6a-4055-ba7d-6e6be5c35fc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:50.223837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b6a9c-5d6a-4055-ba7d-6e6be5c35fc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:50.231981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b6a9c-5d6a-4055-ba7d-6e6be5c35fc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:42:50.233589 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b6a9c-5d6a-4055-ba7d-6e6be5c35fc0 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:42:50.243212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 749/1527] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:42:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:42:54.251050 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331238bb-486d-4646-bf22-2e13a569257f None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:54.251646 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331238bb-486d-4646-bf22-2e13a569257f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:54.251646 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331238bb-486d-4646-bf22-2e13a569257f None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:54.252911 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 779/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 00:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:42:54.258040 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c8f3f-6bbc-43c7-a1ef-1bc1eedb32d5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:54.258494 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c8f3f-6bbc-43c7-a1ef-1bc1eedb32d5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:54.258594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c8f3f-6bbc-43c7-a1ef-1bc1eedb32d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:54.277513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-749c8f3f-6bbc-43c7-a1ef-1bc1eedb32d5 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:42:54.278796 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-749c8f3f-6bbc-43c7-a1ef-1bc1eedb32d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:42:54.286449 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 750/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 00:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:42:54.577132 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331238bb-486d-4646-bf22-2e13a569257f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:42:54.578857 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-331238bb-486d-4646-bf22-2e13a569257f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:42:54.656720 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331238bb-486d-4646-bf22-2e13a569257f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:42:54.660256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd65dd-9eea-4277-aaca-53145c9e3379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:42:54.660845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd65dd-9eea-4277-aaca-53145c9e3379 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:54.661146 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd65dd-9eea-4277-aaca-53145c9e3379 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:54.661415 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd65dd-9eea-4277-aaca-53145c9e3379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:54.670154 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd65dd-9eea-4277-aaca-53145c9e3379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:42:54.671749 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd65dd-9eea-4277-aaca-53145c9e3379 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:42:54.681607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 780/1530] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:42:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:42:56.798282 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ca9ed-f03d-4b7a-970d-2f794426e5f2 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:56.798811 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ca9ed-f03d-4b7a-970d-2f794426e5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:56.798811 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ca9ed-f03d-4b7a-970d-2f794426e5f2 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:56.800082 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 751/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 00:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:42:56.805329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b053a15-9e7d-4de6-93ac-71014da42bc9 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:56.805738 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b053a15-9e7d-4de6-93ac-71014da42bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:56.805933 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b053a15-9e7d-4de6-93ac-71014da42bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:56.825620 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-4b053a15-9e7d-4de6-93ac-71014da42bc9 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:42:56.826816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4b053a15-9e7d-4de6-93ac-71014da42bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:42:56.835216 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 781/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 00:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:42:57.119944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ca9ed-f03d-4b7a-970d-2f794426e5f2 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:42:57.131535 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ca9ed-f03d-4b7a-970d-2f794426e5f2 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:42:57.134980 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a8569-a95f-443c-8b14-3ebbb198eeac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:42:57.135573 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a8569-a95f-443c-8b14-3ebbb198eeac service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:42:57.135881 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a8569-a95f-443c-8b14-3ebbb198eeac service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:42:57.136155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a8569-a95f-443c-8b14-3ebbb198eeac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:42:57.144848 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a8569-a95f-443c-8b14-3ebbb198eeac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:42:57.146323 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a8569-a95f-443c-8b14-3ebbb198eeac service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:42:57.155532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 752/1533] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:42:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:43:00.925808 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45370707-fe0a-4a00-a440-37a9f11ad581 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:43:00.926466 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45370707-fe0a-4a00-a440-37a9f11ad581 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:43:00.926466 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45370707-fe0a-4a00-a440-37a9f11ad581 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:43:00.927718 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 782/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 00:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:43:00.932933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd36a58-7671-44c4-87f3-3c00378b4ff6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:43:00.933381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd36a58-7671-44c4-87f3-3c00378b4ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:43:00.933490 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd36a58-7671-44c4-87f3-3c00378b4ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:43:00.941644 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=81 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:43:00.961119 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-acd36a58-7671-44c4-87f3-3c00378b4ff6 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:43:00.962727 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-acd36a58-7671-44c4-87f3-3c00378b4ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:43:00.970570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 753/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 00:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:43:01.280647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45370707-fe0a-4a00-a440-37a9f11ad581 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:43:01.282847 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-45370707-fe0a-4a00-a440-37a9f11ad581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:43:01.348074 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:43:01.362484 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45370707-fe0a-4a00-a440-37a9f11ad581 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:43:01.366018 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92286373-02e1-472e-9fbc-68d6eec06142 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:43:01.366616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92286373-02e1-472e-9fbc-68d6eec06142 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:43:01.366910 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92286373-02e1-472e-9fbc-68d6eec06142 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:43:01.367157 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92286373-02e1-472e-9fbc-68d6eec06142 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:43:01.375863 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92286373-02e1-472e-9fbc-68d6eec06142 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:43:01.377295 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92286373-02e1-472e-9fbc-68d6eec06142 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:43:01.386437 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 783/1536] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:43:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:43:03.506937 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde77b48-98ec-419d-a7a5-5755db710148 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:43:03.507490 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde77b48-98ec-419d-a7a5-5755db710148 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:43:03.507490 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde77b48-98ec-419d-a7a5-5755db710148 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:43:03.508827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 754/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 00:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:43:03.514106 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a7b8c-1b3a-4b54-81fd-d1d77e82619b None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:43:03.514542 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a7b8c-1b3a-4b54-81fd-d1d77e82619b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:43:03.514647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a7b8c-1b3a-4b54-81fd-d1d77e82619b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:43:03.534583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-1d6a7b8c-1b3a-4b54-81fd-d1d77e82619b None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:43:03.535762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1d6a7b8c-1b3a-4b54-81fd-d1d77e82619b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:43:03.543423 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 784/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 00:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:43:03.840590 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde77b48-98ec-419d-a7a5-5755db710148 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:43:03.842249 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bde77b48-98ec-419d-a7a5-5755db710148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:43:03.856039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde77b48-98ec-419d-a7a5-5755db710148 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:43:03.859564 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54156d64-dcd6-4b48-b601-c9adc791a492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:43:03.860142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54156d64-dcd6-4b48-b601-c9adc791a492 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:43:03.860429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54156d64-dcd6-4b48-b601-c9adc791a492 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:43:03.860685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54156d64-dcd6-4b48-b601-c9adc791a492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:43:03.869335 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54156d64-dcd6-4b48-b601-c9adc791a492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:43:03.870757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54156d64-dcd6-4b48-b601-c9adc791a492 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:43:03.880036 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 755/1539] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:43:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:43:13.529165 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=11 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:43:13.876027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=8 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:29.818352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5186ab-e038-46b0-82dc-6f9f421bb8a0 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:29.821579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5186ab-e038-46b0-82dc-6f9f421bb8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:29.821579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5186ab-e038-46b0-82dc-6f9f421bb8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:29.843264 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2c5186ab-e038-46b0-82dc-6f9f421bb8a0 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:29.844469 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2c5186ab-e038-46b0-82dc-6f9f421bb8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:29.857762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 785/1540] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:29.866275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013a6ca-c2c7-4d71-838d-b21659eb89c0 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:29.866832 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013a6ca-c2c7-4d71-838d-b21659eb89c0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:29.866832 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013a6ca-c2c7-4d71-838d-b21659eb89c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:29.891846 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-4013a6ca-c2c7-4d71-838d-b21659eb89c0 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:29.893033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4013a6ca-c2c7-4d71-838d-b21659eb89c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:29.904381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 756/1541] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:29.905829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b1e1f-6e9f-4ae8-a8b8-3a1718c0a0bc None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:29.906115 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b1e1f-6e9f-4ae8-a8b8-3a1718c0a0bc None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:29.906388 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b1e1f-6e9f-4ae8-a8b8-3a1718c0a0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:29.921125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013a6ca-c2c7-4d71-838d-b21659eb89c0 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:29.940740 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013a6ca-c2c7-4d71-838d-b21659eb89c0 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:29.943315 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-aa9b1e1f-6e9f-4ae8-a8b8-3a1718c0a0bc None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:29.944560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-aa9b1e1f-6e9f-4ae8-a8b8-3a1718c0a0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:29.951226 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536378d-41c8-4c09-ac41-93048fda7d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:29.951981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536378d-41c8-4c09-ac41-93048fda7d31 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:29.952258 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536378d-41c8-4c09-ac41-93048fda7d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:29.952555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536378d-41c8-4c09-ac41-93048fda7d31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:29.953195 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536378d-41c8-4c09-ac41-93048fda7d31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:44:29.953500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536378d-41c8-4c09-ac41-93048fda7d31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:29.954519 dv-cinder-857528-2-smb devstack@keystone.service[81615]: WARNING py.warnings [None req-4536378d-41c8-4c09-ac41-93048fda7d31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 00:44:29.954519 dv-cinder-857528-2-smb devstack@keystone.service[81615]: warnings.warn(msg) Sep 15 00:44:29.954519 dv-cinder-857528-2-smb devstack@keystone.service[81615]: Sep 15 00:44:29.955408 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536378d-41c8-4c09-ac41-93048fda7d31 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:29.957793 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 786/1542] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:29.958867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4bfca-88ef-4838-a4ea-1fa811b4b3af None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:29.959147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4bfca-88ef-4838-a4ea-1fa811b4b3af None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:29.959414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4bfca-88ef-4838-a4ea-1fa811b4b3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:29.977012 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 757/1543] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:44:29.978657 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cee86c-e27a-466e-9f0e-dac31594f2cb None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:29.978939 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cee86c-e27a-466e-9f0e-dac31594f2cb None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:29.979209 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cee86c-e27a-466e-9f0e-dac31594f2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:29.993477 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-26a4bfca-88ef-4838-a4ea-1fa811b4b3af None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:29.994849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-26a4bfca-88ef-4838-a4ea-1fa811b4b3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:30.007624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 787/1544] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:30.008959 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4955906-5662-416f-868f-07eb57618884 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.009262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4955906-5662-416f-868f-07eb57618884 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.009530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4955906-5662-416f-868f-07eb57618884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.032332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-02cee86c-e27a-466e-9f0e-dac31594f2cb None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:30.033595 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-02cee86c-e27a-466e-9f0e-dac31594f2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:30.045057 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b4955906-5662-416f-868f-07eb57618884 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:30.046287 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b4955906-5662-416f-868f-07eb57618884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:30.056269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 758/1545] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:30.057108 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cee86c-e27a-466e-9f0e-dac31594f2cb None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:30.061188 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 788/1546] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:30.062496 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8ffa1-01ff-4f0b-915e-15145eb48bab None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.062784 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8ffa1-01ff-4f0b-915e-15145eb48bab None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.063058 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8ffa1-01ff-4f0b-915e-15145eb48bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.068169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cee86c-e27a-466e-9f0e-dac31594f2cb None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:30.073606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0f4f4-cce6-404e-8a42-876a5867de8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:30.074152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0f4f4-cce6-404e-8a42-876a5867de8a admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.074431 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0f4f4-cce6-404e-8a42-876a5867de8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.074703 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0f4f4-cce6-404e-8a42-876a5867de8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.075337 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0f4f4-cce6-404e-8a42-876a5867de8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:30.077504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0f4f4-cce6-404e-8a42-876a5867de8a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:30.083329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-50b8ffa1-01ff-4f0b-915e-15145eb48bab None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:30.084514 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-50b8ffa1-01ff-4f0b-915e-15145eb48bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:30.092338 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 789/1547] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:30.093512 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921a7e7-6ae3-41a1-9d04-c9d06469e9c5 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.093797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921a7e7-6ae3-41a1-9d04-c9d06469e9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.094066 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921a7e7-6ae3-41a1-9d04-c9d06469e9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.115401 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b921a7e7-6ae3-41a1-9d04-c9d06469e9c5 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:30.116586 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b921a7e7-6ae3-41a1-9d04-c9d06469e9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:30.117519 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 759/1548] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:30.118661 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b8bf0-34e4-4d99-a6d1-db124412b0fd None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.118948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b8bf0-34e4-4d99-a6d1-db124412b0fd None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.119224 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b8bf0-34e4-4d99-a6d1-db124412b0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.139162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0d0b8bf0-34e4-4d99-a6d1-db124412b0fd None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:30.140364 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0d0b8bf0-34e4-4d99-a6d1-db124412b0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:30.177606 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 790/1549] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:30.181433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1881b9b-7c98-4ea5-aa7a-d0b7fb9c35a7 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.181433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1881b9b-7c98-4ea5-aa7a-d0b7fb9c35a7 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.181433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1881b9b-7c98-4ea5-aa7a-d0b7fb9c35a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.199836 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b1881b9b-7c98-4ea5-aa7a-d0b7fb9c35a7 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:30.201032 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b1881b9b-7c98-4ea5-aa7a-d0b7fb9c35a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:30.202652 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 760/1550] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:30.203483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b8bf0-34e4-4d99-a6d1-db124412b0fd None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:30.212617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b8bf0-34e4-4d99-a6d1-db124412b0fd None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:30.216055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 791/1551] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:30.217228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2c40a-ffab-45be-aca3-5104a2ec0dbf None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.217515 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2c40a-ffab-45be-aca3-5104a2ec0dbf None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.217788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2c40a-ffab-45be-aca3-5104a2ec0dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.224402 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090c99d-61d0-4a50-804a-3c8c45320fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:30.225025 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090c99d-61d0-4a50-804a-3c8c45320fee admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.225409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090c99d-61d0-4a50-804a-3c8c45320fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.225679 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090c99d-61d0-4a50-804a-3c8c45320fee admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.226322 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090c99d-61d0-4a50-804a-3c8c45320fee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:44:30.226625 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090c99d-61d0-4a50-804a-3c8c45320fee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:30.228219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090c99d-61d0-4a50-804a-3c8c45320fee admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:30.238488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8cb2c40a-ffab-45be-aca3-5104a2ec0dbf None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:30.239690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8cb2c40a-ffab-45be-aca3-5104a2ec0dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:30.240383 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 761/1552] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:44:30.241482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b8b6b-a2fc-425d-a2b3-e1216f236fed None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.241764 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b8b6b-a2fc-425d-a2b3-e1216f236fed None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.242035 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b8b6b-a2fc-425d-a2b3-e1216f236fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.248642 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 792/1553] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:30.250052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a39b9-0f0f-4528-96be-909ec06c94da None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.250335 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a39b9-0f0f-4528-96be-909ec06c94da None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.250613 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a39b9-0f0f-4528-96be-909ec06c94da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.261829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3e2b8b6b-a2fc-425d-a2b3-e1216f236fed None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:30.263012 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3e2b8b6b-a2fc-425d-a2b3-e1216f236fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:30.269552 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-416a39b9-0f0f-4528-96be-909ec06c94da None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:30.270665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-416a39b9-0f0f-4528-96be-909ec06c94da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:30.270789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 762/1554] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:30.271529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b8b6b-a2fc-425d-a2b3-e1216f236fed None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:30.280604 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b8b6b-a2fc-425d-a2b3-e1216f236fed None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:30.287632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 793/1555] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:30.287632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a39b9-0f0f-4528-96be-909ec06c94da None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:30.287888 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d853b-d347-46a3-bcd6-9b24000de4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:30.287888 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d853b-d347-46a3-bcd6-9b24000de4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.287888 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d853b-d347-46a3-bcd6-9b24000de4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.287888 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d853b-d347-46a3-bcd6-9b24000de4c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.288261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d853b-d347-46a3-bcd6-9b24000de4c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:30.288261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: WARNING py.warnings [None req-c32d853b-d347-46a3-bcd6-9b24000de4c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 00:44:30.288261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: warnings.warn(msg) Sep 15 00:44:30.288261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: Sep 15 00:44:30.289199 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d853b-d347-46a3-bcd6-9b24000de4c2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:30.298801 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a39b9-0f0f-4528-96be-909ec06c94da None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:30.303480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945da8f1-f88e-47e9-a024-531ff121dc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:30.304101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945da8f1-f88e-47e9-a024-531ff121dc4f admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.304353 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945da8f1-f88e-47e9-a024-531ff121dc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.304625 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945da8f1-f88e-47e9-a024-531ff121dc4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.305295 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945da8f1-f88e-47e9-a024-531ff121dc4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:44:30.305594 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945da8f1-f88e-47e9-a024-531ff121dc4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:30.307176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945da8f1-f88e-47e9-a024-531ff121dc4f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:30.316583 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 763/1556] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:30.316583 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389047-8f16-4378-a1ef-d396061110d2 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.316583 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389047-8f16-4378-a1ef-d396061110d2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.316583 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389047-8f16-4378-a1ef-d396061110d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.320150 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 794/1557] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:44:30.321475 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83a314-3b05-4ccb-ac18-cbf81a907bc1 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.321741 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83a314-3b05-4ccb-ac18-cbf81a907bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.322008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83a314-3b05-4ccb-ac18-cbf81a907bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.348544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-7c83a314-3b05-4ccb-ac18-cbf81a907bc1 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:30.349154 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b2389047-8f16-4378-a1ef-d396061110d2 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:30.349822 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7c83a314-3b05-4ccb-ac18-cbf81a907bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:30.350446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b2389047-8f16-4378-a1ef-d396061110d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:30.358509 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 795/1558] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:30.359064 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 764/1559] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:30.359726 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83a314-3b05-4ccb-ac18-cbf81a907bc1 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:30.362083 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2389047-8f16-4378-a1ef-d396061110d2 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:30.369663 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83a314-3b05-4ccb-ac18-cbf81a907bc1 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:30.371791 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2389047-8f16-4378-a1ef-d396061110d2 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:30.374601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557523f6-fe24-4004-86c2-1204ae686382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:30.375157 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557523f6-fe24-4004-86c2-1204ae686382 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.375497 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557523f6-fe24-4004-86c2-1204ae686382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.375773 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557523f6-fe24-4004-86c2-1204ae686382 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.376483 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557523f6-fe24-4004-86c2-1204ae686382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:30.377018 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e1d55-0409-44a5-9aec-43d317aaec0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:30.377576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: WARNING py.warnings [None req-557523f6-fe24-4004-86c2-1204ae686382 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 00:44:30.377576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: warnings.warn(msg) Sep 15 00:44:30.377576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: Sep 15 00:44:30.377849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e1d55-0409-44a5-9aec-43d317aaec0f admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.378144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e1d55-0409-44a5-9aec-43d317aaec0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.378527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e1d55-0409-44a5-9aec-43d317aaec0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.378760 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557523f6-fe24-4004-86c2-1204ae686382 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:30.379285 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e1d55-0409-44a5-9aec-43d317aaec0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:44:30.379677 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e1d55-0409-44a5-9aec-43d317aaec0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:30.381526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e1d55-0409-44a5-9aec-43d317aaec0f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:30.394794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 765/1560] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:44:30.397109 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6fd60-b75f-430e-8223-f0edf1949f49 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.397478 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6fd60-b75f-430e-8223-f0edf1949f49 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.397752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6fd60-b75f-430e-8223-f0edf1949f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.413992 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 796/1561] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:30.415184 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557523f6-fe24-4004-86c2-1204ae686382 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:30.421733 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-cbd6fd60-b75f-430e-8223-f0edf1949f49 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:30.422949 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cbd6fd60-b75f-430e-8223-f0edf1949f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:30.464899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:30.478297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557523f6-fe24-4004-86c2-1204ae686382 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:30.483389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69559e4c-6b44-47db-985b-54cc351b1264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:30.484023 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69559e4c-6b44-47db-985b-54cc351b1264 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.484308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69559e4c-6b44-47db-985b-54cc351b1264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.484578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69559e4c-6b44-47db-985b-54cc351b1264 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.488576 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 766/1562] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:30.488743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69559e4c-6b44-47db-985b-54cc351b1264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:44:30.488743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69559e4c-6b44-47db-985b-54cc351b1264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:30.488920 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6fd60-b75f-430e-8223-f0edf1949f49 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:30.489008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69559e4c-6b44-47db-985b-54cc351b1264 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:30.494843 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6fd60-b75f-430e-8223-f0edf1949f49 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:30.496517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:30.499985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05859d-4fdd-4132-b728-0e8f2543cfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:30.500562 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05859d-4fdd-4132-b728-0e8f2543cfcd admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.500835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05859d-4fdd-4132-b728-0e8f2543cfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.501118 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05859d-4fdd-4132-b728-0e8f2543cfcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.501752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05859d-4fdd-4132-b728-0e8f2543cfcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:30.503344 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05859d-4fdd-4132-b728-0e8f2543cfcd admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:30.505857 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 797/1563] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:44:30.506891 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69559e4c-6b44-47db-985b-54cc351b1264 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:30.513439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 767/1564] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:30.514109 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05859d-4fdd-4132-b728-0e8f2543cfcd admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:30.517720 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69559e4c-6b44-47db-985b-54cc351b1264 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:30.522225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6113ba1-cb5e-4376-b795-e7c290b967bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:30.522811 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6113ba1-cb5e-4376-b795-e7c290b967bf admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.523089 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6113ba1-cb5e-4376-b795-e7c290b967bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.523205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05859d-4fdd-4132-b728-0e8f2543cfcd admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:30.523357 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6113ba1-cb5e-4376-b795-e7c290b967bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.523986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6113ba1-cb5e-4376-b795-e7c290b967bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:30.526167 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6113ba1-cb5e-4376-b795-e7c290b967bf admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:30.528226 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173599a6-6a83-49b9-a582-0a1987bfb09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:30.528785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173599a6-6a83-49b9-a582-0a1987bfb09c admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.529059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173599a6-6a83-49b9-a582-0a1987bfb09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.529357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173599a6-6a83-49b9-a582-0a1987bfb09c admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.529976 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173599a6-6a83-49b9-a582-0a1987bfb09c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:44:30.530274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173599a6-6a83-49b9-a582-0a1987bfb09c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:30.531836 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173599a6-6a83-49b9-a582-0a1987bfb09c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:30.548557 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 768/1565] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:44:30.549405 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173599a6-6a83-49b9-a582-0a1987bfb09c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:30.559196 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 798/1566] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:30.560006 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6113ba1-cb5e-4376-b795-e7c290b967bf admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:30.562444 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173599a6-6a83-49b9-a582-0a1987bfb09c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:30.624755 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce277c-1161-44c0-9e77-47ff06866297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:30.625301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce277c-1161-44c0-9e77-47ff06866297 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.625581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce277c-1161-44c0-9e77-47ff06866297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.625849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce277c-1161-44c0-9e77-47ff06866297 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.626382 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6113ba1-cb5e-4376-b795-e7c290b967bf admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:30.626511 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce277c-1161-44c0-9e77-47ff06866297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:44:30.626765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce277c-1161-44c0-9e77-47ff06866297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:30.628367 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce277c-1161-44c0-9e77-47ff06866297 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:30.631122 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c30523-7237-4ee2-966d-d471fe67f8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:30.631719 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c30523-7237-4ee2-966d-d471fe67f8de admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.632001 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c30523-7237-4ee2-966d-d471fe67f8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.632275 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c30523-7237-4ee2-966d-d471fe67f8de admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.632906 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c30523-7237-4ee2-966d-d471fe67f8de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:30.634854 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c30523-7237-4ee2-966d-d471fe67f8de admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:30.639587 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 769/1567] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:44:30.640487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce277c-1161-44c0-9e77-47ff06866297 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:30.652251 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce277c-1161-44c0-9e77-47ff06866297 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:30.657963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f1cb0-11fc-454b-bf33-6e26c841ed9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:30.658585 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f1cb0-11fc-454b-bf33-6e26c841ed9c admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.659025 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f1cb0-11fc-454b-bf33-6e26c841ed9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.659301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f1cb0-11fc-454b-bf33-6e26c841ed9c admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.659925 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f1cb0-11fc-454b-bf33-6e26c841ed9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:30.661877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f1cb0-11fc-454b-bf33-6e26c841ed9c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:30.663158 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 799/1568] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:30.663976 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c30523-7237-4ee2-966d-d471fe67f8de admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:30.690845 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 770/1569] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/users => generated 286 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:30.690845 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f1cb0-11fc-454b-bf33-6e26c841ed9c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:30.701816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f1cb0-11fc-454b-bf33-6e26c841ed9c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:30.727983 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c30523-7237-4ee2-966d-d471fe67f8de admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:30.732682 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0720f-e65c-4afb-a7ea-e51635941a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:30.733312 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0720f-e65c-4afb-a7ea-e51635941a8d admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.733598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0720f-e65c-4afb-a7ea-e51635941a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.733874 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0720f-e65c-4afb-a7ea-e51635941a8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.734526 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0720f-e65c-4afb-a7ea-e51635941a8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:44:30.734832 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0720f-e65c-4afb-a7ea-e51635941a8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:30.736431 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0720f-e65c-4afb-a7ea-e51635941a8d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:30.748409 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 800/1570] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:44:30.749237 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0720f-e65c-4afb-a7ea-e51635941a8d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:30.757398 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7febb39-6ba1-434f-ac25-64198f2d0c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:30.758004 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7febb39-6ba1-434f-ac25-64198f2d0c39 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.758288 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7febb39-6ba1-434f-ac25-64198f2d0c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.758559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7febb39-6ba1-434f-ac25-64198f2d0c39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.759188 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7febb39-6ba1-434f-ac25-64198f2d0c39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:30.760609 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0720f-e65c-4afb-a7ea-e51635941a8d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:30.761758 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7febb39-6ba1-434f-ac25-64198f2d0c39 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:30.767350 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc4926-bc46-4aee-82ec-8341fa1af28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:30.768013 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc4926-bc46-4aee-82ec-8341fa1af28c admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.768312 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc4926-bc46-4aee-82ec-8341fa1af28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.768694 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc4926-bc46-4aee-82ec-8341fa1af28c admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.769869 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc4926-bc46-4aee-82ec-8341fa1af28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:30.771576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc4926-bc46-4aee-82ec-8341fa1af28c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:30.783401 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 801/1571] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:30.784267 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc4926-bc46-4aee-82ec-8341fa1af28c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:30.792936 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 771/1572] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:30.793764 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7febb39-6ba1-434f-ac25-64198f2d0c39 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:30.793899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc4926-bc46-4aee-82ec-8341fa1af28c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:30.819748 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:30.841318 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:30.855672 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ad41b-b727-4033-99e6-ef985d69f4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:30.856280 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ad41b-b727-4033-99e6-ef985d69f4cb admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.856569 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ad41b-b727-4033-99e6-ef985d69f4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.856844 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ad41b-b727-4033-99e6-ef985d69f4cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.856963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7febb39-6ba1-434f-ac25-64198f2d0c39 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:30.857524 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ad41b-b727-4033-99e6-ef985d69f4cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:30.859452 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ad41b-b727-4033-99e6-ef985d69f4cb admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:30.861639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2f2f5-2e5f-4a06-afd5-9bfd239474c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:30.862403 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2f2f5-2e5f-4a06-afd5-9bfd239474c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.862680 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2f2f5-2e5f-4a06-afd5-9bfd239474c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.862949 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2f2f5-2e5f-4a06-afd5-9bfd239474c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.863685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2f2f5-2e5f-4a06-afd5-9bfd239474c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:30.866274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2f2f5-2e5f-4a06-afd5-9bfd239474c4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:30.888695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 772/1573] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:30.889496 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2f2f5-2e5f-4a06-afd5-9bfd239474c4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:30.893205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 802/1574] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:30.893205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ad41b-b727-4033-99e6-ef985d69f4cb admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:30.899052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2f2f5-2e5f-4a06-afd5-9bfd239474c4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:30.954223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ad41b-b727-4033-99e6-ef985d69f4cb admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:30.957182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70bc6a-5b05-490d-86db-c231ca005267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:30.957787 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70bc6a-5b05-490d-86db-c231ca005267 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.958069 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70bc6a-5b05-490d-86db-c231ca005267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.958346 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70bc6a-5b05-490d-86db-c231ca005267 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.958836 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c69603-7c81-4a98-9863-529f6cc2d768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:30.958998 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70bc6a-5b05-490d-86db-c231ca005267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:30.959441 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c69603-7c81-4a98-9863-529f6cc2d768 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:30.959720 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c69603-7c81-4a98-9863-529f6cc2d768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:30.959994 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c69603-7c81-4a98-9863-529f6cc2d768 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:30.960644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c69603-7c81-4a98-9863-529f6cc2d768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:30.960927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70bc6a-5b05-490d-86db-c231ca005267 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:30.962598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c69603-7c81-4a98-9863-529f6cc2d768 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:30.987077 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 803/1575] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:30.988047 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c69603-7c81-4a98-9863-529f6cc2d768 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:30.994014 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 773/1576] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/projects => generated 403 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:30.994014 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70bc6a-5b05-490d-86db-c231ca005267 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:30.999601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c69603-7c81-4a98-9863-529f6cc2d768 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.054854 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a46a11-d53f-4658-94f0-65ca8bf643d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.055460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a46a11-d53f-4658-94f0-65ca8bf643d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.055716 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70bc6a-5b05-490d-86db-c231ca005267 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.055847 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a46a11-d53f-4658-94f0-65ca8bf643d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.056003 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a46a11-d53f-4658-94f0-65ca8bf643d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.056711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a46a11-d53f-4658-94f0-65ca8bf643d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.058312 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a46a11-d53f-4658-94f0-65ca8bf643d3 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.060563 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f634324-16e3-4785-9c1e-7a6127e56099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.061209 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f634324-16e3-4785-9c1e-7a6127e56099 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.061489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f634324-16e3-4785-9c1e-7a6127e56099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.061763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f634324-16e3-4785-9c1e-7a6127e56099 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.062426 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f634324-16e3-4785-9c1e-7a6127e56099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.064398 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f634324-16e3-4785-9c1e-7a6127e56099 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.068314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 804/1577] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:31.069080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a46a11-d53f-4658-94f0-65ca8bf643d3 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.080849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a46a11-d53f-4658-94f0-65ca8bf643d3 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.086475 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b293e8-1036-44f7-9c43-14fd4d322ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.087157 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b293e8-1036-44f7-9c43-14fd4d322ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.087442 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b293e8-1036-44f7-9c43-14fd4d322ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.087728 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b293e8-1036-44f7-9c43-14fd4d322ed6 admin admin] PATH_INFO: `/v3/projects/6d8c50f214e04fa1b50d3539e95baeab/users/888bda8e3665469cafd6739ae3423bab/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.094423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 774/1578] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:44:30 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:31.095300 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f634324-16e3-4785-9c1e-7a6127e56099 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.104105 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b293e8-1036-44f7-9c43-14fd4d322ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8c50f214e04fa1b50d3539e95baeab, user_id=888bda8e3665469cafd6739ae3423bab, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.105223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: WARNING py.warnings [None req-34b293e8-1036-44f7-9c43-14fd4d322ed6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 00:44:31.105223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: warnings.warn(msg) Sep 15 00:44:31.105223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: Sep 15 00:44:31.107171 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b293e8-1036-44f7-9c43-14fd4d322ed6 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.121272 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 805/1579] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:31 2022] PUT /identity/v3/projects/6d8c50f214e04fa1b50d3539e95baeab/users/888bda8e3665469cafd6739ae3423bab/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:31.122135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b293e8-1036-44f7-9c43-14fd4d322ed6 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.125708 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:31.159449 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:31.162358 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f634324-16e3-4785-9c1e-7a6127e56099 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.190277 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b293e8-1036-44f7-9c43-14fd4d322ed6 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.194809 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc245053-b36e-45ee-a1f9-b701496ed84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.195413 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc245053-b36e-45ee-a1f9-b701496ed84e admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.195689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc245053-b36e-45ee-a1f9-b701496ed84e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.195963 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc245053-b36e-45ee-a1f9-b701496ed84e admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.196597 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc245053-b36e-45ee-a1f9-b701496ed84e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.198215 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc245053-b36e-45ee-a1f9-b701496ed84e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.209286 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 806/1580] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:31.210189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc245053-b36e-45ee-a1f9-b701496ed84e admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.219469 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc245053-b36e-45ee-a1f9-b701496ed84e admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.222095 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2643d-f293-4ad8-af85-9012bad6bf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.222963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2643d-f293-4ad8-af85-9012bad6bf42 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.223243 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2643d-f293-4ad8-af85-9012bad6bf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.223515 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2643d-f293-4ad8-af85-9012bad6bf42 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.224135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2643d-f293-4ad8-af85-9012bad6bf42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.224762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c60994-827b-4991-948a-971436be881d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.225388 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c60994-827b-4991-948a-971436be881d admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.225706 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c60994-827b-4991-948a-971436be881d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.225979 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c60994-827b-4991-948a-971436be881d admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.226099 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2643d-f293-4ad8-af85-9012bad6bf42 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.226587 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c60994-827b-4991-948a-971436be881d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.228492 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c60994-827b-4991-948a-971436be881d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.253070 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 775/1581] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:44:31 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:31.253304 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 807/1582] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:44:31 2022] POST /identity/v3/users => generated 287 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:31.253443 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2643d-f293-4ad8-af85-9012bad6bf42 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.253549 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c60994-827b-4991-948a-971436be881d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.264124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c60994-827b-4991-948a-971436be881d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.264310 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2643d-f293-4ad8-af85-9012bad6bf42 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.268661 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e75588-2d8c-4c21-8d76-f1a7816b713b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.268831 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253eac14-a932-4f89-b635-4b71225e8dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.269401 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e75588-2d8c-4c21-8d76-f1a7816b713b admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.269629 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253eac14-a932-4f89-b635-4b71225e8dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.269734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e75588-2d8c-4c21-8d76-f1a7816b713b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.269905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253eac14-a932-4f89-b635-4b71225e8dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.270020 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e75588-2d8c-4c21-8d76-f1a7816b713b admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.270221 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253eac14-a932-4f89-b635-4b71225e8dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.270555 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e75588-2d8c-4c21-8d76-f1a7816b713b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.271005 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253eac14-a932-4f89-b635-4b71225e8dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.272551 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253eac14-a932-4f89-b635-4b71225e8dc2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.272720 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e75588-2d8c-4c21-8d76-f1a7816b713b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.282645 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 776/1583] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:31.283540 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253eac14-a932-4f89-b635-4b71225e8dc2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.293625 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253eac14-a932-4f89-b635-4b71225e8dc2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.298442 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 808/1584] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:44:31 2022] POST /identity/v3/users => generated 302 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:31.298442 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e75588-2d8c-4c21-8d76-f1a7816b713b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.298655 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e37c9-c3e7-4c12-be03-923c397ddf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.299000 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e37c9-c3e7-4c12-be03-923c397ddf70 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.299225 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e37c9-c3e7-4c12-be03-923c397ddf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.299492 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e37c9-c3e7-4c12-be03-923c397ddf70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.300117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e37c9-c3e7-4c12-be03-923c397ddf70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.301726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e37c9-c3e7-4c12-be03-923c397ddf70 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.306133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e75588-2d8c-4c21-8d76-f1a7816b713b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.311214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74939ba-2945-4552-a0ea-3a1148333738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.311787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74939ba-2945-4552-a0ea-3a1148333738 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.312062 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74939ba-2945-4552-a0ea-3a1148333738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.312331 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74939ba-2945-4552-a0ea-3a1148333738 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.315516 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 777/1585] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:31.315652 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74939ba-2945-4552-a0ea-3a1148333738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.315745 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d3bf9-a3e7-482c-aa43-607d5c57a110 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.315745 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d3bf9-a3e7-482c-aa43-607d5c57a110 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.315745 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d3bf9-a3e7-482c-aa43-607d5c57a110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.315967 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74939ba-2945-4552-a0ea-3a1148333738 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.333523 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d14d3bf9-a3e7-482c-aa43-607d5c57a110 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:31.334750 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d14d3bf9-a3e7-482c-aa43-607d5c57a110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:31.336926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 809/1586] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:44:31 2022] POST /identity/v3/users => generated 284 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:31.337629 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74939ba-2945-4552-a0ea-3a1148333738 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.344617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 778/1587] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:31.346619 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d3bf9-a3e7-482c-aa43-607d5c57a110 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.353278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74939ba-2945-4552-a0ea-3a1148333738 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.357113 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d3bf9-a3e7-482c-aa43-607d5c57a110 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.358354 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d669958-090d-45da-a684-97a41d276486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.358960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d669958-090d-45da-a684-97a41d276486 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.359240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d669958-090d-45da-a684-97a41d276486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.359506 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d669958-090d-45da-a684-97a41d276486 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.360143 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d669958-090d-45da-a684-97a41d276486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.361861 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f6b75-8eaf-4eb8-8912-e0e240b19ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.361992 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d669958-090d-45da-a684-97a41d276486 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.362451 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f6b75-8eaf-4eb8-8912-e0e240b19ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.362730 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f6b75-8eaf-4eb8-8912-e0e240b19ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.363037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f6b75-8eaf-4eb8-8912-e0e240b19ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.363841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f6b75-8eaf-4eb8-8912-e0e240b19ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.365975 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f6b75-8eaf-4eb8-8912-e0e240b19ce6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.375841 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 810/1588] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:31.375841 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d669958-090d-45da-a684-97a41d276486 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.377178 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 779/1589] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:31.377940 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f6b75-8eaf-4eb8-8912-e0e240b19ce6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.385737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d669958-090d-45da-a684-97a41d276486 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.389951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f6b75-8eaf-4eb8-8912-e0e240b19ce6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.391348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f491a67-28da-4d79-b0a4-f62691dffee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.391936 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f491a67-28da-4d79-b0a4-f62691dffee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.392243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f491a67-28da-4d79-b0a4-f62691dffee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.392513 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f491a67-28da-4d79-b0a4-f62691dffee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.393175 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f491a67-28da-4d79-b0a4-f62691dffee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.394751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f491a67-28da-4d79-b0a4-f62691dffee9 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.394924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d484fb-d82e-4eee-a904-f835f0e1b3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.395504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d484fb-d82e-4eee-a904-f835f0e1b3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.395896 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d484fb-d82e-4eee-a904-f835f0e1b3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.396232 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d484fb-d82e-4eee-a904-f835f0e1b3a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.396869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d484fb-d82e-4eee-a904-f835f0e1b3a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.398494 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d484fb-d82e-4eee-a904-f835f0e1b3a7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.405483 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 811/1590] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:31.406285 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f491a67-28da-4d79-b0a4-f62691dffee9 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.408963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 780/1591] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:31.413050 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d484fb-d82e-4eee-a904-f835f0e1b3a7 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.416113 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f491a67-28da-4d79-b0a4-f62691dffee9 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.421265 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e37dcd-caea-40f6-aa72-abdc264619a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.421985 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e37dcd-caea-40f6-aa72-abdc264619a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.422305 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e37dcd-caea-40f6-aa72-abdc264619a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.422582 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e37dcd-caea-40f6-aa72-abdc264619a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.423346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e37dcd-caea-40f6-aa72-abdc264619a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.424910 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e37dcd-caea-40f6-aa72-abdc264619a5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.425038 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d484fb-d82e-4eee-a904-f835f0e1b3a7 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.429732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec33ad8-a7b2-47e6-a57e-785a17ea4d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.430368 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec33ad8-a7b2-47e6-a57e-785a17ea4d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.430643 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec33ad8-a7b2-47e6-a57e-785a17ea4d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.430911 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec33ad8-a7b2-47e6-a57e-785a17ea4d4e admin admin] PATH_INFO: `/v3/projects/d5fe2749241a4bb3a9ca62eb88b8e5a7/users/98182d9d32224bc0a85306757822e8d6/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.435463 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 812/1592] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:31.439177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e37dcd-caea-40f6-aa72-abdc264619a5 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.446063 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec33ad8-a7b2-47e6-a57e-785a17ea4d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5fe2749241a4bb3a9ca62eb88b8e5a7, user_id=98182d9d32224bc0a85306757822e8d6, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.449099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e37dcd-caea-40f6-aa72-abdc264619a5 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.449723 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec33ad8-a7b2-47e6-a57e-785a17ea4d4e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.453710 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fe516-2b0f-461f-be63-c24a86b0bda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.454304 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fe516-2b0f-461f-be63-c24a86b0bda1 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.454583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fe516-2b0f-461f-be63-c24a86b0bda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.454853 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fe516-2b0f-461f-be63-c24a86b0bda1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.455535 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fe516-2b0f-461f-be63-c24a86b0bda1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.457045 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fe516-2b0f-461f-be63-c24a86b0bda1 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.462765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 781/1593] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:31 2022] PUT /identity/v3/projects/d5fe2749241a4bb3a9ca62eb88b8e5a7/users/98182d9d32224bc0a85306757822e8d6/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:31.463550 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec33ad8-a7b2-47e6-a57e-785a17ea4d4e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.467093 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 813/1594] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:31.467730 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fe516-2b0f-461f-be63-c24a86b0bda1 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.481643 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fe516-2b0f-461f-be63-c24a86b0bda1 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.513578 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:31.521032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec33ad8-a7b2-47e6-a57e-785a17ea4d4e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.531952 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0a062-bf4c-4c1c-b76f-e6e137f7688d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.532561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0a062-bf4c-4c1c-b76f-e6e137f7688d service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.532842 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0a062-bf4c-4c1c-b76f-e6e137f7688d service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.533139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0a062-bf4c-4c1c-b76f-e6e137f7688d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.540271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4194b77-936e-42d1-af9d-59b4ceb69fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.540943 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4194b77-936e-42d1-af9d-59b4ceb69fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.541242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4194b77-936e-42d1-af9d-59b4ceb69fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.541513 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4194b77-936e-42d1-af9d-59b4ceb69fd5 admin admin] PATH_INFO: `/v3/projects/75d1835470234029ad7b6f527ec0939c/users/62f885531eb94f0dab1cf0aadd309a3f/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.556877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4194b77-936e-42d1-af9d-59b4ceb69fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d1835470234029ad7b6f527ec0939c, user_id=62f885531eb94f0dab1cf0aadd309a3f, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.560307 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4194b77-936e-42d1-af9d-59b4ceb69fd5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.573878 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 814/1595] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:31 2022] PUT /identity/v3/projects/75d1835470234029ad7b6f527ec0939c/users/62f885531eb94f0dab1cf0aadd309a3f/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:31.575240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4194b77-936e-42d1-af9d-59b4ceb69fd5 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.599803 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:31.612815 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0a062-bf4c-4c1c-b76f-e6e137f7688d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.614292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0a062-bf4c-4c1c-b76f-e6e137f7688d service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.624424 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 782/1596] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:31.625248 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0a062-bf4c-4c1c-b76f-e6e137f7688d service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.634074 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0a062-bf4c-4c1c-b76f-e6e137f7688d service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.653284 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4194b77-936e-42d1-af9d-59b4ceb69fd5 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.658171 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae147bc-c83b-4baa-b102-d02da6106103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.658787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae147bc-c83b-4baa-b102-d02da6106103 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.659068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae147bc-c83b-4baa-b102-d02da6106103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.659348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae147bc-c83b-4baa-b102-d02da6106103 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.659992 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae147bc-c83b-4baa-b102-d02da6106103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.661794 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae147bc-c83b-4baa-b102-d02da6106103 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.674355 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 815/1597] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:31.675250 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae147bc-c83b-4baa-b102-d02da6106103 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.685949 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae147bc-c83b-4baa-b102-d02da6106103 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.693943 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16992491-e9fb-4554-843a-a4c87ffc4313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.695130 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16992491-e9fb-4554-843a-a4c87ffc4313 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.695619 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16992491-e9fb-4554-843a-a4c87ffc4313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.696103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16992491-e9fb-4554-843a-a4c87ffc4313 admin admin] PATH_INFO: `/v3/projects/b0829ac0231d4396b7056b1adda89771/users/8f337b4fe77349349455227eeebe4c79/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.697665 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cd904-ea79-47e5-ae4a-c5905e8f705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.698270 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cd904-ea79-47e5-ae4a-c5905e8f705c admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.698596 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cd904-ea79-47e5-ae4a-c5905e8f705c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.698874 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cd904-ea79-47e5-ae4a-c5905e8f705c admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.699500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cd904-ea79-47e5-ae4a-c5905e8f705c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.701119 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cd904-ea79-47e5-ae4a-c5905e8f705c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.711779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 783/1598] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:31.712783 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cd904-ea79-47e5-ae4a-c5905e8f705c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.719230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16992491-e9fb-4554-843a-a4c87ffc4313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0829ac0231d4396b7056b1adda89771, user_id=8f337b4fe77349349455227eeebe4c79, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.724771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16992491-e9fb-4554-843a-a4c87ffc4313 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.726516 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cd904-ea79-47e5-ae4a-c5905e8f705c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.732530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa2e2e-0835-4733-88f3-8781744e8863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.733600 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa2e2e-0835-4733-88f3-8781744e8863 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.733882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa2e2e-0835-4733-88f3-8781744e8863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.734151 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa2e2e-0835-4733-88f3-8781744e8863 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.734902 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa2e2e-0835-4733-88f3-8781744e8863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.737077 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa2e2e-0835-4733-88f3-8781744e8863 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.741014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 816/1599] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:31 2022] PUT /identity/v3/projects/b0829ac0231d4396b7056b1adda89771/users/8f337b4fe77349349455227eeebe4c79/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:31.741745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16992491-e9fb-4554-843a-a4c87ffc4313 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.749745 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 784/1600] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:31.751399 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f659aa-7eb6-4fa0-a47b-fa7a2227a867 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.751671 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f659aa-7eb6-4fa0-a47b-fa7a2227a867 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.751946 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f659aa-7eb6-4fa0-a47b-fa7a2227a867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.781741 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-24f659aa-7eb6-4fa0-a47b-fa7a2227a867 None None] MFA Rules not processed for user `98182d9d32224bc0a85306757822e8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:31.782947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-24f659aa-7eb6-4fa0-a47b-fa7a2227a867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:31.808608 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16992491-e9fb-4554-843a-a4c87ffc4313 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.814035 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231a012-4386-4176-a1a1-7971b38a329a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.814648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231a012-4386-4176-a1a1-7971b38a329a admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.815082 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231a012-4386-4176-a1a1-7971b38a329a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.815416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231a012-4386-4176-a1a1-7971b38a329a admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.816000 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231a012-4386-4176-a1a1-7971b38a329a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.817842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231a012-4386-4176-a1a1-7971b38a329a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.841455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 817/1601] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:31.841455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502b449-c8a7-4688-8437-1d23a5db0a82 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.841455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502b449-c8a7-4688-8437-1d23a5db0a82 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.842200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502b449-c8a7-4688-8437-1d23a5db0a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.862564 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 785/1602] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:31.867600 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f659aa-7eb6-4fa0-a47b-fa7a2227a867 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.875032 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2502b449-c8a7-4688-8437-1d23a5db0a82 None None] MFA Rules not processed for user `62f885531eb94f0dab1cf0aadd309a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:31.876306 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2502b449-c8a7-4688-8437-1d23a5db0a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:31.879396 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f659aa-7eb6-4fa0-a47b-fa7a2227a867 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.884699 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223abcc-c5d3-4637-8f02-3038a57fc149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:31.885586 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223abcc-c5d3-4637-8f02-3038a57fc149 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:31.885951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223abcc-c5d3-4637-8f02-3038a57fc149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:31.886309 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223abcc-c5d3-4637-8f02-3038a57fc149 admin admin] PATH_INFO: `/v3/projects/87e5d4ff07144668b67506c0639887a2/users/6c8719f0b3cc4cfeb8b2bfb8b2d34173/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:31.896675 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:31.908013 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223abcc-c5d3-4637-8f02-3038a57fc149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e5d4ff07144668b67506c0639887a2, user_id=6c8719f0b3cc4cfeb8b2bfb8b2d34173, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:31.911465 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223abcc-c5d3-4637-8f02-3038a57fc149 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:31.934661 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 786/1603] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:31 2022] PUT /identity/v3/projects/87e5d4ff07144668b67506c0639887a2/users/6c8719f0b3cc4cfeb8b2bfb8b2d34173/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:31.936184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223abcc-c5d3-4637-8f02-3038a57fc149 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.974586 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 818/1604] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:31.974586 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502b449-c8a7-4688-8437-1d23a5db0a82 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:31.984850 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502b449-c8a7-4688-8437-1d23a5db0a82 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:31.996792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:32.033523 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223abcc-c5d3-4637-8f02-3038a57fc149 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:32.039078 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4305f0-6b7c-4d3d-8005-7a06e0866dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:32.039957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4305f0-6b7c-4d3d-8005-7a06e0866dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:32.040406 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4305f0-6b7c-4d3d-8005-7a06e0866dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:32.040784 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4305f0-6b7c-4d3d-8005-7a06e0866dfe admin admin] PATH_INFO: `/v3/projects/ed7c07e243104274ac81dad3927c69c6/users/62504645dd0e4cabb967d39cf5c31cbc/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:32.060022 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4305f0-6b7c-4d3d-8005-7a06e0866dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed7c07e243104274ac81dad3927c69c6, user_id=62504645dd0e4cabb967d39cf5c31cbc, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:32.064265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4305f0-6b7c-4d3d-8005-7a06e0866dfe admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:32.065995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763b816-c469-4d38-bdb8-6a0efff14441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:32.067331 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763b816-c469-4d38-bdb8-6a0efff14441 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:32.067699 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763b816-c469-4d38-bdb8-6a0efff14441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:32.068222 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763b816-c469-4d38-bdb8-6a0efff14441 admin admin] PATH_INFO: `/v3/projects/b9343ee5d6cd4c88aa30984ddbf913bd/users/0850f890043a4d67b56db1f3a81889b0/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:32.093168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 787/1605] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:31 2022] PUT /identity/v3/projects/ed7c07e243104274ac81dad3927c69c6/users/62504645dd0e4cabb967d39cf5c31cbc/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:32.094951 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763b816-c469-4d38-bdb8-6a0efff14441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9343ee5d6cd4c88aa30984ddbf913bd, user_id=0850f890043a4d67b56db1f3a81889b0, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:32.095444 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b31b39-0615-4447-8409-e8a6f457ac02 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:32.095444 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b31b39-0615-4447-8409-e8a6f457ac02 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:32.095444 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b31b39-0615-4447-8409-e8a6f457ac02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:32.095699 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763b816-c469-4d38-bdb8-6a0efff14441 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:32.111854 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 819/1606] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:31 2022] PUT /identity/v3/projects/b9343ee5d6cd4c88aa30984ddbf913bd/users/0850f890043a4d67b56db1f3a81889b0/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:32.113235 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763b816-c469-4d38-bdb8-6a0efff14441 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:32.124719 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-74b31b39-0615-4447-8409-e8a6f457ac02 None None] MFA Rules not processed for user `8f337b4fe77349349455227eeebe4c79`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:32.126158 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-74b31b39-0615-4447-8409-e8a6f457ac02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:32.191056 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763b816-c469-4d38-bdb8-6a0efff14441 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:32.195956 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083c7b7-8fdc-4f5b-b624-42a47e82fdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:32.196732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083c7b7-8fdc-4f5b-b624-42a47e82fdfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:32.197128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083c7b7-8fdc-4f5b-b624-42a47e82fdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:32.197573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083c7b7-8fdc-4f5b-b624-42a47e82fdfa admin admin] PATH_INFO: `/v3/projects/78acf048669441758aba2dce0b2658b4/users/908a6895d6e94b04961621b339ebda17/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:32.200816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 788/1607] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:32.202403 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a941ba3-07ab-4dab-b2b5-627123c08dd0 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:32.202626 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a941ba3-07ab-4dab-b2b5-627123c08dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:32.203007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a941ba3-07ab-4dab-b2b5-627123c08dd0 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:32.204604 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 789/1608] 10.222.0.52 () {54 vars in 962 bytes} [Thu Sep 15 00:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:44:32.205713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0822bda-70e4-4265-a78f-07eeee3bf224 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:32.206053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0822bda-70e4-4265-a78f-07eeee3bf224 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:32.206377 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0822bda-70e4-4265-a78f-07eeee3bf224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:32.219844 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083c7b7-8fdc-4f5b-b624-42a47e82fdfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=78acf048669441758aba2dce0b2658b4, user_id=908a6895d6e94b04961621b339ebda17, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:32.223014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083c7b7-8fdc-4f5b-b624-42a47e82fdfa admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:32.227406 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b0822bda-70e4-4265-a78f-07eeee3bf224 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:32.228637 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b0822bda-70e4-4265-a78f-07eeee3bf224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:32.236957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 790/1609] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:32.239248 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 820/1610] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:32 2022] PUT /identity/v3/projects/78acf048669441758aba2dce0b2658b4/users/908a6895d6e94b04961621b339ebda17/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:32.240777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eedc54-0a1e-4fca-b3cb-166c6d3d35eb None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:32.240942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eedc54-0a1e-4fca-b3cb-166c6d3d35eb None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:32.241240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eedc54-0a1e-4fca-b3cb-166c6d3d35eb None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:32.242495 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 791/1611] 10.222.0.52 () {54 vars in 962 bytes} [Thu Sep 15 00:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:44:32.243495 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aed2a8-6754-490a-b456-7ecb6b705edf None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:32.243772 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aed2a8-6754-490a-b456-7ecb6b705edf None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:32.244040 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aed2a8-6754-490a-b456-7ecb6b705edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:32.247977 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d4b25-15d4-446c-a70a-a670239a3ba5 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:32.248260 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d4b25-15d4-446c-a70a-a670239a3ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:32.248534 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d4b25-15d4-446c-a70a-a670239a3ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:32.279085 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-82aed2a8-6754-490a-b456-7ecb6b705edf None None] MFA Rules not processed for user `62504645dd0e4cabb967d39cf5c31cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:32.279621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b62d4b25-15d4-446c-a70a-a670239a3ba5 None None] MFA Rules not processed for user `0850f890043a4d67b56db1f3a81889b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:32.280395 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-82aed2a8-6754-490a-b456-7ecb6b705edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:32.280867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b62d4b25-15d4-446c-a70a-a670239a3ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:32.328151 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:32.361558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 821/1612] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:32 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:32.365526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 792/1613] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:32.365526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aed2a8-6754-490a-b456-7ecb6b705edf None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:32.367822 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133d9b0-cb64-4608-8c15-61898817a822 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:32.368124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133d9b0-cb64-4608-8c15-61898817a822 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:32.368403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133d9b0-cb64-4608-8c15-61898817a822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:32.388444 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:32.417533 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-a133d9b0-cb64-4608-8c15-61898817a822 None None] MFA Rules not processed for user `bfcfcf8061f24231858b9b0205a8abaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:32.418735 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a133d9b0-cb64-4608-8c15-61898817a822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:32.444316 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aed2a8-6754-490a-b456-7ecb6b705edf None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:32.451794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad02a7a-4e12-498e-b62f-f806d749ca8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:32.452965 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad02a7a-4e12-498e-b62f-f806d749ca8e admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:32.453575 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad02a7a-4e12-498e-b62f-f806d749ca8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:32.454144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad02a7a-4e12-498e-b62f-f806d749ca8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:32.454926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad02a7a-4e12-498e-b62f-f806d749ca8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:32.457301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad02a7a-4e12-498e-b62f-f806d749ca8e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:32.503546 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 822/1614] 10.222.0.52 () {58 vars in 1059 bytes} [Thu Sep 15 00:44:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:32.510000 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 793/1615] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:44:32 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:32.512051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43b84a-b8d4-424b-87be-87d05d19d73a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:32.512339 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43b84a-b8d4-424b-87be-87d05d19d73a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:32.512571 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133d9b0-cb64-4608-8c15-61898817a822 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:32.512696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43b84a-b8d4-424b-87be-87d05d19d73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:32.548347 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8d43b84a-b8d4-424b-87be-87d05d19d73a None None] MFA Rules not processed for user `908a6895d6e94b04961621b339ebda17`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:32.549646 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8d43b84a-b8d4-424b-87be-87d05d19d73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:32.575968 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133d9b0-cb64-4608-8c15-61898817a822 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:32.638193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 794/1616] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:32.639620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b620f0-ae44-47aa-a844-c17227a88007 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:32.639909 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b620f0-ae44-47aa-a844-c17227a88007 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:32.640183 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b620f0-ae44-47aa-a844-c17227a88007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:32.661034 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c615747-e742-4c26-9042-3dad30e62dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:32.662538 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c615747-e742-4c26-9042-3dad30e62dcf service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:32.662930 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c615747-e742-4c26-9042-3dad30e62dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:32.663272 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c615747-e742-4c26-9042-3dad30e62dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:32.669863 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-92b620f0-ae44-47aa-a844-c17227a88007 None None] MFA Rules not processed for user `bfcfcf8061f24231858b9b0205a8abaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:32.671359 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-92b620f0-ae44-47aa-a844-c17227a88007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:32.732460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:32.737478 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:32.737861 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c615747-e742-4c26-9042-3dad30e62dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:32.742086 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c615747-e742-4c26-9042-3dad30e62dcf service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:32.758214 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 795/1617] 10.222.0.52 () {58 vars in 1059 bytes} [Thu Sep 15 00:44:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:32.759191 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b620f0-ae44-47aa-a844-c17227a88007 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:32.769193 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 823/1618] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:32.770033 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c615747-e742-4c26-9042-3dad30e62dcf service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:32.770932 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b620f0-ae44-47aa-a844-c17227a88007 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:32.776348 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc9c2c-7000-4ba2-b887-78fe73127115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:32.777236 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc9c2c-7000-4ba2-b887-78fe73127115 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:32.777613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc9c2c-7000-4ba2-b887-78fe73127115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:32.778058 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc9c2c-7000-4ba2-b887-78fe73127115 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:32.778991 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc9c2c-7000-4ba2-b887-78fe73127115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:32.780438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c615747-e742-4c26-9042-3dad30e62dcf service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:32.781318 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc9c2c-7000-4ba2-b887-78fe73127115 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:32.785952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb7ad3-0d2c-48b3-b399-bf1467d7fc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:32.786675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb7ad3-0d2c-48b3-b399-bf1467d7fc9a admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:32.787155 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb7ad3-0d2c-48b3-b399-bf1467d7fc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:32.787278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb7ad3-0d2c-48b3-b399-bf1467d7fc9a admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:32.787896 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb7ad3-0d2c-48b3-b399-bf1467d7fc9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:32.789952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb7ad3-0d2c-48b3-b399-bf1467d7fc9a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:32.816553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 824/1619] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:44:32 2022] POST /identity/v3/users => generated 292 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:32.818141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 796/1620] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:44:32 2022] POST /identity/v3/projects => generated 405 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:32.819252 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc9c2c-7000-4ba2-b887-78fe73127115 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:32.819857 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb7ad3-0d2c-48b3-b399-bf1467d7fc9a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:32.836652 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb7ad3-0d2c-48b3-b399-bf1467d7fc9a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:32.905309 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc9c2c-7000-4ba2-b887-78fe73127115 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:32.912737 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1854e5-9c88-4ae1-9414-47d5d78cdadd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:32.914073 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1854e5-9c88-4ae1-9414-47d5d78cdadd service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:32.914631 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1854e5-9c88-4ae1-9414-47d5d78cdadd service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:32.915135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1854e5-9c88-4ae1-9414-47d5d78cdadd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:32.918269 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce09a0c-b95d-441f-a86b-2492afcb4356 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:32.919435 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce09a0c-b95d-441f-a86b-2492afcb4356 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:32.919865 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce09a0c-b95d-441f-a86b-2492afcb4356 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:32.920280 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce09a0c-b95d-441f-a86b-2492afcb4356 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:33.003251 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce09a0c-b95d-441f-a86b-2492afcb4356 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:33.005266 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce09a0c-b95d-441f-a86b-2492afcb4356 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:33.017120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 825/1621] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:33.018343 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1854e5-9c88-4ae1-9414-47d5d78cdadd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:33.018532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce09a0c-b95d-441f-a86b-2492afcb4356 service nova] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:33.022009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1854e5-9c88-4ae1-9414-47d5d78cdadd service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:33.034319 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce09a0c-b95d-441f-a86b-2492afcb4356 service nova] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:33.038040 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 797/1622] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:33.039436 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1854e5-9c88-4ae1-9414-47d5d78cdadd service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:33.041121 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a704f32-37d7-45a1-9dc8-314c365371b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:33.042745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a704f32-37d7-45a1-9dc8-314c365371b1 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:33.043188 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a704f32-37d7-45a1-9dc8-314c365371b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:33.043769 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a704f32-37d7-45a1-9dc8-314c365371b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:33.115962 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a704f32-37d7-45a1-9dc8-314c365371b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:33.118064 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a704f32-37d7-45a1-9dc8-314c365371b1 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:33.151781 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 826/1623] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:33.155773 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a704f32-37d7-45a1-9dc8-314c365371b1 service nova] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:33.169375 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1854e5-9c88-4ae1-9414-47d5d78cdadd service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:33.176599 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a704f32-37d7-45a1-9dc8-314c365371b1 service nova] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:33.191099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e196248-2aaf-4926-aa23-d09b99becdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:33.192737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e196248-2aaf-4926-aa23-d09b99becdbc admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:33.193993 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e196248-2aaf-4926-aa23-d09b99becdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:33.194349 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e196248-2aaf-4926-aa23-d09b99becdbc admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:33.195613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2034c55-eba9-472d-af53-388e28230594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:33.196338 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e196248-2aaf-4926-aa23-d09b99becdbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:33.198167 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2034c55-eba9-472d-af53-388e28230594 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:33.198670 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2034c55-eba9-472d-af53-388e28230594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:33.199573 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2034c55-eba9-472d-af53-388e28230594 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:33.200384 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2034c55-eba9-472d-af53-388e28230594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:33.201597 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e196248-2aaf-4926-aa23-d09b99becdbc admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:33.203750 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2034c55-eba9-472d-af53-388e28230594 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:33.219834 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 798/1624] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:33.224254 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:33.225718 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2034c55-eba9-472d-af53-388e28230594 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:33.246298 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2034c55-eba9-472d-af53-388e28230594 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:33.250941 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 827/1625] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:44:33 2022] POST /identity/v3/users => generated 309 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:33.251911 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e196248-2aaf-4926-aa23-d09b99becdbc admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:33.262974 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e196248-2aaf-4926-aa23-d09b99becdbc admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:33.268717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0998ea-c8b3-4dda-8d1d-d35dd22e6742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:33.269768 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0998ea-c8b3-4dda-8d1d-d35dd22e6742 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:33.270143 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0998ea-c8b3-4dda-8d1d-d35dd22e6742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:33.270553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0998ea-c8b3-4dda-8d1d-d35dd22e6742 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:33.271430 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0998ea-c8b3-4dda-8d1d-d35dd22e6742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:33.271889 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a4974-a847-4391-b8b0-6e06233d181a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:33.275453 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0998ea-c8b3-4dda-8d1d-d35dd22e6742 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:33.275660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a4974-a847-4391-b8b0-6e06233d181a admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:33.276533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a4974-a847-4391-b8b0-6e06233d181a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:33.277505 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a4974-a847-4391-b8b0-6e06233d181a admin admin] PATH_INFO: `/v3/projects/36c3ced678ce428da972c59cd993365d/users/2b1ea15527194d5f990eae5ec93204e6/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:33.291809 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 828/1626] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 00:44:33.299036 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0998ea-c8b3-4dda-8d1d-d35dd22e6742 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:33.316691 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a4974-a847-4391-b8b0-6e06233d181a admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c3ced678ce428da972c59cd993365d, user_id=2b1ea15527194d5f990eae5ec93204e6, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:33.318355 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0998ea-c8b3-4dda-8d1d-d35dd22e6742 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:33.325137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a4974-a847-4391-b8b0-6e06233d181a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:33.330421 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:33.335143 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4c3ee-8209-4cf3-a0b3-2f8973ba6134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:33.336004 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4c3ee-8209-4cf3-a0b3-2f8973ba6134 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:33.336652 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4c3ee-8209-4cf3-a0b3-2f8973ba6134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:33.337069 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4c3ee-8209-4cf3-a0b3-2f8973ba6134 admin admin] PATH_INFO: `/v3/projects/26693beaa1e74c929f718275018b685d/users/0d569a32cf08433b8b942e73c981f07e/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:33.362325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 799/1627] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:33 2022] PUT /identity/v3/projects/36c3ced678ce428da972c59cd993365d/users/2b1ea15527194d5f990eae5ec93204e6/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:33.366364 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a4974-a847-4391-b8b0-6e06233d181a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:33.390633 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4c3ee-8209-4cf3-a0b3-2f8973ba6134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26693beaa1e74c929f718275018b685d, user_id=0d569a32cf08433b8b942e73c981f07e, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:33.395113 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4c3ee-8209-4cf3-a0b3-2f8973ba6134 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:33.425664 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 829/1628] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:33 2022] PUT /identity/v3/projects/26693beaa1e74c929f718275018b685d/users/0d569a32cf08433b8b942e73c981f07e/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:33.433115 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4c3ee-8209-4cf3-a0b3-2f8973ba6134 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:33.531966 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a4974-a847-4391-b8b0-6e06233d181a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:33.610884 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4c3ee-8209-4cf3-a0b3-2f8973ba6134 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:33.636841 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7f03d-fb42-4782-a708-7c95d16f6478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:33.637675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7f03d-fb42-4782-a708-7c95d16f6478 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:33.638063 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7f03d-fb42-4782-a708-7c95d16f6478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:33.638424 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7f03d-fb42-4782-a708-7c95d16f6478 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:33.639204 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7f03d-fb42-4782-a708-7c95d16f6478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:33.642214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7f03d-fb42-4782-a708-7c95d16f6478 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:33.677975 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 830/1629] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:33.679805 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199ec04-3507-4988-ba63-b6d165d812d6 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:33.680225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199ec04-3507-4988-ba63-b6d165d812d6 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:33.680956 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199ec04-3507-4988-ba63-b6d165d812d6 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:33.685440 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 831/1630] 10.222.0.52 () {54 vars in 912 bytes} [Thu Sep 15 00:44:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:44:33.687602 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7f717-77fb-4583-b024-e59f1f067a04 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:33.688021 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7f717-77fb-4583-b024-e59f1f067a04 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:33.688364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7f717-77fb-4583-b024-e59f1f067a04 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:33.689925 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 832/1631] 10.222.0.52 () {54 vars in 912 bytes} [Thu Sep 15 00:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:44:33.695788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7f717-77fb-4583-b024-e59f1f067a04 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:33.710663 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1494d79-5b09-4ad6-a17d-392a1be8fe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:33.711508 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1494d79-5b09-4ad6-a17d-392a1be8fe11 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:33.711860 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1494d79-5b09-4ad6-a17d-392a1be8fe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:33.712229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1494d79-5b09-4ad6-a17d-392a1be8fe11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:33.712622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7f717-77fb-4583-b024-e59f1f067a04 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:33.713191 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1494d79-5b09-4ad6-a17d-392a1be8fe11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:33.715851 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1494d79-5b09-4ad6-a17d-392a1be8fe11 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:33.723838 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1e0a8-f406-43ba-9c07-73c9f7c1cd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:33.725822 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1e0a8-f406-43ba-9c07-73c9f7c1cd50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:33.726397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1e0a8-f406-43ba-9c07-73c9f7c1cd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:33.727031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1e0a8-f406-43ba-9c07-73c9f7c1cd50 admin admin] PATH_INFO: `/v3/projects/26693beaa1e74c929f718275018b685d/users/0d569a32cf08433b8b942e73c981f07e/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:33.728937 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1e0a8-f406-43ba-9c07-73c9f7c1cd50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26693beaa1e74c929f718275018b685d, user_id=0d569a32cf08433b8b942e73c981f07e, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:33.733059 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1e0a8-f406-43ba-9c07-73c9f7c1cd50 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:33.738742 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 800/1632] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:33.740157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c3716-61d9-4b93-9c6b-ee7924cebb69 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:33.740631 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c3716-61d9-4b93-9c6b-ee7924cebb69 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:33.740965 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c3716-61d9-4b93-9c6b-ee7924cebb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:33.752449 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 833/1633] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:33 2022] PUT /identity/v3/projects/26693beaa1e74c929f718275018b685d/users/0d569a32cf08433b8b942e73c981f07e/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:33.761617 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f4709-dbd7-40ad-a8c9-84cad5e3cb96 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:33.761617 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f4709-dbd7-40ad-a8c9-84cad5e3cb96 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:33.761617 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f4709-dbd7-40ad-a8c9-84cad5e3cb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:33.765022 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f96c3716-61d9-4b93-9c6b-ee7924cebb69 None None] MFA Rules not processed for user `bfcfcf8061f24231858b9b0205a8abaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:33.766602 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f96c3716-61d9-4b93-9c6b-ee7924cebb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:33.787452 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2c7f4709-dbd7-40ad-a8c9-84cad5e3cb96 None None] MFA Rules not processed for user `bfcfcf8061f24231858b9b0205a8abaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:33.792021 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2c7f4709-dbd7-40ad-a8c9-84cad5e3cb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:33.928534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 801/1634] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 15 00:44:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:33.941970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c3716-61d9-4b93-9c6b-ee7924cebb69 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:34.032092 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 834/1635] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 15 00:44:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:34.032092 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cae2f-f80e-4ec6-bf3a-c841f88e8b75 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:34.032092 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cae2f-f80e-4ec6-bf3a-c841f88e8b75 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:34.032092 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cae2f-f80e-4ec6-bf3a-c841f88e8b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:34.042334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:34.082350 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-0b5cae2f-f80e-4ec6-bf3a-c841f88e8b75 None None] MFA Rules not processed for user `0d569a32cf08433b8b942e73c981f07e`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:34.083747 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0b5cae2f-f80e-4ec6-bf3a-c841f88e8b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:34.115213 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:34.137052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c3716-61d9-4b93-9c6b-ee7924cebb69 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:34.143665 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e816b5a-b70a-4a77-8ebe-a06f4e5daf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:34.144574 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e816b5a-b70a-4a77-8ebe-a06f4e5daf7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:34.144935 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e816b5a-b70a-4a77-8ebe-a06f4e5daf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:34.145347 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e816b5a-b70a-4a77-8ebe-a06f4e5daf7f admin admin] PATH_INFO: `/v3/projects/36c3ced678ce428da972c59cd993365d/users/2b1ea15527194d5f990eae5ec93204e6/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:34.147706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e816b5a-b70a-4a77-8ebe-a06f4e5daf7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c3ced678ce428da972c59cd993365d, user_id=2b1ea15527194d5f990eae5ec93204e6, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:34.151777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e816b5a-b70a-4a77-8ebe-a06f4e5daf7f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:34.173669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 802/1636] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:33 2022] PUT /identity/v3/projects/36c3ced678ce428da972c59cd993365d/users/2b1ea15527194d5f990eae5ec93204e6/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:34.175581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e816b5a-b70a-4a77-8ebe-a06f4e5daf7f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:34.214396 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 835/1637] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:34 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:34.219644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cae2f-f80e-4ec6-bf3a-c841f88e8b75 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:34.265688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e816b5a-b70a-4a77-8ebe-a06f4e5daf7f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:34.283688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdd323-123b-40b0-b0e7-4f3cd366edf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:34.285030 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdd323-123b-40b0-b0e7-4f3cd366edf1 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:34.285659 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdd323-123b-40b0-b0e7-4f3cd366edf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:34.286299 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdd323-123b-40b0-b0e7-4f3cd366edf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:34.326823 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cae2f-f80e-4ec6-bf3a-c841f88e8b75 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:34.330754 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e69344-1b03-4053-8e9e-07102ed4e5e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:34.331373 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e69344-1b03-4053-8e9e-07102ed4e5e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:34.331699 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e69344-1b03-4053-8e9e-07102ed4e5e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:34.331975 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e69344-1b03-4053-8e9e-07102ed4e5e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:34.442103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e69344-1b03-4053-8e9e-07102ed4e5e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:34.444874 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e69344-1b03-4053-8e9e-07102ed4e5e0 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:34.446049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdd323-123b-40b0-b0e7-4f3cd366edf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:34.447973 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdd323-123b-40b0-b0e7-4f3cd366edf1 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:34.464432 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 836/1638] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:34.465264 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6ef9f-8ea0-4390-adc6-50dadd34452a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:34.465598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6ef9f-8ea0-4390-adc6-50dadd34452a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:34.465942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6ef9f-8ea0-4390-adc6-50dadd34452a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:34.470400 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 803/1639] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:34.510814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f7b6ef9f-8ea0-4390-adc6-50dadd34452a None None] MFA Rules not processed for user `2b1ea15527194d5f990eae5ec93204e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:34.512242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f7b6ef9f-8ea0-4390-adc6-50dadd34452a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:34.590215 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:34.631856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 837/1640] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:34.953754 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdd323-123b-40b0-b0e7-4f3cd366edf1 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:34.962667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdd323-123b-40b0-b0e7-4f3cd366edf1 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:34.976734 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db3e3b-5342-4ed0-a719-1506c5e8ec5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:34.977510 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db3e3b-5342-4ed0-a719-1506c5e8ec5a service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:34.977859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db3e3b-5342-4ed0-a719-1506c5e8ec5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:34.978200 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db3e3b-5342-4ed0-a719-1506c5e8ec5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:35.060530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db3e3b-5342-4ed0-a719-1506c5e8ec5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:35.062198 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db3e3b-5342-4ed0-a719-1506c5e8ec5a service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:35.067833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:35.075227 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 804/1641] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:34 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:35.213332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6ef9f-8ea0-4390-adc6-50dadd34452a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:35.230480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6ef9f-8ea0-4390-adc6-50dadd34452a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:35.244340 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff2900-c7f8-4efb-a6da-33da4902cebe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:35.245694 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff2900-c7f8-4efb-a6da-33da4902cebe service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:35.246044 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff2900-c7f8-4efb-a6da-33da4902cebe service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:35.246424 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff2900-c7f8-4efb-a6da-33da4902cebe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:35.274122 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff2900-c7f8-4efb-a6da-33da4902cebe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:35.275909 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff2900-c7f8-4efb-a6da-33da4902cebe service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:35.299690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 838/1642] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:44:35.333206 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db3e3b-5342-4ed0-a719-1506c5e8ec5a service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:35.354866 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db3e3b-5342-4ed0-a719-1506c5e8ec5a service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:35.367357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070f94b-11b7-4f29-aca8-44421849eb0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:35.368000 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070f94b-11b7-4f29-aca8-44421849eb0f service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:35.368276 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070f94b-11b7-4f29-aca8-44421849eb0f service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:35.368552 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070f94b-11b7-4f29-aca8-44421849eb0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:35.510342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070f94b-11b7-4f29-aca8-44421849eb0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:35.512586 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070f94b-11b7-4f29-aca8-44421849eb0f service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:35.526976 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 805/1643] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:35.587451 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff2900-c7f8-4efb-a6da-33da4902cebe service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:35.598318 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff2900-c7f8-4efb-a6da-33da4902cebe service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:35.603404 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b158552-c8ec-4784-8ca3-3325ddb43248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:35.605120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b158552-c8ec-4784-8ca3-3325ddb43248 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:35.605627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b158552-c8ec-4784-8ca3-3325ddb43248 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:35.606129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b158552-c8ec-4784-8ca3-3325ddb43248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:35.679399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b158552-c8ec-4784-8ca3-3325ddb43248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:35.681266 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b158552-c8ec-4784-8ca3-3325ddb43248 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:35.705681 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 839/1644] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:36.162357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070f94b-11b7-4f29-aca8-44421849eb0f service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:36.391248 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070f94b-11b7-4f29-aca8-44421849eb0f service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:36.415617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603b8ae-efdd-4d39-be3d-97f3d094e352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:36.416521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603b8ae-efdd-4d39-be3d-97f3d094e352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:36.416833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603b8ae-efdd-4d39-be3d-97f3d094e352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:36.417136 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603b8ae-efdd-4d39-be3d-97f3d094e352 admin admin] PATH_INFO: `/v3/users/0850f890043a4d67b56db1f3a81889b0` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:36.421741 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603b8ae-efdd-4d39-be3d-97f3d094e352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0850f890043a4d67b56db1f3a81889b0)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:36.423739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603b8ae-efdd-4d39-be3d-97f3d094e352 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:36.562225 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4603b8ae-efdd-4d39-be3d-97f3d094e352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0850f890043a4d67b56db1f3a81889b0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:36.581294 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4603b8ae-efdd-4d39-be3d-97f3d094e352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0850f890043a4d67b56db1f3a81889b0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:36.582172 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4603b8ae-efdd-4d39-be3d-97f3d094e352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0850f890043a4d67b56db1f3a81889b0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:36.583350 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4603b8ae-efdd-4d39-be3d-97f3d094e352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0850f890043a4d67b56db1f3a81889b0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:36.597811 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-4603b8ae-efdd-4d39-be3d-97f3d094e352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0850f890043a4d67b56db1f3a81889b0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:36.650274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 806/1645] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:44:36 2022] DELETE /identity/v3/users/0850f890043a4d67b56db1f3a81889b0 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:36.655349 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2527b24-3de8-4cd3-92ff-0d58853d62f0 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:36.656148 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2527b24-3de8-4cd3-92ff-0d58853d62f0 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:36.656712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2527b24-3de8-4cd3-92ff-0d58853d62f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:36.700122 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b2527b24-3de8-4cd3-92ff-0d58853d62f0 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:36.703710 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b2527b24-3de8-4cd3-92ff-0d58853d62f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:36.948296 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 840/1646] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:36.992237 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603b8ae-efdd-4d39-be3d-97f3d094e352 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:36.994066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4603b8ae-efdd-4d39-be3d-97f3d094e352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:37.027946 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:37.155660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603b8ae-efdd-4d39-be3d-97f3d094e352 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:37.176346 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529659fc-3cce-4e9d-b9b3-30fed0229f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:37.177022 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529659fc-3cce-4e9d-b9b3-30fed0229f40 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:37.177357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529659fc-3cce-4e9d-b9b3-30fed0229f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:37.177679 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529659fc-3cce-4e9d-b9b3-30fed0229f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:37.211578 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529659fc-3cce-4e9d-b9b3-30fed0229f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:37.213543 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529659fc-3cce-4e9d-b9b3-30fed0229f40 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:37.243983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 807/1647] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:37.260106 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2527b24-3de8-4cd3-92ff-0d58853d62f0 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:37.261763 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b2527b24-3de8-4cd3-92ff-0d58853d62f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:37.286444 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2527b24-3de8-4cd3-92ff-0d58853d62f0 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:37.309526 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193c6cf-81b7-4b17-8804-05a62d1096b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:37.310607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193c6cf-81b7-4b17-8804-05a62d1096b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:37.312481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193c6cf-81b7-4b17-8804-05a62d1096b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:37.314200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193c6cf-81b7-4b17-8804-05a62d1096b5 admin admin] PATH_INFO: `/v3/users/62504645dd0e4cabb967d39cf5c31cbc` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:37.319380 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193c6cf-81b7-4b17-8804-05a62d1096b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62504645dd0e4cabb967d39cf5c31cbc)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:37.323027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: WARNING py.warnings [None req-a193c6cf-81b7-4b17-8804-05a62d1096b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 00:44:37.323027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: warnings.warn(msg) Sep 15 00:44:37.323027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: Sep 15 00:44:37.331917 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193c6cf-81b7-4b17-8804-05a62d1096b5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:37.532821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a193c6cf-81b7-4b17-8804-05a62d1096b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62504645dd0e4cabb967d39cf5c31cbc'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:37.564818 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a193c6cf-81b7-4b17-8804-05a62d1096b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62504645dd0e4cabb967d39cf5c31cbc'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:37.566100 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a193c6cf-81b7-4b17-8804-05a62d1096b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62504645dd0e4cabb967d39cf5c31cbc'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:37.566817 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a193c6cf-81b7-4b17-8804-05a62d1096b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62504645dd0e4cabb967d39cf5c31cbc'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:37.590916 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a193c6cf-81b7-4b17-8804-05a62d1096b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62504645dd0e4cabb967d39cf5c31cbc'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:37.596814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:37.632764 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 841/1648] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:44:37 2022] DELETE /identity/v3/users/62504645dd0e4cabb967d39cf5c31cbc => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:37.634796 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb4bab-a60b-4008-bfc7-1fd569064fa6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:37.635240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb4bab-a60b-4008-bfc7-1fd569064fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:37.636222 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb4bab-a60b-4008-bfc7-1fd569064fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:37.678390 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-93eb4bab-a60b-4008-bfc7-1fd569064fa6 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:37.683507 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-93eb4bab-a60b-4008-bfc7-1fd569064fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:37.817035 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 808/1649] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:37.838098 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193c6cf-81b7-4b17-8804-05a62d1096b5 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:37.842059 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a193c6cf-81b7-4b17-8804-05a62d1096b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:37.946881 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193c6cf-81b7-4b17-8804-05a62d1096b5 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:37.955907 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497526cf-3a14-4905-bf84-26d20d67e88f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:37.958114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497526cf-3a14-4905-bf84-26d20d67e88f service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:37.958114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497526cf-3a14-4905-bf84-26d20d67e88f service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:37.958114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497526cf-3a14-4905-bf84-26d20d67e88f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:37.972093 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497526cf-3a14-4905-bf84-26d20d67e88f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:37.973996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497526cf-3a14-4905-bf84-26d20d67e88f service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:37.992594 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 842/1650] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:38.645489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb4bab-a60b-4008-bfc7-1fd569064fa6 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:38.647152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-93eb4bab-a60b-4008-bfc7-1fd569064fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:38.677757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb4bab-a60b-4008-bfc7-1fd569064fa6 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:38.708537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a6278-8d1c-40f4-94d8-c474711cc0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:38.711496 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a6278-8d1c-40f4-94d8-c474711cc0fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:38.712405 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a6278-8d1c-40f4-94d8-c474711cc0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:38.713408 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a6278-8d1c-40f4-94d8-c474711cc0fc admin admin] PATH_INFO: `/v3/projects/b9343ee5d6cd4c88aa30984ddbf913bd` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:38.717009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a6278-8d1c-40f4-94d8-c474711cc0fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9343ee5d6cd4c88aa30984ddbf913bd)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:38.723676 dv-cinder-857528-2-smb devstack@keystone.service[81615]: WARNING py.warnings [None req-735a6278-8d1c-40f4-94d8-c474711cc0fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 00:44:38.723676 dv-cinder-857528-2-smb devstack@keystone.service[81615]: warnings.warn(msg) Sep 15 00:44:38.723676 dv-cinder-857528-2-smb devstack@keystone.service[81615]: Sep 15 00:44:38.727006 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a6278-8d1c-40f4-94d8-c474711cc0fc admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:38.756441 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497526cf-3a14-4905-bf84-26d20d67e88f service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:38.760796 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-497526cf-3a14-4905-bf84-26d20d67e88f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:38.832123 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497526cf-3a14-4905-bf84-26d20d67e88f service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:38.895556 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbeec9-0854-4300-90de-e4962e5cc0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:38.898851 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbeec9-0854-4300-90de-e4962e5cc0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:38.900275 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbeec9-0854-4300-90de-e4962e5cc0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:38.902231 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbeec9-0854-4300-90de-e4962e5cc0d3 admin admin] PATH_INFO: `/v3/users/98182d9d32224bc0a85306757822e8d6` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:38.907212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbeec9-0854-4300-90de-e4962e5cc0d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98182d9d32224bc0a85306757822e8d6)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:38.911220 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbeec9-0854-4300-90de-e4962e5cc0d3 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:39.041030 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f1dbeec9-0854-4300-90de-e4962e5cc0d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98182d9d32224bc0a85306757822e8d6'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:39.061116 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f1dbeec9-0854-4300-90de-e4962e5cc0d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98182d9d32224bc0a85306757822e8d6'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:39.061995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f1dbeec9-0854-4300-90de-e4962e5cc0d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98182d9d32224bc0a85306757822e8d6'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:39.062689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f1dbeec9-0854-4300-90de-e4962e5cc0d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98182d9d32224bc0a85306757822e8d6'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:39.074457 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f1dbeec9-0854-4300-90de-e4962e5cc0d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98182d9d32224bc0a85306757822e8d6'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:39.076725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-735a6278-8d1c-40f4-94d8-c474711cc0fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9343ee5d6cd4c88aa30984ddbf913bd', 'request_id': 'req-735a6278-8d1c-40f4-94d8-c474711cc0fc'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:39.110807 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-735a6278-8d1c-40f4-94d8-c474711cc0fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9343ee5d6cd4c88aa30984ddbf913bd', 'request_id': 'req-735a6278-8d1c-40f4-94d8-c474711cc0fc'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:39.113761 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 843/1651] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:44:38 2022] DELETE /identity/v3/users/98182d9d32224bc0a85306757822e8d6 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:39.118208 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24c9fc-175a-4a0b-9036-15fac253b23b None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:39.118647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24c9fc-175a-4a0b-9036-15fac253b23b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:39.118921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24c9fc-175a-4a0b-9036-15fac253b23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:39.163941 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-735a6278-8d1c-40f4-94d8-c474711cc0fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9343ee5d6cd4c88aa30984ddbf913bd', 'request_id': 'req-735a6278-8d1c-40f4-94d8-c474711cc0fc'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:39.176219 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-9c24c9fc-175a-4a0b-9036-15fac253b23b None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:39.179581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9c24c9fc-175a-4a0b-9036-15fac253b23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:39.258314 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-735a6278-8d1c-40f4-94d8-c474711cc0fc admin admin] The token cache is being invalidate because project b9343ee5d6cd4c88aa30984ddbf913bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:44:39.258739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-735a6278-8d1c-40f4-94d8-c474711cc0fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:39.263928 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-735a6278-8d1c-40f4-94d8-c474711cc0fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:39.268960 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 809/1652] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:44:38 2022] DELETE /identity/v3/projects/b9343ee5d6cd4c88aa30984ddbf913bd => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:39.274314 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a6278-8d1c-40f4-94d8-c474711cc0fc admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:39.279010 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-735a6278-8d1c-40f4-94d8-c474711cc0fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:39.325955 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:39.340056 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 844/1653] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:44:39.409772 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24c9fc-175a-4a0b-9036-15fac253b23b None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:39.416788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9c24c9fc-175a-4a0b-9036-15fac253b23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:39.512002 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:39.568575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24c9fc-175a-4a0b-9036-15fac253b23b None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:39.572664 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a61fd-1bb9-4758-9968-75dc7f1f10e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:39.574021 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a61fd-1bb9-4758-9968-75dc7f1f10e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:39.574407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a61fd-1bb9-4758-9968-75dc7f1f10e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:39.574813 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a61fd-1bb9-4758-9968-75dc7f1f10e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:39.581459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a6278-8d1c-40f4-94d8-c474711cc0fc admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:39.586284 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35db41-844e-409c-9996-381dfb259d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:39.587105 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35db41-844e-409c-9996-381dfb259d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:39.587390 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35db41-844e-409c-9996-381dfb259d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:39.587742 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35db41-844e-409c-9996-381dfb259d1a admin admin] PATH_INFO: `/v3/users/0d569a32cf08433b8b942e73c981f07e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:39.589307 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35db41-844e-409c-9996-381dfb259d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d569a32cf08433b8b942e73c981f07e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:39.592440 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35db41-844e-409c-9996-381dfb259d1a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:39.606595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a61fd-1bb9-4758-9968-75dc7f1f10e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:39.608166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a61fd-1bb9-4758-9968-75dc7f1f10e3 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:39.639012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 845/1654] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:39.688096 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bd35db41-844e-409c-9996-381dfb259d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d569a32cf08433b8b942e73c981f07e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:39.700524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bd35db41-844e-409c-9996-381dfb259d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d569a32cf08433b8b942e73c981f07e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:39.701608 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bd35db41-844e-409c-9996-381dfb259d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d569a32cf08433b8b942e73c981f07e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:39.702976 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bd35db41-844e-409c-9996-381dfb259d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d569a32cf08433b8b942e73c981f07e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:39.723776 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-bd35db41-844e-409c-9996-381dfb259d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d569a32cf08433b8b942e73c981f07e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:39.760306 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 810/1655] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:44:39 2022] DELETE /identity/v3/users/0d569a32cf08433b8b942e73c981f07e => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:40.379980 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a61fd-1bb9-4758-9968-75dc7f1f10e3 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:40.382266 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9e3a61fd-1bb9-4758-9968-75dc7f1f10e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:40.395974 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a61fd-1bb9-4758-9968-75dc7f1f10e3 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:40.531997 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb875040-aa35-473b-ae76-bc6b34f5e0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:40.532671 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb875040-aa35-473b-ae76-bc6b34f5e0de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:40.532972 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb875040-aa35-473b-ae76-bc6b34f5e0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:40.533237 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb875040-aa35-473b-ae76-bc6b34f5e0de admin admin] PATH_INFO: `/v3/projects/ed7c07e243104274ac81dad3927c69c6` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:40.536845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb875040-aa35-473b-ae76-bc6b34f5e0de admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed7c07e243104274ac81dad3927c69c6)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:40.538922 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb875040-aa35-473b-ae76-bc6b34f5e0de admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:40.685228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-eb875040-aa35-473b-ae76-bc6b34f5e0de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed7c07e243104274ac81dad3927c69c6', 'request_id': 'req-eb875040-aa35-473b-ae76-bc6b34f5e0de'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:40.695386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-eb875040-aa35-473b-ae76-bc6b34f5e0de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed7c07e243104274ac81dad3927c69c6', 'request_id': 'req-eb875040-aa35-473b-ae76-bc6b34f5e0de'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:40.723745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-eb875040-aa35-473b-ae76-bc6b34f5e0de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed7c07e243104274ac81dad3927c69c6', 'request_id': 'req-eb875040-aa35-473b-ae76-bc6b34f5e0de'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:40.771262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-eb875040-aa35-473b-ae76-bc6b34f5e0de admin admin] The token cache is being invalidate because project ed7c07e243104274ac81dad3927c69c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:44:40.771775 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-eb875040-aa35-473b-ae76-bc6b34f5e0de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:40.772902 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-eb875040-aa35-473b-ae76-bc6b34f5e0de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:40.775992 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 846/1656] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:44:40 2022] DELETE /identity/v3/projects/ed7c07e243104274ac81dad3927c69c6 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:40.781536 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9281377-483f-4eb3-b88f-8a626f63f6f4 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:40.782449 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9281377-483f-4eb3-b88f-8a626f63f6f4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:40.782953 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9281377-483f-4eb3-b88f-8a626f63f6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:40.824035 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb875040-aa35-473b-ae76-bc6b34f5e0de admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:40.826823 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-eb875040-aa35-473b-ae76-bc6b34f5e0de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:40.864802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f9281377-483f-4eb3-b88f-8a626f63f6f4 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:40.867563 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f9281377-483f-4eb3-b88f-8a626f63f6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:40.921345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:41.062254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 811/1657] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:44:41.070206 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9281377-483f-4eb3-b88f-8a626f63f6f4 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:41.070206 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f9281377-483f-4eb3-b88f-8a626f63f6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:41.100645 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9281377-483f-4eb3-b88f-8a626f63f6f4 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:41.118369 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ec238-6e79-482d-ab68-d1e4ddbd8f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:41.119212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ec238-6e79-482d-ab68-d1e4ddbd8f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:41.119568 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ec238-6e79-482d-ab68-d1e4ddbd8f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:41.121826 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ec238-6e79-482d-ab68-d1e4ddbd8f31 admin admin] PATH_INFO: `/v3/projects/d5fe2749241a4bb3a9ca62eb88b8e5a7` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:41.123775 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ec238-6e79-482d-ab68-d1e4ddbd8f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5fe2749241a4bb3a9ca62eb88b8e5a7)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:41.124756 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb875040-aa35-473b-ae76-bc6b34f5e0de admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:41.126900 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ec238-6e79-482d-ab68-d1e4ddbd8f31 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:41.144942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80f5ce-7c55-4cdb-8aa9-88c6bafe822c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:41.145982 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80f5ce-7c55-4cdb-8aa9-88c6bafe822c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:41.146446 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80f5ce-7c55-4cdb-8aa9-88c6bafe822c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:41.146976 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80f5ce-7c55-4cdb-8aa9-88c6bafe822c admin admin] PATH_INFO: `/v3/users/62f885531eb94f0dab1cf0aadd309a3f` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:41.155783 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80f5ce-7c55-4cdb-8aa9-88c6bafe822c admin admin] RBAC: Authorizing `identity:delete_user(user_id=62f885531eb94f0dab1cf0aadd309a3f)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:41.163559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80f5ce-7c55-4cdb-8aa9-88c6bafe822c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:41.304983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-739ec238-6e79-482d-ab68-d1e4ddbd8f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5fe2749241a4bb3a9ca62eb88b8e5a7', 'request_id': 'req-739ec238-6e79-482d-ab68-d1e4ddbd8f31'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:41.328373 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-739ec238-6e79-482d-ab68-d1e4ddbd8f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5fe2749241a4bb3a9ca62eb88b8e5a7', 'request_id': 'req-739ec238-6e79-482d-ab68-d1e4ddbd8f31'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:41.330123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:41.353869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-739ec238-6e79-482d-ab68-d1e4ddbd8f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5fe2749241a4bb3a9ca62eb88b8e5a7', 'request_id': 'req-739ec238-6e79-482d-ab68-d1e4ddbd8f31'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:41.362874 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6b80f5ce-7c55-4cdb-8aa9-88c6bafe822c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62f885531eb94f0dab1cf0aadd309a3f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:41.379359 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6b80f5ce-7c55-4cdb-8aa9-88c6bafe822c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62f885531eb94f0dab1cf0aadd309a3f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:41.380259 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6b80f5ce-7c55-4cdb-8aa9-88c6bafe822c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62f885531eb94f0dab1cf0aadd309a3f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:41.381439 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6b80f5ce-7c55-4cdb-8aa9-88c6bafe822c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62f885531eb94f0dab1cf0aadd309a3f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:41.391269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-739ec238-6e79-482d-ab68-d1e4ddbd8f31 admin admin] The token cache is being invalidate because project d5fe2749241a4bb3a9ca62eb88b8e5a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:44:41.393329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-739ec238-6e79-482d-ab68-d1e4ddbd8f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:41.395306 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-739ec238-6e79-482d-ab68-d1e4ddbd8f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:41.395422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6b80f5ce-7c55-4cdb-8aa9-88c6bafe822c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62f885531eb94f0dab1cf0aadd309a3f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:41.397683 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 812/1658] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:44:41 2022] DELETE /identity/v3/projects/d5fe2749241a4bb3a9ca62eb88b8e5a7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:41.409246 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d466eda-8c65-4717-8063-227d5a5cf069 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:41.409648 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d466eda-8c65-4717-8063-227d5a5cf069 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:41.410360 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d466eda-8c65-4717-8063-227d5a5cf069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:41.445175 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 847/1659] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:44:40 2022] DELETE /identity/v3/users/62f885531eb94f0dab1cf0aadd309a3f => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:44:41.446977 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c81f06-c76f-41d9-9bb7-67e94ec6c958 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:41.447461 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c81f06-c76f-41d9-9bb7-67e94ec6c958 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:41.447948 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c81f06-c76f-41d9-9bb7-67e94ec6c958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:41.471319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3d466eda-8c65-4717-8063-227d5a5cf069 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:41.472848 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3d466eda-8c65-4717-8063-227d5a5cf069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:41.484448 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-57c81f06-c76f-41d9-9bb7-67e94ec6c958 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:41.488602 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-57c81f06-c76f-41d9-9bb7-67e94ec6c958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:41.647154 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 813/1660] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:41.647154 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d466eda-8c65-4717-8063-227d5a5cf069 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:41.648268 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3d466eda-8c65-4717-8063-227d5a5cf069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:41.678039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d466eda-8c65-4717-8063-227d5a5cf069 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:41.700245 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca02a8-15c0-425a-8f31-c57886e7c852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:41.703464 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca02a8-15c0-425a-8f31-c57886e7c852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:41.704294 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca02a8-15c0-425a-8f31-c57886e7c852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:41.705462 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca02a8-15c0-425a-8f31-c57886e7c852 admin admin] PATH_INFO: `/v3/projects/26693beaa1e74c929f718275018b685d` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:41.710592 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca02a8-15c0-425a-8f31-c57886e7c852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26693beaa1e74c929f718275018b685d)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:41.717118 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca02a8-15c0-425a-8f31-c57886e7c852 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:41.760420 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 848/1661] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:41.762607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbead8a4-ebdc-4aff-9903-cbcae341806c None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:41.763073 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbead8a4-ebdc-4aff-9903-cbcae341806c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:41.763519 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbead8a4-ebdc-4aff-9903-cbcae341806c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:41.825403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-cbead8a4-ebdc-4aff-9903-cbcae341806c None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:41.829446 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cbead8a4-ebdc-4aff-9903-cbcae341806c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:41.870079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 849/1662] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:41.872893 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbead8a4-ebdc-4aff-9903-cbcae341806c None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:41.903382 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbead8a4-ebdc-4aff-9903-cbcae341806c None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:41.928529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-90ca02a8-15c0-425a-8f31-c57886e7c852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26693beaa1e74c929f718275018b685d', 'request_id': 'req-90ca02a8-15c0-425a-8f31-c57886e7c852'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:41.984889 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-90ca02a8-15c0-425a-8f31-c57886e7c852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26693beaa1e74c929f718275018b685d', 'request_id': 'req-90ca02a8-15c0-425a-8f31-c57886e7c852'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:42.006377 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-90ca02a8-15c0-425a-8f31-c57886e7c852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26693beaa1e74c929f718275018b685d', 'request_id': 'req-90ca02a8-15c0-425a-8f31-c57886e7c852'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:42.042082 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-90ca02a8-15c0-425a-8f31-c57886e7c852 admin admin] The token cache is being invalidate because project 26693beaa1e74c929f718275018b685d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:44:42.042480 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-90ca02a8-15c0-425a-8f31-c57886e7c852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:42.046122 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-90ca02a8-15c0-425a-8f31-c57886e7c852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:42.052725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 814/1663] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:44:41 2022] DELETE /identity/v3/projects/26693beaa1e74c929f718275018b685d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:42.055285 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401b751-51dd-48f3-a763-a00b81b87bfd None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:42.055668 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401b751-51dd-48f3-a763-a00b81b87bfd None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:42.055967 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401b751-51dd-48f3-a763-a00b81b87bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:42.067867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:42.129124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c84e2-c852-4d3e-8675-d235e34f03ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:42.130066 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c84e2-c852-4d3e-8675-d235e34f03ad admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:42.134200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c84e2-c852-4d3e-8675-d235e34f03ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:42.137776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c84e2-c852-4d3e-8675-d235e34f03ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:42.140393 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c84e2-c852-4d3e-8675-d235e34f03ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:44:42.140882 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c84e2-c852-4d3e-8675-d235e34f03ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:42.145369 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c84e2-c852-4d3e-8675-d235e34f03ad admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:42.145508 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e401b751-51dd-48f3-a763-a00b81b87bfd None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:42.146760 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e401b751-51dd-48f3-a763-a00b81b87bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:42.159101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 815/1664] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:42.160312 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401b751-51dd-48f3-a763-a00b81b87bfd None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:42.162945 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e401b751-51dd-48f3-a763-a00b81b87bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:42.181149 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 850/1665] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:44:42.183496 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad737085-d9e7-4ee7-830e-5a55c896345e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:42.186345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad737085-d9e7-4ee7-830e-5a55c896345e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:42.186968 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad737085-d9e7-4ee7-830e-5a55c896345e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:42.310918 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ad737085-d9e7-4ee7-830e-5a55c896345e None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:42.329743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401b751-51dd-48f3-a763-a00b81b87bfd None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:42.331047 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ad737085-d9e7-4ee7-830e-5a55c896345e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:42.334812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820970c-1596-4d43-81c1-0817cc29d0e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:42.335767 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820970c-1596-4d43-81c1-0817cc29d0e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:42.336806 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820970c-1596-4d43-81c1-0817cc29d0e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:42.338123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820970c-1596-4d43-81c1-0817cc29d0e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:42.340874 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b820970c-1596-4d43-81c1-0817cc29d0e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:42.358853 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820970c-1596-4d43-81c1-0817cc29d0e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:42.360312 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 851/1666] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:42.360975 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820970c-1596-4d43-81c1-0817cc29d0e1 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:42.361262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad737085-d9e7-4ee7-830e-5a55c896345e None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:42.382411 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 816/1667] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:42.384703 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820970c-1596-4d43-81c1-0817cc29d0e1 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:42.385056 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad737085-d9e7-4ee7-830e-5a55c896345e None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:42.405949 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619bf6e5-3afa-4dbe-8d76-0125e2859919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:42.406593 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bf6e5-3afa-4dbe-8d76-0125e2859919 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:42.407930 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b820970c-1596-4d43-81c1-0817cc29d0e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:42.409143 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bf6e5-3afa-4dbe-8d76-0125e2859919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:42.409501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bf6e5-3afa-4dbe-8d76-0125e2859919 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:42.410202 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619bf6e5-3afa-4dbe-8d76-0125e2859919 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:44:42.410519 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619bf6e5-3afa-4dbe-8d76-0125e2859919 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:42.416566 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619bf6e5-3afa-4dbe-8d76-0125e2859919 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:42.418165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:42.427101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820970c-1596-4d43-81c1-0817cc29d0e1 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:42.437625 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794f42e-6c07-404d-a098-c107b929b16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:42.440015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794f42e-6c07-404d-a098-c107b929b16e admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:42.440413 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794f42e-6c07-404d-a098-c107b929b16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:42.440784 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794f42e-6c07-404d-a098-c107b929b16e admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:42.441572 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794f42e-6c07-404d-a098-c107b929b16e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:42.443881 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794f42e-6c07-404d-a098-c107b929b16e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:42.445634 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 852/1668] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:44:42.452599 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ec8fd-51a9-4712-ac4f-8514d5b1cdfa None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:42.453187 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ec8fd-51a9-4712-ac4f-8514d5b1cdfa None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:42.454096 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ec8fd-51a9-4712-ac4f-8514d5b1cdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:42.494284 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8e9ec8fd-51a9-4712-ac4f-8514d5b1cdfa None None] MFA Rules not processed for user `888bda8e3665469cafd6739ae3423bab`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:42.497462 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8e9ec8fd-51a9-4712-ac4f-8514d5b1cdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:42.500562 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 817/1669] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:44:42 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:42.506394 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582af58e-ee54-4de1-9c13-3a2f66947ed8 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:42.506804 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582af58e-ee54-4de1-9c13-3a2f66947ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:42.507170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582af58e-ee54-4de1-9c13-3a2f66947ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:42.565250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-582af58e-ee54-4de1-9c13-3a2f66947ed8 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:42.571213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-582af58e-ee54-4de1-9c13-3a2f66947ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:42.696005 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 853/1670] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:42.696896 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ec8fd-51a9-4712-ac4f-8514d5b1cdfa None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:42.780957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 818/1671] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:42.782782 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582af58e-ee54-4de1-9c13-3a2f66947ed8 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:42.814435 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582af58e-ee54-4de1-9c13-3a2f66947ed8 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:42.845876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1932526-bce6-4aa9-a83e-122941507172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:42.846604 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1932526-bce6-4aa9-a83e-122941507172 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:42.846962 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1932526-bce6-4aa9-a83e-122941507172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:42.847564 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1932526-bce6-4aa9-a83e-122941507172 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:42.848284 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1932526-bce6-4aa9-a83e-122941507172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:42.850352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1932526-bce6-4aa9-a83e-122941507172 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:42.872666 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ec8fd-51a9-4712-ac4f-8514d5b1cdfa None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:42.879086 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5181079-90a3-4572-937b-1ddf46986d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:42.880021 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5181079-90a3-4572-937b-1ddf46986d89 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:42.880474 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5181079-90a3-4572-937b-1ddf46986d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:42.880913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5181079-90a3-4572-937b-1ddf46986d89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:42.881759 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5181079-90a3-4572-937b-1ddf46986d89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:42.884505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5181079-90a3-4572-937b-1ddf46986d89 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:42.925807 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 819/1672] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:44:42 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:42.928254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1932526-bce6-4aa9-a83e-122941507172 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:42.934325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f1932526-bce6-4aa9-a83e-122941507172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:42.953623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 854/1673] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:44:42 2022] POST /identity/v3/projects => generated 379 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:42.953623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5181079-90a3-4572-937b-1ddf46986d89 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:43.067229 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:43.137557 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5181079-90a3-4572-937b-1ddf46986d89 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:43.156481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1932526-bce6-4aa9-a83e-122941507172 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:43.156963 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7609b3-2628-4196-8478-7d64b3bffdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:43.157724 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7609b3-2628-4196-8478-7d64b3bffdbd admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:43.158007 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7609b3-2628-4196-8478-7d64b3bffdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:43.158283 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7609b3-2628-4196-8478-7d64b3bffdbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:43.158985 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7609b3-2628-4196-8478-7d64b3bffdbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:44:43.159271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7609b3-2628-4196-8478-7d64b3bffdbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:43.160896 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7609b3-2628-4196-8478-7d64b3bffdbd admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:43.191185 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 855/1674] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:44:43.192062 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7609b3-2628-4196-8478-7d64b3bffdbd admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:43.219735 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7609b3-2628-4196-8478-7d64b3bffdbd admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:43.241126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd64d0-8fc3-451d-ab12-4499eb8f7ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:43.241761 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd64d0-8fc3-451d-ab12-4499eb8f7ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:43.242105 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd64d0-8fc3-451d-ab12-4499eb8f7ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:43.242391 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd64d0-8fc3-451d-ab12-4499eb8f7ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:43.243967 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd64d0-8fc3-451d-ab12-4499eb8f7ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:43.246767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd64d0-8fc3-451d-ab12-4499eb8f7ee9 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:43.269142 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 856/1675] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:43.269142 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd64d0-8fc3-451d-ab12-4499eb8f7ee9 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:43.284802 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd64d0-8fc3-451d-ab12-4499eb8f7ee9 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:43.296186 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:43.296390 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbe918-c3ff-4ce4-8759-85663758b3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:43.296967 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbe918-c3ff-4ce4-8759-85663758b3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:43.298063 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbe918-c3ff-4ce4-8759-85663758b3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:43.298960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbe918-c3ff-4ce4-8759-85663758b3b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:43.299835 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbe918-c3ff-4ce4-8759-85663758b3b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:43.304645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbe918-c3ff-4ce4-8759-85663758b3b8 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:43.322094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068f44d-3273-4303-b828-39d0dd6807a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:43.323453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068f44d-3273-4303-b828-39d0dd6807a7 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:43.323898 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068f44d-3273-4303-b828-39d0dd6807a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:43.324402 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068f44d-3273-4303-b828-39d0dd6807a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:43.362694 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 857/1676] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:44:43 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:43.365737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbe918-c3ff-4ce4-8759-85663758b3b8 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:43.368549 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3dbbe918-c3ff-4ce4-8759-85663758b3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:43.407088 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbe918-c3ff-4ce4-8759-85663758b3b8 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:43.412761 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9911414-7108-434b-8974-c57fb93b2069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:43.413459 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9911414-7108-434b-8974-c57fb93b2069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:43.413739 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9911414-7108-434b-8974-c57fb93b2069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:43.414010 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9911414-7108-434b-8974-c57fb93b2069 admin admin] PATH_INFO: `/v3/projects/75d1835470234029ad7b6f527ec0939c` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:43.415309 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9911414-7108-434b-8974-c57fb93b2069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d1835470234029ad7b6f527ec0939c)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:43.421265 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9911414-7108-434b-8974-c57fb93b2069 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:43.422052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068f44d-3273-4303-b828-39d0dd6807a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:43.424099 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068f44d-3273-4303-b828-39d0dd6807a7 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:43.436718 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 820/1677] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:43.438539 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068f44d-3273-4303-b828-39d0dd6807a7 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:43.458392 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068f44d-3273-4303-b828-39d0dd6807a7 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:43.473953 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511f636-725e-4e92-91df-ef40dfe1f6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:43.474653 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511f636-725e-4e92-91df-ef40dfe1f6ab admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:43.474943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511f636-725e-4e92-91df-ef40dfe1f6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:43.475263 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511f636-725e-4e92-91df-ef40dfe1f6ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:43.475965 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511f636-725e-4e92-91df-ef40dfe1f6ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:43.483577 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511f636-725e-4e92-91df-ef40dfe1f6ab admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:43.509626 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e9911414-7108-434b-8974-c57fb93b2069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d1835470234029ad7b6f527ec0939c', 'request_id': 'req-e9911414-7108-434b-8974-c57fb93b2069'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:43.520879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e9911414-7108-434b-8974-c57fb93b2069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d1835470234029ad7b6f527ec0939c', 'request_id': 'req-e9911414-7108-434b-8974-c57fb93b2069'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:43.533792 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 821/1678] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:44:43 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:43.535339 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e9911414-7108-434b-8974-c57fb93b2069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d1835470234029ad7b6f527ec0939c', 'request_id': 'req-e9911414-7108-434b-8974-c57fb93b2069'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:43.535476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1aa0c-85ce-433a-9b85-1887a3770c58 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:43.535739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1aa0c-85ce-433a-9b85-1887a3770c58 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:43.536021 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1aa0c-85ce-433a-9b85-1887a3770c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:43.548208 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e9911414-7108-434b-8974-c57fb93b2069 admin admin] The token cache is being invalidate because project 75d1835470234029ad7b6f527ec0939c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:44:43.548507 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e9911414-7108-434b-8974-c57fb93b2069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:43.549223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e9911414-7108-434b-8974-c57fb93b2069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:43.550964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 858/1679] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:44:43 2022] DELETE /identity/v3/projects/75d1835470234029ad7b6f527ec0939c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:43.551637 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9911414-7108-434b-8974-c57fb93b2069 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:43.553321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e9911414-7108-434b-8974-c57fb93b2069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:43.580321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-07d1aa0c-85ce-433a-9b85-1887a3770c58 None None] MFA Rules not processed for user `6c8719f0b3cc4cfeb8b2bfb8b2d34173`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:43.582529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-07d1aa0c-85ce-433a-9b85-1887a3770c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:43.638030 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9911414-7108-434b-8974-c57fb93b2069 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:43.695248 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:43.734325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 822/1680] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:43.735473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1aa0c-85ce-433a-9b85-1887a3770c58 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:43.737835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-07d1aa0c-85ce-433a-9b85-1887a3770c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:43.782289 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7cf05d-88a0-4cbb-aa82-425aeef9d1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:43.785036 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cf05d-88a0-4cbb-aa82-425aeef9d1ed admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:43.786209 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cf05d-88a0-4cbb-aa82-425aeef9d1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:43.786734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7cf05d-88a0-4cbb-aa82-425aeef9d1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:43.788807 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7cf05d-88a0-4cbb-aa82-425aeef9d1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:43.792615 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7cf05d-88a0-4cbb-aa82-425aeef9d1ed admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:43.818963 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 859/1681] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:43.820151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7cf05d-88a0-4cbb-aa82-425aeef9d1ed admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:43.824510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4d7cf05d-88a0-4cbb-aa82-425aeef9d1ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:43.850167 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7cf05d-88a0-4cbb-aa82-425aeef9d1ed admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:43.860315 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1aa0c-85ce-433a-9b85-1887a3770c58 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:43.869220 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e84ce-1011-4bb1-95a4-76e63df4b05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:43.870618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e84ce-1011-4bb1-95a4-76e63df4b05e admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:43.870901 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e84ce-1011-4bb1-95a4-76e63df4b05e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:43.871182 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e84ce-1011-4bb1-95a4-76e63df4b05e admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:43.871951 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e84ce-1011-4bb1-95a4-76e63df4b05e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:43.872301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d693c-8645-458e-80fc-85f70a065355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:43.874121 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e84ce-1011-4bb1-95a4-76e63df4b05e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:43.874659 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d693c-8645-458e-80fc-85f70a065355 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:43.874952 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d693c-8645-458e-80fc-85f70a065355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:43.875232 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d693c-8645-458e-80fc-85f70a065355 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:43.875959 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d693c-8645-458e-80fc-85f70a065355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:43.878006 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d693c-8645-458e-80fc-85f70a065355 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:43.893932 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 823/1682] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:43.893932 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a1558-ee6f-4d4e-ac08-3dae4a3eac25 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:43.893932 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a1558-ee6f-4d4e-ac08-3dae4a3eac25 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:43.893932 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a1558-ee6f-4d4e-ac08-3dae4a3eac25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:43.909892 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:43.928814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 860/1683] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:44:43 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:43.928814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f1730-7d63-4354-ad01-d8ef92c71c38 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:43.929071 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-328a1558-ee6f-4d4e-ac08-3dae4a3eac25 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:43.929266 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f1730-7d63-4354-ad01-d8ef92c71c38 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:43.929266 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f1730-7d63-4354-ad01-d8ef92c71c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:43.929396 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-328a1558-ee6f-4d4e-ac08-3dae4a3eac25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:43.948650 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 824/1684] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:43.949577 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a1558-ee6f-4d4e-ac08-3dae4a3eac25 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:43.960474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a1558-ee6f-4d4e-ac08-3dae4a3eac25 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:43.985869 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-eb6f1730-7d63-4354-ad01-d8ef92c71c38 None None] MFA Rules not processed for user `6c8719f0b3cc4cfeb8b2bfb8b2d34173`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:43.987343 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-eb6f1730-7d63-4354-ad01-d8ef92c71c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:43.990934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486a2ea-05a6-4594-9d65-9afb83556160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:43.993116 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486a2ea-05a6-4594-9d65-9afb83556160 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:43.995205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486a2ea-05a6-4594-9d65-9afb83556160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:43.995711 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486a2ea-05a6-4594-9d65-9afb83556160 admin admin] PATH_INFO: `/v3/projects/f962ef7473b64ff79eb3e8bc2141898c/users/84da5a0fda454362876283214da70cbc/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:44.003528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 861/1685] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:44.005881 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f1730-7d63-4354-ad01-d8ef92c71c38 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:44.027670 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f1730-7d63-4354-ad01-d8ef92c71c38 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:44.029756 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486a2ea-05a6-4594-9d65-9afb83556160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f962ef7473b64ff79eb3e8bc2141898c, user_id=84da5a0fda454362876283214da70cbc, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:44.035580 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae5cc1-c116-4f80-ac9d-e733989046af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:44.036261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae5cc1-c116-4f80-ac9d-e733989046af admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:44.036581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae5cc1-c116-4f80-ac9d-e733989046af admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:44.036862 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae5cc1-c116-4f80-ac9d-e733989046af admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:44.037579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae5cc1-c116-4f80-ac9d-e733989046af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:44.039370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae5cc1-c116-4f80-ac9d-e733989046af admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:44.039479 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486a2ea-05a6-4594-9d65-9afb83556160 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:44.058175 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 862/1686] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:44.059362 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae5cc1-c116-4f80-ac9d-e733989046af admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:44.072117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae5cc1-c116-4f80-ac9d-e733989046af admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:44.087703 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 825/1687] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:43 2022] PUT /identity/v3/projects/f962ef7473b64ff79eb3e8bc2141898c/users/84da5a0fda454362876283214da70cbc/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:44.090775 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bcc87-07ec-4a14-8ada-a1ee9731c851 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:44.091090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bcc87-07ec-4a14-8ada-a1ee9731c851 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:44.091410 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bcc87-07ec-4a14-8ada-a1ee9731c851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:44.121643 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-705bcc87-07ec-4a14-8ada-a1ee9731c851 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:44.123891 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-705bcc87-07ec-4a14-8ada-a1ee9731c851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:44.214764 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b22a1-8011-42fc-abb2-804af99f4f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:44.215554 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b22a1-8011-42fc-abb2-804af99f4f6b admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:44.215869 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b22a1-8011-42fc-abb2-804af99f4f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:44.216167 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b22a1-8011-42fc-abb2-804af99f4f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:44.216906 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b22a1-8011-42fc-abb2-804af99f4f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:44.218631 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b22a1-8011-42fc-abb2-804af99f4f6b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:44.243745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 863/1688] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:44.247010 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b22a1-8011-42fc-abb2-804af99f4f6b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:44.253064 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-dc1b22a1-8011-42fc-abb2-804af99f4f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:44.277341 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 826/1689] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:44.278556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bcc87-07ec-4a14-8ada-a1ee9731c851 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:44.290996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bcc87-07ec-4a14-8ada-a1ee9731c851 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:44.303681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80c548-5582-42d6-8519-29f2224acc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:44.304620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80c548-5582-42d6-8519-29f2224acc26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:44.305146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80c548-5582-42d6-8519-29f2224acc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:44.305675 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80c548-5582-42d6-8519-29f2224acc26 admin admin] PATH_INFO: `/v3/projects/bbb8c8497c964b5fb191fb8f9abbb84b/users/7c011aa7f15d4e03babae12930978204/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:44.380232 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80c548-5582-42d6-8519-29f2224acc26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb8c8497c964b5fb191fb8f9abbb84b, user_id=7c011aa7f15d4e03babae12930978204, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:44.388245 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80c548-5582-42d6-8519-29f2224acc26 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:44.427623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 827/1690] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:44 2022] PUT /identity/v3/projects/bbb8c8497c964b5fb191fb8f9abbb84b/users/7c011aa7f15d4e03babae12930978204/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:44.430447 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2ee1a-518e-4917-9d27-f9507f11f2e1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:44.431653 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2ee1a-518e-4917-9d27-f9507f11f2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:44.431943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2ee1a-518e-4917-9d27-f9507f11f2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:44.455955 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b22a1-8011-42fc-abb2-804af99f4f6b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:44.479656 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-17d2ee1a-518e-4917-9d27-f9507f11f2e1 None None] MFA Rules not processed for user `84da5a0fda454362876283214da70cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:44.484691 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-17d2ee1a-518e-4917-9d27-f9507f11f2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:44.531150 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:44.656338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 828/1691] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:44.657023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2ee1a-518e-4917-9d27-f9507f11f2e1 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:44.695560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd061c6-4691-4681-b7f9-00400f3b2def service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:44.700359 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd061c6-4691-4681-b7f9-00400f3b2def service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:44.700359 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd061c6-4691-4681-b7f9-00400f3b2def service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:44.700359 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd061c6-4691-4681-b7f9-00400f3b2def service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:44.764404 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:44.813696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2ee1a-518e-4917-9d27-f9507f11f2e1 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:44.826309 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc060d-3558-4f00-bfd8-9b560cb202fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:44.828160 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc060d-3558-4f00-bfd8-9b560cb202fe admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:44.828396 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc060d-3558-4f00-bfd8-9b560cb202fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:44.828680 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc060d-3558-4f00-bfd8-9b560cb202fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:44.832910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc060d-3558-4f00-bfd8-9b560cb202fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:44.834794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc060d-3558-4f00-bfd8-9b560cb202fe admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:44.858627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd061c6-4691-4681-b7f9-00400f3b2def service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:44.866083 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd061c6-4691-4681-b7f9-00400f3b2def service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:44.872927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 829/1692] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:44.874171 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc060d-3558-4f00-bfd8-9b560cb202fe admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:44.895423 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 864/1693] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:44.896815 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a58cf8-634c-4306-b778-7785e0393573 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:44.897308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a58cf8-634c-4306-b778-7785e0393573 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:44.897628 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a58cf8-634c-4306-b778-7785e0393573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:44.907092 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc060d-3558-4f00-bfd8-9b560cb202fe admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:44.919862 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc264c1a-ffa0-4b20-bcfe-07f87495b354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:44.920577 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc264c1a-ffa0-4b20-bcfe-07f87495b354 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:44.920865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc264c1a-ffa0-4b20-bcfe-07f87495b354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:44.921163 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc264c1a-ffa0-4b20-bcfe-07f87495b354 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:44.921945 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc264c1a-ffa0-4b20-bcfe-07f87495b354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:44:44.922143 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc264c1a-ffa0-4b20-bcfe-07f87495b354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:44.932651 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc264c1a-ffa0-4b20-bcfe-07f87495b354 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:44.962095 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 830/1694] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:44:44.962946 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc264c1a-ffa0-4b20-bcfe-07f87495b354 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:44.981166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-49a58cf8-634c-4306-b778-7785e0393573 None None] MFA Rules not processed for user `7c011aa7f15d4e03babae12930978204`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:44.982419 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-49a58cf8-634c-4306-b778-7785e0393573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:44.995398 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc264c1a-ffa0-4b20-bcfe-07f87495b354 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:45.005860 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca9525-54e6-4246-bc96-b681a0224e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:45.006490 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca9525-54e6-4246-bc96-b681a0224e9d admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:45.006770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca9525-54e6-4246-bc96-b681a0224e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:45.007045 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca9525-54e6-4246-bc96-b681a0224e9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:45.007690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca9525-54e6-4246-bc96-b681a0224e9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:45.009702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca9525-54e6-4246-bc96-b681a0224e9d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:45.121349 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 831/1695] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:44:44 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:45.122338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca9525-54e6-4246-bc96-b681a0224e9d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:45.165461 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 865/1696] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:45.167697 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a58cf8-634c-4306-b778-7785e0393573 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:45.223299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a58cf8-634c-4306-b778-7785e0393573 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:45.332077 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca9525-54e6-4246-bc96-b681a0224e9d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:45.369995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac1323-8969-47a0-a91f-bb305b087f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:45.371310 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac1323-8969-47a0-a91f-bb305b087f88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:45.372039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac1323-8969-47a0-a91f-bb305b087f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:45.372477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac1323-8969-47a0-a91f-bb305b087f88 admin admin] PATH_INFO: `/v3/projects/b026d9a70159464dadd756899dea2ca2/users/66f57131b23e49fda8b5045f20cd4284/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:45.381909 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:45.403890 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac1323-8969-47a0-a91f-bb305b087f88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b026d9a70159464dadd756899dea2ca2, user_id=66f57131b23e49fda8b5045f20cd4284, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:45.409299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02018e5b-f5f6-49a7-9706-c8cf5c32941b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:45.410397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02018e5b-f5f6-49a7-9706-c8cf5c32941b admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:45.411007 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02018e5b-f5f6-49a7-9706-c8cf5c32941b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:45.411007 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02018e5b-f5f6-49a7-9706-c8cf5c32941b admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:45.415550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02018e5b-f5f6-49a7-9706-c8cf5c32941b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:45.424330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac1323-8969-47a0-a91f-bb305b087f88 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:45.425020 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02018e5b-f5f6-49a7-9706-c8cf5c32941b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:45.455533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 832/1697] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:45 2022] PUT /identity/v3/projects/b026d9a70159464dadd756899dea2ca2/users/66f57131b23e49fda8b5045f20cd4284/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:45.456845 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac1323-8969-47a0-a91f-bb305b087f88 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:45.491176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 866/1698] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:44:45 2022] POST /identity/v3/projects => generated 363 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:45.492746 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02018e5b-f5f6-49a7-9706-c8cf5c32941b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:45.647733 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac1323-8969-47a0-a91f-bb305b087f88 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:45.685038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02018e5b-f5f6-49a7-9706-c8cf5c32941b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:45.703010 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e21d70-9645-4060-b0f3-ffc6e2699974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:45.703750 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e21d70-9645-4060-b0f3-ffc6e2699974 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:45.705065 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e21d70-9645-4060-b0f3-ffc6e2699974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:45.705285 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e21d70-9645-4060-b0f3-ffc6e2699974 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:45.707126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e21d70-9645-4060-b0f3-ffc6e2699974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:45.711470 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e21d70-9645-4060-b0f3-ffc6e2699974 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:45.722820 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:45.785243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 867/1699] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:44:45 2022] POST /identity/v3/projects => generated 381 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:45.790233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66714b2b-08ad-432c-a78b-df74c3412b13 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:45.790554 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66714b2b-08ad-432c-a78b-df74c3412b13 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:45.791272 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66714b2b-08ad-432c-a78b-df74c3412b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:45.801261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468fdc2-0f4c-412e-9a59-70bdc6527c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:45.802860 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468fdc2-0f4c-412e-9a59-70bdc6527c10 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:45.803529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468fdc2-0f4c-412e-9a59-70bdc6527c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:45.803529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468fdc2-0f4c-412e-9a59-70bdc6527c10 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:45.804248 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468fdc2-0f4c-412e-9a59-70bdc6527c10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:45.807204 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468fdc2-0f4c-412e-9a59-70bdc6527c10 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:45.849424 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 833/1700] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:44:45 2022] POST /identity/v3/users => generated 294 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:45.850173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468fdc2-0f4c-412e-9a59-70bdc6527c10 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:45.858492 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-66714b2b-08ad-432c-a78b-df74c3412b13 None None] MFA Rules not processed for user `66f57131b23e49fda8b5045f20cd4284`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:45.860326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-66714b2b-08ad-432c-a78b-df74c3412b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:45.869695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468fdc2-0f4c-412e-9a59-70bdc6527c10 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:45.965059 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 868/1701] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:45.965710 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66714b2b-08ad-432c-a78b-df74c3412b13 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:45.992934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af6ed2-a9cd-4075-9bbd-88d79da55eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:45.993741 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af6ed2-a9cd-4075-9bbd-88d79da55eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:45.994023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af6ed2-a9cd-4075-9bbd-88d79da55eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:45.994941 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af6ed2-a9cd-4075-9bbd-88d79da55eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:45.995043 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af6ed2-a9cd-4075-9bbd-88d79da55eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:45.997297 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af6ed2-a9cd-4075-9bbd-88d79da55eb3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:46.026496 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 834/1702] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:44:45 2022] POST /identity/v3/users => generated 282 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:46.028042 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af6ed2-a9cd-4075-9bbd-88d79da55eb3 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:46.042059 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:46.043288 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af6ed2-a9cd-4075-9bbd-88d79da55eb3 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:46.048786 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23810393-e4f8-4909-a170-785251f008ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:46.048994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23810393-e4f8-4909-a170-785251f008ef admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:46.049291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23810393-e4f8-4909-a170-785251f008ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:46.049568 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23810393-e4f8-4909-a170-785251f008ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:46.050226 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23810393-e4f8-4909-a170-785251f008ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:46.052706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23810393-e4f8-4909-a170-785251f008ef admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:46.062327 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66714b2b-08ad-432c-a78b-df74c3412b13 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:46.064678 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 835/1703] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:46.066193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c840939-9b36-4275-bff5-b9b8ed854297 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:46.066481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c840939-9b36-4275-bff5-b9b8ed854297 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:46.066754 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c840939-9b36-4275-bff5-b9b8ed854297 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:46.073172 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 836/1704] 10.222.0.52 () {54 vars in 912 bytes} [Thu Sep 15 00:44:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:44:46.074327 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c840939-9b36-4275-bff5-b9b8ed854297 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:46.076137 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc34c81-0f9b-4e20-b1d8-c40b0312f559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:46.076829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc34c81-0f9b-4e20-b1d8-c40b0312f559 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:46.077255 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc34c81-0f9b-4e20-b1d8-c40b0312f559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:46.077680 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc34c81-0f9b-4e20-b1d8-c40b0312f559 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:46.078397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc34c81-0f9b-4e20-b1d8-c40b0312f559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:46.080439 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc34c81-0f9b-4e20-b1d8-c40b0312f559 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:46.087010 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c840939-9b36-4275-bff5-b9b8ed854297 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:46.092114 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1b83f-1ec9-40a1-96de-07d7b451517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:46.092715 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1b83f-1ec9-40a1-96de-07d7b451517a admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:46.092994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1b83f-1ec9-40a1-96de-07d7b451517a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:46.093295 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1b83f-1ec9-40a1-96de-07d7b451517a admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:46.093931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1b83f-1ec9-40a1-96de-07d7b451517a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:46.095848 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1b83f-1ec9-40a1-96de-07d7b451517a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:46.113465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 869/1705] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:44:45 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:46.114437 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc34c81-0f9b-4e20-b1d8-c40b0312f559 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:46.129301 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc34c81-0f9b-4e20-b1d8-c40b0312f559 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:46.140307 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dea38b-00ef-4e4e-acd4-4bcd57e39c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:46.141863 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dea38b-00ef-4e4e-acd4-4bcd57e39c0f admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:46.145197 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 837/1706] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:44:46 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:46.145349 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dea38b-00ef-4e4e-acd4-4bcd57e39c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:46.145349 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dea38b-00ef-4e4e-acd4-4bcd57e39c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:46.145531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1b83f-1ec9-40a1-96de-07d7b451517a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:46.145622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dea38b-00ef-4e4e-acd4-4bcd57e39c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:46.147515 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dea38b-00ef-4e4e-acd4-4bcd57e39c0f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:46.160825 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 870/1707] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:46.162577 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff17107-29fd-459d-99bb-080e15775784 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:46.162844 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff17107-29fd-459d-99bb-080e15775784 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:46.163195 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff17107-29fd-459d-99bb-080e15775784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:46.208974 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-4ff17107-29fd-459d-99bb-080e15775784 None None] MFA Rules not processed for user `50ec251be76543b4ad97442664db6858`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:46.211183 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4ff17107-29fd-459d-99bb-080e15775784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:46.220957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1b83f-1ec9-40a1-96de-07d7b451517a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:46.226273 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b047a6-2f74-4374-a2f6-3fb5fd797e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:46.226881 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b047a6-2f74-4374-a2f6-3fb5fd797e36 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:46.227161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b047a6-2f74-4374-a2f6-3fb5fd797e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:46.227571 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b047a6-2f74-4374-a2f6-3fb5fd797e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:46.228224 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b047a6-2f74-4374-a2f6-3fb5fd797e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:46.229904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b047a6-2f74-4374-a2f6-3fb5fd797e36 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:46.240686 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 838/1708] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:46.241623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b047a6-2f74-4374-a2f6-3fb5fd797e36 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:46.259393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b047a6-2f74-4374-a2f6-3fb5fd797e36 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:46.267766 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315a3c5-e532-4862-bf16-2b178c9ef0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:46.268385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315a3c5-e532-4862-bf16-2b178c9ef0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:46.268663 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315a3c5-e532-4862-bf16-2b178c9ef0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:46.268932 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315a3c5-e532-4862-bf16-2b178c9ef0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:46.269744 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4315a3c5-e532-4862-bf16-2b178c9ef0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:46.271497 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4315a3c5-e532-4862-bf16-2b178c9ef0f3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:46.283233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 871/1709] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 15 00:44:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:46.284364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff17107-29fd-459d-99bb-080e15775784 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:46.286137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 839/1710] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:46.287042 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315a3c5-e532-4862-bf16-2b178c9ef0f3 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:46.292515 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:46.298726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315a3c5-e532-4862-bf16-2b178c9ef0f3 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:46.300089 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff17107-29fd-459d-99bb-080e15775784 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:46.305545 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7566a7-4f2e-44a1-9a3c-560d077f6621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:46.306190 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7566a7-4f2e-44a1-9a3c-560d077f6621 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:46.306445 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7566a7-4f2e-44a1-9a3c-560d077f6621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:46.306719 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7566a7-4f2e-44a1-9a3c-560d077f6621 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:46.307787 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6fc6e-32e0-4909-92fb-f097af9fdf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:46.307937 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7566a7-4f2e-44a1-9a3c-560d077f6621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:46.308749 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6fc6e-32e0-4909-92fb-f097af9fdf3b admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:46.309204 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6fc6e-32e0-4909-92fb-f097af9fdf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:46.309613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6fc6e-32e0-4909-92fb-f097af9fdf3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:46.309830 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7566a7-4f2e-44a1-9a3c-560d077f6621 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:46.310595 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6fc6e-32e0-4909-92fb-f097af9fdf3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:46.312555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6fc6e-32e0-4909-92fb-f097af9fdf3b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:46.333165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 840/1711] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:46.334202 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6fc6e-32e0-4909-92fb-f097af9fdf3b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:46.341973 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 872/1712] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:44:46 2022] POST /identity/v3/users => generated 298 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:46.346503 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7566a7-4f2e-44a1-9a3c-560d077f6621 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:46.348876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6fc6e-32e0-4909-92fb-f097af9fdf3b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:46.358225 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5194a6-d6a8-4277-8fa2-ec3570651466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:46.358948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5194a6-d6a8-4277-8fa2-ec3570651466 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:46.359177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7566a7-4f2e-44a1-9a3c-560d077f6621 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:46.359481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5194a6-d6a8-4277-8fa2-ec3570651466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:46.359700 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5194a6-d6a8-4277-8fa2-ec3570651466 admin admin] PATH_INFO: `/v3/projects/d1ad0507f19247bcbc8c91bd197a04ff/users/a8515b0d193a453695f765451f478900/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:46.364972 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e691ec-dd3c-46b7-9911-4e5cb19bf6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:46.365746 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e691ec-dd3c-46b7-9911-4e5cb19bf6dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:46.366040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e691ec-dd3c-46b7-9911-4e5cb19bf6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:46.366315 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e691ec-dd3c-46b7-9911-4e5cb19bf6dc admin admin] PATH_INFO: `/v3/projects/fdc363fc7e7b491cb829e9059b256488/users/01ab68e564d14c4998b1037ee5ec846a/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:46.391405 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5194a6-d6a8-4277-8fa2-ec3570651466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ad0507f19247bcbc8c91bd197a04ff, user_id=a8515b0d193a453695f765451f478900, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:46.391979 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e691ec-dd3c-46b7-9911-4e5cb19bf6dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc363fc7e7b491cb829e9059b256488, user_id=01ab68e564d14c4998b1037ee5ec846a, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:46.394766 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e691ec-dd3c-46b7-9911-4e5cb19bf6dc admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:46.399233 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5194a6-d6a8-4277-8fa2-ec3570651466 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:46.417134 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 873/1713] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:46 2022] PUT /identity/v3/projects/fdc363fc7e7b491cb829e9059b256488/users/01ab68e564d14c4998b1037ee5ec846a/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:46.417134 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e691ec-dd3c-46b7-9911-4e5cb19bf6dc admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:46.430294 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e5e691ec-dd3c-46b7-9911-4e5cb19bf6dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:46.431159 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 841/1714] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:46 2022] PUT /identity/v3/projects/d1ad0507f19247bcbc8c91bd197a04ff/users/a8515b0d193a453695f765451f478900/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:46.431159 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5194a6-d6a8-4277-8fa2-ec3570651466 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:46.520639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5194a6-d6a8-4277-8fa2-ec3570651466 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:46.526476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87117b14-2443-445a-9c91-2d92251904e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:46.527281 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87117b14-2443-445a-9c91-2d92251904e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:46.527637 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87117b14-2443-445a-9c91-2d92251904e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:46.527919 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87117b14-2443-445a-9c91-2d92251904e5 admin admin] PATH_INFO: `/v3/projects/b5596c63e12048cfaf90947a28dc2567/users/a408f37c235943b39fad27820938b442/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:46.530747 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e691ec-dd3c-46b7-9911-4e5cb19bf6dc admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:46.559333 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87117b14-2443-445a-9c91-2d92251904e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5596c63e12048cfaf90947a28dc2567, user_id=a408f37c235943b39fad27820938b442, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:46.565128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87117b14-2443-445a-9c91-2d92251904e5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:46.585418 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 842/1715] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:46 2022] PUT /identity/v3/projects/b5596c63e12048cfaf90947a28dc2567/users/a408f37c235943b39fad27820938b442/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:46.592380 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:46.596404 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87117b14-2443-445a-9c91-2d92251904e5 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:46.613820 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fa498-0c5d-4e99-bb04-0e9431673ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:46.614458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fa498-0c5d-4e99-bb04-0e9431673ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:46.614741 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fa498-0c5d-4e99-bb04-0e9431673ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:46.615050 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fa498-0c5d-4e99-bb04-0e9431673ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:46.623635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fa498-0c5d-4e99-bb04-0e9431673ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:46.625124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fa498-0c5d-4e99-bb04-0e9431673ac0 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:46.635314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 874/1716] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:46.636238 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fa498-0c5d-4e99-bb04-0e9431673ac0 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:46.647362 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fa498-0c5d-4e99-bb04-0e9431673ac0 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:46.690725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87117b14-2443-445a-9c91-2d92251904e5 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:46.698183 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808d348-221f-41f6-bcff-8ca496939f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:46.698994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808d348-221f-41f6-bcff-8ca496939f03 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:46.699449 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808d348-221f-41f6-bcff-8ca496939f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:46.699855 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808d348-221f-41f6-bcff-8ca496939f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:46.700650 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808d348-221f-41f6-bcff-8ca496939f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:46.713342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808d348-221f-41f6-bcff-8ca496939f03 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:46.729836 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 843/1717] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:46.729836 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246da82-f542-46c0-b4ff-6518305a3f82 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:46.729836 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246da82-f542-46c0-b4ff-6518305a3f82 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:46.729836 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246da82-f542-46c0-b4ff-6518305a3f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:46.742828 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adb52c-f531-4f5f-bee3-ff1f5b804ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:46.743459 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adb52c-f531-4f5f-bee3-ff1f5b804ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:46.743782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adb52c-f531-4f5f-bee3-ff1f5b804ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:46.744209 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adb52c-f531-4f5f-bee3-ff1f5b804ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:46.745610 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0adb52c-f531-4f5f-bee3-ff1f5b804ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:46.747417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0adb52c-f531-4f5f-bee3-ff1f5b804ad7 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:46.769515 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 875/1718] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:46.769515 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adb52c-f531-4f5f-bee3-ff1f5b804ad7 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:46.770824 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2246da82-f542-46c0-b4ff-6518305a3f82 None None] MFA Rules not processed for user `a8515b0d193a453695f765451f478900`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:46.772180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2246da82-f542-46c0-b4ff-6518305a3f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:46.774116 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d0adb52c-f531-4f5f-bee3-ff1f5b804ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:46.790331 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adb52c-f531-4f5f-bee3-ff1f5b804ad7 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:46.804418 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64010f7-7b72-4d1c-96ca-16cc3a5b1fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:46.805281 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64010f7-7b72-4d1c-96ca-16cc3a5b1fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:46.805619 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64010f7-7b72-4d1c-96ca-16cc3a5b1fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:46.805923 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64010f7-7b72-4d1c-96ca-16cc3a5b1fbc admin admin] PATH_INFO: `/v3/users/908a6895d6e94b04961621b339ebda17` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:46.808217 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64010f7-7b72-4d1c-96ca-16cc3a5b1fbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=908a6895d6e94b04961621b339ebda17)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:46.817240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64010f7-7b72-4d1c-96ca-16cc3a5b1fbc admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:46.872875 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:46.925431 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 844/1719] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:46.925431 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2abce6-c796-41f6-93da-24ae5957972e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:46.925431 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2abce6-c796-41f6-93da-24ae5957972e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:46.925431 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2abce6-c796-41f6-93da-24ae5957972e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:46.929633 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a64010f7-7b72-4d1c-96ca-16cc3a5b1fbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '908a6895d6e94b04961621b339ebda17'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:46.943025 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a64010f7-7b72-4d1c-96ca-16cc3a5b1fbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '908a6895d6e94b04961621b339ebda17'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:46.943837 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a64010f7-7b72-4d1c-96ca-16cc3a5b1fbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '908a6895d6e94b04961621b339ebda17'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:46.945389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a64010f7-7b72-4d1c-96ca-16cc3a5b1fbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '908a6895d6e94b04961621b339ebda17'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:46.950687 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-cb2abce6-c796-41f6-93da-24ae5957972e None None] MFA Rules not processed for user `888bda8e3665469cafd6739ae3423bab`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:46.951999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cb2abce6-c796-41f6-93da-24ae5957972e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:46.955869 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a64010f7-7b72-4d1c-96ca-16cc3a5b1fbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '908a6895d6e94b04961621b339ebda17'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:46.995889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 876/1720] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:44:46 2022] DELETE /identity/v3/users/908a6895d6e94b04961621b339ebda17 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:46.997597 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff123121-5e56-4f58-900c-5b8e89c78d63 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:47.000218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff123121-5e56-4f58-900c-5b8e89c78d63 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:47.000652 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff123121-5e56-4f58-900c-5b8e89c78d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:47.053232 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 845/1721] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:47.054158 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2abce6-c796-41f6-93da-24ae5957972e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:47.069212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ff123121-5e56-4f58-900c-5b8e89c78d63 None None] MFA Rules not processed for user `a408f37c235943b39fad27820938b442`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:47.070468 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ff123121-5e56-4f58-900c-5b8e89c78d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:47.086237 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cb2abce6-c796-41f6-93da-24ae5957972e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:47.118232 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2abce6-c796-41f6-93da-24ae5957972e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:47.148738 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:47.219921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 877/1722] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:47.224919 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff123121-5e56-4f58-900c-5b8e89c78d63 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:47.227680 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0bc0e-e39b-48a0-bbfd-d2b29c85d030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:47.228601 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0bc0e-e39b-48a0-bbfd-d2b29c85d030 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:47.229036 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0bc0e-e39b-48a0-bbfd-d2b29c85d030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:47.229523 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0bc0e-e39b-48a0-bbfd-d2b29c85d030 admin admin] PATH_INFO: `/v3/projects/8b33c619268548e59a4892d92486ac6a/users/209bb32b99a04486bb2f0862ad3875ec/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:47.230366 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ff123121-5e56-4f58-900c-5b8e89c78d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:47.250508 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a0bc0e-e39b-48a0-bbfd-d2b29c85d030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b33c619268548e59a4892d92486ac6a, user_id=209bb32b99a04486bb2f0862ad3875ec, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:47.253583 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a0bc0e-e39b-48a0-bbfd-d2b29c85d030 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:47.286736 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff123121-5e56-4f58-900c-5b8e89c78d63 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:47.289045 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 846/1723] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:47 2022] PUT /identity/v3/projects/8b33c619268548e59a4892d92486ac6a/users/209bb32b99a04486bb2f0862ad3875ec/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:47.291696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0bc0e-e39b-48a0-bbfd-d2b29c85d030 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:47.302113 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-64a0bc0e-e39b-48a0-bbfd-d2b29c85d030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:47.423659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2dbd9-272e-40b6-9e16-ec42daada4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:47.425211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2dbd9-272e-40b6-9e16-ec42daada4c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:47.425501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2dbd9-272e-40b6-9e16-ec42daada4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:47.425780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2dbd9-272e-40b6-9e16-ec42daada4c6 admin admin] PATH_INFO: `/v3/projects/fdc363fc7e7b491cb829e9059b256488/users/01ab68e564d14c4998b1037ee5ec846a/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:47.427942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2dbd9-272e-40b6-9e16-ec42daada4c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc363fc7e7b491cb829e9059b256488, user_id=01ab68e564d14c4998b1037ee5ec846a, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:47.430728 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2dbd9-272e-40b6-9e16-ec42daada4c6 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:47.456640 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 878/1724] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:47 2022] PUT /identity/v3/projects/fdc363fc7e7b491cb829e9059b256488/users/01ab68e564d14c4998b1037ee5ec846a/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:47.458702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d1ff7-fe14-4ddf-a5b5-15ddd9d449cf None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:47.459142 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d1ff7-fe14-4ddf-a5b5-15ddd9d449cf None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:47.459561 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d1ff7-fe14-4ddf-a5b5-15ddd9d449cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:47.466743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0bc0e-e39b-48a0-bbfd-d2b29c85d030 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:47.477168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:47.500074 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-871d1ff7-fe14-4ddf-a5b5-15ddd9d449cf None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:47.501198 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-871d1ff7-fe14-4ddf-a5b5-15ddd9d449cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:47.579380 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee3268-d75b-4dc5-ae53-140458f89f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:47.580358 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee3268-d75b-4dc5-ae53-140458f89f17 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:47.580840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee3268-d75b-4dc5-ae53-140458f89f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:47.581957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee3268-d75b-4dc5-ae53-140458f89f17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:47.582813 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee3268-d75b-4dc5-ae53-140458f89f17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:47.584957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee3268-d75b-4dc5-ae53-140458f89f17 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:47.612269 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 879/1725] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:47.618590 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 847/1726] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:44:47 2022] POST /identity/v3/projects => generated 385 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:47.621259 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee3268-d75b-4dc5-ae53-140458f89f17 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:47.621399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d1ff7-fe14-4ddf-a5b5-15ddd9d449cf None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:47.623104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-871d1ff7-fe14-4ddf-a5b5-15ddd9d449cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:47.644186 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d1ff7-fe14-4ddf-a5b5-15ddd9d449cf None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:47.744033 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17baef4c-3c76-4381-8d8a-daba2aec9341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:47.745690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baef4c-3c76-4381-8d8a-daba2aec9341 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:47.747790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baef4c-3c76-4381-8d8a-daba2aec9341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:47.748269 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baef4c-3c76-4381-8d8a-daba2aec9341 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:47.749444 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17baef4c-3c76-4381-8d8a-daba2aec9341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:47.752824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17baef4c-3c76-4381-8d8a-daba2aec9341 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:47.765977 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee3268-d75b-4dc5-ae53-140458f89f17 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:47.777308 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd11f1-7a46-4a70-bb9b-c2b87a05efab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:47.777934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd11f1-7a46-4a70-bb9b-c2b87a05efab admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:47.778221 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd11f1-7a46-4a70-bb9b-c2b87a05efab admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:47.778599 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd11f1-7a46-4a70-bb9b-c2b87a05efab admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:47.779154 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd11f1-7a46-4a70-bb9b-c2b87a05efab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:47.780790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd11f1-7a46-4a70-bb9b-c2b87a05efab admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:47.792229 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:47.803414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 880/1727] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:44:47 2022] POST /identity/v3/projects => generated 363 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:47.804500 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17baef4c-3c76-4381-8d8a-daba2aec9341 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:47.805310 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 848/1728] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:47.813681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319a4c2-8b62-48c9-8957-e8b57e476ad9 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:47.814275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319a4c2-8b62-48c9-8957-e8b57e476ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:47.814647 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319a4c2-8b62-48c9-8957-e8b57e476ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:47.815559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-17baef4c-3c76-4381-8d8a-daba2aec9341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:47.865284 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a319a4c2-8b62-48c9-8957-e8b57e476ad9 None None] MFA Rules not processed for user `01ab68e564d14c4998b1037ee5ec846a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:47.867185 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a319a4c2-8b62-48c9-8957-e8b57e476ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:47.926773 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17baef4c-3c76-4381-8d8a-daba2aec9341 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:47.933454 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc51b4-a8d1-4e49-a2de-00693a971002 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed987b44d934ac7b2dc64c0aab28099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:47.934077 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc51b4-a8d1-4e49-a2de-00693a971002 service placement] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:47.934486 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc51b4-a8d1-4e49-a2de-00693a971002 service placement] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:47.934754 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc51b4-a8d1-4e49-a2de-00693a971002 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:47.936474 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b2dc51b4-a8d1-4e49-a2de-00693a971002 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:47.949598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc51b4-a8d1-4e49-a2de-00693a971002 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:47.951141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc51b4-a8d1-4e49-a2de-00693a971002 service placement] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:47.952926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 849/1729] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:47.953662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319a4c2-8b62-48c9-8957-e8b57e476ad9 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:47.967098 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 881/1730] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:47.968235 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc51b4-a8d1-4e49-a2de-00693a971002 service placement] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:47.969836 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b2dc51b4-a8d1-4e49-a2de-00693a971002 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:47.976584 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:48.031350 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319a4c2-8b62-48c9-8957-e8b57e476ad9 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:48.036460 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b7141-72af-4843-9711-5c0999167cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:48.037162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b7141-72af-4843-9711-5c0999167cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:48.037524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b7141-72af-4843-9711-5c0999167cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:48.037873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b7141-72af-4843-9711-5c0999167cf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:48.038587 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b7141-72af-4843-9711-5c0999167cf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:48.040568 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc51b4-a8d1-4e49-a2de-00693a971002 service placement] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:48.040988 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b7141-72af-4843-9711-5c0999167cf1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:48.045566 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6457b3b-cd86-4993-b024-80ca581c074d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:48.046255 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6457b3b-cd86-4993-b024-80ca581c074d service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:48.046611 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6457b3b-cd86-4993-b024-80ca581c074d service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:48.046953 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6457b3b-cd86-4993-b024-80ca581c074d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:48.062359 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6457b3b-cd86-4993-b024-80ca581c074d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:48.064273 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6457b3b-cd86-4993-b024-80ca581c074d service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:48.075706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 850/1731] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:44:47 2022] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:48.075706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b7141-72af-4843-9711-5c0999167cf1 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:48.095753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b7141-72af-4843-9711-5c0999167cf1 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:48.096488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 882/1732] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:48.100282 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6457b3b-cd86-4993-b024-80ca581c074d service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:48.109808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca64a80-ef3d-4e99-8645-bc9bcdf90a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:48.110647 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca64a80-ef3d-4e99-8645-bc9bcdf90a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:48.110938 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca64a80-ef3d-4e99-8645-bc9bcdf90a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:48.111215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca64a80-ef3d-4e99-8645-bc9bcdf90a2c admin admin] PATH_INFO: `/v3/projects/8b33c619268548e59a4892d92486ac6a/users/209bb32b99a04486bb2f0862ad3875ec/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:48.114416 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca64a80-ef3d-4e99-8645-bc9bcdf90a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b33c619268548e59a4892d92486ac6a, user_id=209bb32b99a04486bb2f0862ad3875ec, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:48.125701 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6457b3b-cd86-4993-b024-80ca581c074d service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:48.130409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca64a80-ef3d-4e99-8645-bc9bcdf90a2c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:48.138446 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3ab80-281e-4a10-b3db-7cd1e16ab09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:48.139265 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3ab80-281e-4a10-b3db-7cd1e16ab09d admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:48.139486 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3ab80-281e-4a10-b3db-7cd1e16ab09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:48.140388 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3ab80-281e-4a10-b3db-7cd1e16ab09d admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:48.142100 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3ab80-281e-4a10-b3db-7cd1e16ab09d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:48.146055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3ab80-281e-4a10-b3db-7cd1e16ab09d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:48.160830 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 851/1733] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:48 2022] PUT /identity/v3/projects/8b33c619268548e59a4892d92486ac6a/users/209bb32b99a04486bb2f0862ad3875ec/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:48.160830 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cda45f-236a-4cff-b7c0-d78ab7be4f81 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:48.160830 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cda45f-236a-4cff-b7c0-d78ab7be4f81 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:48.160830 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cda45f-236a-4cff-b7c0-d78ab7be4f81 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:48.168483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 852/1734] 10.222.0.52 () {54 vars in 912 bytes} [Thu Sep 15 00:44:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:44:48.168873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cda45f-236a-4cff-b7c0-d78ab7be4f81 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:48.178109 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-87cda45f-236a-4cff-b7c0-d78ab7be4f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:48.205036 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 883/1735] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:44:48 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:48.207075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3ab80-281e-4a10-b3db-7cd1e16ab09d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:48.236301 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3ab80-281e-4a10-b3db-7cd1e16ab09d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:48.282900 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cda45f-236a-4cff-b7c0-d78ab7be4f81 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:48.298463 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d9a80-6433-48fb-b682-2a5ce7ded95e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:48.299737 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d9a80-6433-48fb-b682-2a5ce7ded95e service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:48.300032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d9a80-6433-48fb-b682-2a5ce7ded95e service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:48.300579 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d9a80-6433-48fb-b682-2a5ce7ded95e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:48.395531 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efdb70b-5509-45ca-a001-cac3f061254e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:48.396515 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efdb70b-5509-45ca-a001-cac3f061254e admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:48.396869 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efdb70b-5509-45ca-a001-cac3f061254e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:48.397318 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efdb70b-5509-45ca-a001-cac3f061254e admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:48.398023 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efdb70b-5509-45ca-a001-cac3f061254e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:48.405405 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efdb70b-5509-45ca-a001-cac3f061254e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:48.422925 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 884/1736] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:48.428183 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5117bd-9a25-4334-aa47-2525c7e6c563 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:48.430071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5117bd-9a25-4334-aa47-2525c7e6c563 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:48.430687 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5117bd-9a25-4334-aa47-2525c7e6c563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:48.431998 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d9a80-6433-48fb-b682-2a5ce7ded95e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:48.436388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d9a80-6433-48fb-b682-2a5ce7ded95e service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:48.457209 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 853/1737] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:48.458501 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09ed81-eb97-435d-b11c-b9e9682ae3b6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:48.458823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09ed81-eb97-435d-b11c-b9e9682ae3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:48.459070 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09ed81-eb97-435d-b11c-b9e9682ae3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:48.490333 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-9b5117bd-9a25-4334-aa47-2525c7e6c563 None None] MFA Rules not processed for user `50ec251be76543b4ad97442664db6858`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:48.492413 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9b5117bd-9a25-4334-aa47-2525c7e6c563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:48.508672 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:48.520742 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-de09ed81-eb97-435d-b11c-b9e9682ae3b6 None None] MFA Rules not processed for user `209bb32b99a04486bb2f0862ad3875ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:48.522894 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-de09ed81-eb97-435d-b11c-b9e9682ae3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:48.641770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:48.660623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 885/1738] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 15 00:44:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:48.661636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5117bd-9a25-4334-aa47-2525c7e6c563 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:48.691799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5117bd-9a25-4334-aa47-2525c7e6c563 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:48.705952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bebae-9a25-49aa-8c8c-392c7c7c3538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:48.707290 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bebae-9a25-49aa-8c8c-392c7c7c3538 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:48.708204 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bebae-9a25-49aa-8c8c-392c7c7c3538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:48.709662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bebae-9a25-49aa-8c8c-392c7c7c3538 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:48.712428 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bebae-9a25-49aa-8c8c-392c7c7c3538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:48.717222 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bebae-9a25-49aa-8c8c-392c7c7c3538 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:48.741220 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 886/1739] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:48.742380 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bebae-9a25-49aa-8c8c-392c7c7c3538 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:48.755352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bebae-9a25-49aa-8c8c-392c7c7c3538 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:48.761496 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7550b6-5611-4e8f-84e0-0cedbe8f55b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:48.762425 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7550b6-5611-4e8f-84e0-0cedbe8f55b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:48.762716 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7550b6-5611-4e8f-84e0-0cedbe8f55b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:48.762987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7550b6-5611-4e8f-84e0-0cedbe8f55b4 admin admin] PATH_INFO: `/v3/projects/a64f030efded461f91cdb0985f2a3432/users/9705c576743c435285aa2b99eb542b6e/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:48.766597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 854/1740] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:48.767558 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09ed81-eb97-435d-b11c-b9e9682ae3b6 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:48.787302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7550b6-5611-4e8f-84e0-0cedbe8f55b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a64f030efded461f91cdb0985f2a3432, user_id=9705c576743c435285aa2b99eb542b6e, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:48.790357 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7550b6-5611-4e8f-84e0-0cedbe8f55b4 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:48.791667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09ed81-eb97-435d-b11c-b9e9682ae3b6 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:48.800918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d74091-b69d-4241-b54a-e163ad337a7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:48.802588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d74091-b69d-4241-b54a-e163ad337a7e service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:48.803860 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d74091-b69d-4241-b54a-e163ad337a7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:48.804953 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d74091-b69d-4241-b54a-e163ad337a7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:48.812130 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d4d74091-b69d-4241-b54a-e163ad337a7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:48.825430 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 887/1741] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:48 2022] PUT /identity/v3/projects/a64f030efded461f91cdb0985f2a3432/users/9705c576743c435285aa2b99eb542b6e/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:48.826784 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7550b6-5611-4e8f-84e0-0cedbe8f55b4 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:48.831449 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0c7550b6-5611-4e8f-84e0-0cedbe8f55b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:48.934327 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d74091-b69d-4241-b54a-e163ad337a7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:48.934690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d74091-b69d-4241-b54a-e163ad337a7e service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:48.939649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7550b6-5611-4e8f-84e0-0cedbe8f55b4 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:48.945839 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c8db0-bde6-4e74-91fe-5203dad18c66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:48.946472 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c8db0-bde6-4e74-91fe-5203dad18c66 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:48.946759 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c8db0-bde6-4e74-91fe-5203dad18c66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:48.946891 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 855/1742] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:48.947122 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c8db0-bde6-4e74-91fe-5203dad18c66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:48.948369 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d74091-b69d-4241-b54a-e163ad337a7e service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:48.959465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c8db0-bde6-4e74-91fe-5203dad18c66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:48.961256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c8db0-bde6-4e74-91fe-5203dad18c66 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:48.961563 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d74091-b69d-4241-b54a-e163ad337a7e service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:48.972782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 888/1743] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:48.974282 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c8db0-bde6-4e74-91fe-5203dad18c66 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:48.975923 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-866c8db0-bde6-4e74-91fe-5203dad18c66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:49.039827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c486b-1fd1-4c97-9099-09b0839dca79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:49.042354 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c486b-1fd1-4c97-9099-09b0839dca79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:49.042989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c486b-1fd1-4c97-9099-09b0839dca79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:49.043641 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c486b-1fd1-4c97-9099-09b0839dca79 admin admin] PATH_INFO: `/v3/projects/9f61b803017b4a9487091510d6d62e10/users/20a0fc4f582d4a0fb0fc16e8cc672d47/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:49.081250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c486b-1fd1-4c97-9099-09b0839dca79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f61b803017b4a9487091510d6d62e10, user_id=20a0fc4f582d4a0fb0fc16e8cc672d47, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:49.089434 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c486b-1fd1-4c97-9099-09b0839dca79 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:49.096372 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c8db0-bde6-4e74-91fe-5203dad18c66 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:49.105107 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87c39a-2a0f-4faa-beae-31b86d7b1a8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:49.106266 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87c39a-2a0f-4faa-beae-31b86d7b1a8d service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:49.106658 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87c39a-2a0f-4faa-beae-31b86d7b1a8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:49.106945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87c39a-2a0f-4faa-beae-31b86d7b1a8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:49.137232 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 856/1744] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:48 2022] PUT /identity/v3/projects/9f61b803017b4a9487091510d6d62e10/users/20a0fc4f582d4a0fb0fc16e8cc672d47/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:49.137232 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c486b-1fd1-4c97-9099-09b0839dca79 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:49.253417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:49.290144 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87c39a-2a0f-4faa-beae-31b86d7b1a8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:49.291607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87c39a-2a0f-4faa-beae-31b86d7b1a8d service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:49.297466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:49.314857 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c486b-1fd1-4c97-9099-09b0839dca79 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:49.323832 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 889/1745] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:49.324953 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87c39a-2a0f-4faa-beae-31b86d7b1a8d service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:49.331306 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8a87c39a-2a0f-4faa-beae-31b86d7b1a8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:49.345148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01457047-9874-401c-9f4c-0eeb16f4d609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:49.346199 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01457047-9874-401c-9f4c-0eeb16f4d609 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:49.346510 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01457047-9874-401c-9f4c-0eeb16f4d609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:49.346825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01457047-9874-401c-9f4c-0eeb16f4d609 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:49.348884 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01457047-9874-401c-9f4c-0eeb16f4d609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:49.351529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01457047-9874-401c-9f4c-0eeb16f4d609 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:49.370826 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 857/1746] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:49.371880 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01457047-9874-401c-9f4c-0eeb16f4d609 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:49.377633 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87c39a-2a0f-4faa-beae-31b86d7b1a8d service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:49.383576 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01457047-9874-401c-9f4c-0eeb16f4d609 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:49.386599 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae00920-9826-4421-b83e-8780eea9a5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:49.387441 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae00920-9826-4421-b83e-8780eea9a5e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:49.387857 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae00920-9826-4421-b83e-8780eea9a5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:49.388258 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae00920-9826-4421-b83e-8780eea9a5e0 admin admin] PATH_INFO: `/v3/projects/78acf048669441758aba2dce0b2658b4` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:49.389036 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe51f5-12b5-46b7-a804-5520c60c109a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:49.389773 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe51f5-12b5-46b7-a804-5520c60c109a admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:49.389987 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe51f5-12b5-46b7-a804-5520c60c109a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:49.390261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe51f5-12b5-46b7-a804-5520c60c109a admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:49.390438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae00920-9826-4421-b83e-8780eea9a5e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78acf048669441758aba2dce0b2658b4)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:49.390897 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe51f5-12b5-46b7-a804-5520c60c109a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:49.392893 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae00920-9826-4421-b83e-8780eea9a5e0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:49.393011 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe51f5-12b5-46b7-a804-5520c60c109a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:49.414447 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 858/1747] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:49.415702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe51f5-12b5-46b7-a804-5520c60c109a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:49.429807 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe51f5-12b5-46b7-a804-5520c60c109a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:49.449133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed293e-85d9-426d-b2a0-1344ec96494f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:49.451359 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed293e-85d9-426d-b2a0-1344ec96494f admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:49.452276 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed293e-85d9-426d-b2a0-1344ec96494f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:49.452885 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed293e-85d9-426d-b2a0-1344ec96494f admin admin] PATH_INFO: `/v3/projects/a64f030efded461f91cdb0985f2a3432/users/9705c576743c435285aa2b99eb542b6e/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:49.459781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed293e-85d9-426d-b2a0-1344ec96494f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a64f030efded461f91cdb0985f2a3432, user_id=9705c576743c435285aa2b99eb542b6e, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:49.463420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed293e-85d9-426d-b2a0-1344ec96494f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:49.491575 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 859/1748] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:49 2022] PUT /identity/v3/projects/a64f030efded461f91cdb0985f2a3432/users/9705c576743c435285aa2b99eb542b6e/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:49.495195 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed293e-85d9-426d-b2a0-1344ec96494f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:49.498542 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6ae00920-9826-4421-b83e-8780eea9a5e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78acf048669441758aba2dce0b2658b4', 'request_id': 'req-6ae00920-9826-4421-b83e-8780eea9a5e0'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:49.515599 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6ae00920-9826-4421-b83e-8780eea9a5e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78acf048669441758aba2dce0b2658b4', 'request_id': 'req-6ae00920-9826-4421-b83e-8780eea9a5e0'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:49.538791 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6ae00920-9826-4421-b83e-8780eea9a5e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78acf048669441758aba2dce0b2658b4', 'request_id': 'req-6ae00920-9826-4421-b83e-8780eea9a5e0'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:49.560429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6ae00920-9826-4421-b83e-8780eea9a5e0 admin admin] The token cache is being invalidate because project 78acf048669441758aba2dce0b2658b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:44:49.560880 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6ae00920-9826-4421-b83e-8780eea9a5e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:49.561861 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6ae00920-9826-4421-b83e-8780eea9a5e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:49.564648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 890/1749] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:44:49 2022] DELETE /identity/v3/projects/78acf048669441758aba2dce0b2658b4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:49.565639 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae00920-9826-4421-b83e-8780eea9a5e0 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:49.567215 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6ae00920-9826-4421-b83e-8780eea9a5e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:49.590444 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed293e-85d9-426d-b2a0-1344ec96494f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:49.600434 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa73422-793f-4473-9d31-5df185998db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:49.601394 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa73422-793f-4473-9d31-5df185998db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:49.602045 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa73422-793f-4473-9d31-5df185998db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:49.602463 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa73422-793f-4473-9d31-5df185998db4 admin admin] PATH_INFO: `/v3/projects/9f61b803017b4a9487091510d6d62e10/users/20a0fc4f582d4a0fb0fc16e8cc672d47/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:49.605395 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa73422-793f-4473-9d31-5df185998db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f61b803017b4a9487091510d6d62e10, user_id=20a0fc4f582d4a0fb0fc16e8cc672d47, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:49.608268 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa73422-793f-4473-9d31-5df185998db4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:49.621303 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 860/1750] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:49 2022] PUT /identity/v3/projects/9f61b803017b4a9487091510d6d62e10/users/20a0fc4f582d4a0fb0fc16e8cc672d47/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:49.622776 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1f1c1-41e6-4b1a-a387-7a4152b89bc9 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:49.623307 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1f1c1-41e6-4b1a-a387-7a4152b89bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:49.623672 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1f1c1-41e6-4b1a-a387-7a4152b89bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:49.701653 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-dfa1f1c1-41e6-4b1a-a387-7a4152b89bc9 None None] MFA Rules not processed for user `9705c576743c435285aa2b99eb542b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:49.703006 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-dfa1f1c1-41e6-4b1a-a387-7a4152b89bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:49.719265 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae00920-9826-4421-b83e-8780eea9a5e0 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:49.877288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afceb634-422d-487f-bb1b-6d5433eec058 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:49.881371 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceb634-422d-487f-bb1b-6d5433eec058 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:49.881898 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceb634-422d-487f-bb1b-6d5433eec058 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:49.882689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceb634-422d-487f-bb1b-6d5433eec058 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:49.889459 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-afceb634-422d-487f-bb1b-6d5433eec058 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:49.897490 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 861/1751] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:49.897490 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e0715-71c9-4d54-a8c4-05aba5baa02f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:49.897490 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e0715-71c9-4d54-a8c4-05aba5baa02f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:49.897773 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e0715-71c9-4d54-a8c4-05aba5baa02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:49.947711 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a43e0715-71c9-4d54-a8c4-05aba5baa02f None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:49.950283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a43e0715-71c9-4d54-a8c4-05aba5baa02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:49.981751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:50.041853 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:50.060202 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afceb634-422d-487f-bb1b-6d5433eec058 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:50.061682 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afceb634-422d-487f-bb1b-6d5433eec058 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:50.092334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 891/1752] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:50.094673 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab5a80-757d-4302-b1db-892962c6e4d6 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:50.095263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab5a80-757d-4302-b1db-892962c6e4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:50.095715 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 862/1753] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:50.096574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab5a80-757d-4302-b1db-892962c6e4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:50.104370 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f60ff-eaa2-4f33-bb6b-354543226f40 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:50.104760 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f60ff-eaa2-4f33-bb6b-354543226f40 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:50.104926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f60ff-eaa2-4f33-bb6b-354543226f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:50.140920 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0a9f60ff-eaa2-4f33-bb6b-354543226f40 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:50.142187 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0a9f60ff-eaa2-4f33-bb6b-354543226f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:50.162330 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-92ab5a80-757d-4302-b1db-892962c6e4d6 None None] MFA Rules not processed for user `20a0fc4f582d4a0fb0fc16e8cc672d47`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:50.162330 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-92ab5a80-757d-4302-b1db-892962c6e4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:50.164389 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 863/1754] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:50.171622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f60ff-eaa2-4f33-bb6b-354543226f40 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:50.188997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f60ff-eaa2-4f33-bb6b-354543226f40 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:50.198177 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15da49-ce4e-452f-ba7c-9f3d625c424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:50.198801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15da49-ce4e-452f-ba7c-9f3d625c424d admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:50.199084 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15da49-ce4e-452f-ba7c-9f3d625c424d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:50.199446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15da49-ce4e-452f-ba7c-9f3d625c424d admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:50.199995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15da49-ce4e-452f-ba7c-9f3d625c424d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:44:50.200308 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15da49-ce4e-452f-ba7c-9f3d625c424d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:50.201970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15da49-ce4e-452f-ba7c-9f3d625c424d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:50.238124 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 864/1755] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:44:50.238680 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15da49-ce4e-452f-ba7c-9f3d625c424d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:50.252942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15da49-ce4e-452f-ba7c-9f3d625c424d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:50.264460 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4e174-5966-472a-ba6b-332d1e4e7cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:50.265097 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4e174-5966-472a-ba6b-332d1e4e7cfe admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:50.265382 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4e174-5966-472a-ba6b-332d1e4e7cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:50.265656 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4e174-5966-472a-ba6b-332d1e4e7cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:50.266296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4e174-5966-472a-ba6b-332d1e4e7cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:50.268395 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4e174-5966-472a-ba6b-332d1e4e7cfe admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:50.348689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 892/1756] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:50.364785 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab5a80-757d-4302-b1db-892962c6e4d6 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:50.364926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 865/1757] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:44:50 2022] POST /identity/v3/projects => generated 403 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:50.389126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab5a80-757d-4302-b1db-892962c6e4d6 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:50.434684 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4e174-5966-472a-ba6b-332d1e4e7cfe admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:50.436910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6fc4e174-5966-472a-ba6b-332d1e4e7cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:50.577356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f9e8b-35a3-4831-8d29-45f1b88ea280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:50.578050 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f9e8b-35a3-4831-8d29-45f1b88ea280 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:50.578402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f9e8b-35a3-4831-8d29-45f1b88ea280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:50.579104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f9e8b-35a3-4831-8d29-45f1b88ea280 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:50.579747 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f9e8b-35a3-4831-8d29-45f1b88ea280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:50.581898 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f9e8b-35a3-4831-8d29-45f1b88ea280 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:50.626444 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4e174-5966-472a-ba6b-332d1e4e7cfe admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:50.639799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 893/1758] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:44:50 2022] POST /identity/v3/users => generated 302 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:50.641573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f9e8b-35a3-4831-8d29-45f1b88ea280 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:50.659259 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa02e42-a62b-4ad2-9298-3eee15f4c608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:50.660801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa02e42-a62b-4ad2-9298-3eee15f4c608 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:50.661113 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa02e42-a62b-4ad2-9298-3eee15f4c608 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:50.661462 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa02e42-a62b-4ad2-9298-3eee15f4c608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:50.677935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f9e8b-35a3-4831-8d29-45f1b88ea280 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:50.697157 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8d7aa-42b6-44a8-87da-d344391a6c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:50.699356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8d7aa-42b6-44a8-87da-d344391a6c6c admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:50.701137 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8d7aa-42b6-44a8-87da-d344391a6c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:50.701722 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8d7aa-42b6-44a8-87da-d344391a6c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:50.702512 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8d7aa-42b6-44a8-87da-d344391a6c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:50.708688 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8d7aa-42b6-44a8-87da-d344391a6c6c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:50.755513 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 894/1759] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:50.758852 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8d7aa-42b6-44a8-87da-d344391a6c6c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:50.827604 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8d7aa-42b6-44a8-87da-d344391a6c6c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:50.848205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfd62a-2f81-455b-ae94-2a8fa85db335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:50.849938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfd62a-2f81-455b-ae94-2a8fa85db335 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:50.850229 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfd62a-2f81-455b-ae94-2a8fa85db335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:50.850539 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfd62a-2f81-455b-ae94-2a8fa85db335 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:50.851356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfd62a-2f81-455b-ae94-2a8fa85db335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:50.852777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cfd62a-2f81-455b-ae94-2a8fa85db335 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:50.885723 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa02e42-a62b-4ad2-9298-3eee15f4c608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:50.887878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa02e42-a62b-4ad2-9298-3eee15f4c608 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:50.900701 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 866/1760] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:50.901763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa02e42-a62b-4ad2-9298-3eee15f4c608 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:50.917889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 895/1761] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:50.919439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa02e42-a62b-4ad2-9298-3eee15f4c608 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:50.920595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfd62a-2f81-455b-ae94-2a8fa85db335 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:50.928017 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb47fe-f997-4c1c-bbd3-70616eab3144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:50.928837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb47fe-f997-4c1c-bbd3-70616eab3144 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:50.929196 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb47fe-f997-4c1c-bbd3-70616eab3144 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:50.929702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb47fe-f997-4c1c-bbd3-70616eab3144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:50.954758 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfd62a-2f81-455b-ae94-2a8fa85db335 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:50.996322 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb2f6c-d56f-46ed-a102-dead966d339b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:50.997033 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb2f6c-d56f-46ed-a102-dead966d339b admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:50.997340 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb2f6c-d56f-46ed-a102-dead966d339b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:50.997619 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb2f6c-d56f-46ed-a102-dead966d339b admin admin] PATH_INFO: `/v3/projects/2327f065b97a471abae3079d394dcbc6/users/c16047d7587747f88fc8237cfc28b7d2/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:51.027282 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb2f6c-d56f-46ed-a102-dead966d339b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2327f065b97a471abae3079d394dcbc6, user_id=c16047d7587747f88fc8237cfc28b7d2, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:51.030050 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb2f6c-d56f-46ed-a102-dead966d339b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:51.042607 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:51.046072 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:51.058062 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 896/1762] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:50 2022] PUT /identity/v3/projects/2327f065b97a471abae3079d394dcbc6/users/c16047d7587747f88fc8237cfc28b7d2/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:51.063219 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f8c5e-66a0-4ade-ae27-86508de843e8 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:51.063762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f8c5e-66a0-4ade-ae27-86508de843e8 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:51.064218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f8c5e-66a0-4ade-ae27-86508de843e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:51.082399 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb47fe-f997-4c1c-bbd3-70616eab3144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:51.083892 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb47fe-f997-4c1c-bbd3-70616eab3144 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:51.102557 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f03f8c5e-66a0-4ade-ae27-86508de843e8 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:51.104391 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f03f8c5e-66a0-4ade-ae27-86508de843e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:51.108509 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 867/1763] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:51.257375 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 897/1764] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:51.257902 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb47fe-f997-4c1c-bbd3-70616eab3144 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:51.259466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4dcb47fe-f997-4c1c-bbd3-70616eab3144 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:51.275745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e080d-6484-4860-bac1-1ea61b037e59 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:51.276205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e080d-6484-4860-bac1-1ea61b037e59 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:51.276962 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e080d-6484-4860-bac1-1ea61b037e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:51.414048 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f87e080d-6484-4860-bac1-1ea61b037e59 None None] MFA Rules not processed for user `ed49a596f15542a29ce331bae4640274`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:51.431642 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f87e080d-6484-4860-bac1-1ea61b037e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:51.463535 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb47fe-f997-4c1c-bbd3-70616eab3144 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:51.573223 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a1152-b282-4233-87f0-87f0b2630625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:51.573950 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a1152-b282-4233-87f0-87f0b2630625 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:51.574307 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a1152-b282-4233-87f0-87f0b2630625 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:51.574595 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a1152-b282-4233-87f0-87f0b2630625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:51.594990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a1152-b282-4233-87f0-87f0b2630625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:51.599084 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a1152-b282-4233-87f0-87f0b2630625 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:51.623110 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 868/1765] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:44:51.624429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a1152-b282-4233-87f0-87f0b2630625 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:51.705107 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 898/1766] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 15 00:44:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:44:51.728803 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a1152-b282-4233-87f0-87f0b2630625 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:51.735114 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908074ac-5f8e-402e-b548-89787d4fb7b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:51.736748 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908074ac-5f8e-402e-b548-89787d4fb7b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:51.736748 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908074ac-5f8e-402e-b548-89787d4fb7b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:51.736748 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908074ac-5f8e-402e-b548-89787d4fb7b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:51.739359 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-908074ac-5f8e-402e-b548-89787d4fb7b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:51.892623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908074ac-5f8e-402e-b548-89787d4fb7b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:51.895341 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908074ac-5f8e-402e-b548-89787d4fb7b5 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:51.902818 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:51.927793 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 869/1767] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:52.020587 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e080d-6484-4860-bac1-1ea61b037e59 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:52.022462 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f87e080d-6484-4860-bac1-1ea61b037e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:52.233027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:52.282012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e080d-6484-4860-bac1-1ea61b037e59 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:52.295964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f6a18-6d67-41c0-9fb3-cf487cc0a473 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb248b85aba45b39132d0f92ede0b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:52.296610 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f6a18-6d67-41c0-9fb3-cf487cc0a473 service swift] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:52.299313 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f6a18-6d67-41c0-9fb3-cf487cc0a473 service swift] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:52.299741 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f6a18-6d67-41c0-9fb3-cf487cc0a473 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:52.336769 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f6a18-6d67-41c0-9fb3-cf487cc0a473 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:52.336769 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f6a18-6d67-41c0-9fb3-cf487cc0a473 service swift] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:52.365405 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 899/1768] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 15 00:44:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 00:44:53.301253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f410df-0acf-47d6-932c-33a69343a5f0 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:53.301253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f410df-0acf-47d6-932c-33a69343a5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:53.301253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f410df-0acf-47d6-932c-33a69343a5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:53.301989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9262a2-34ea-422d-8e66-6621f7a08328 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:53.301989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9262a2-34ea-422d-8e66-6621f7a08328 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:53.302409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9262a2-34ea-422d-8e66-6621f7a08328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:53.387379 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-83f410df-0acf-47d6-932c-33a69343a5f0 None None] MFA Rules not processed for user `50ec251be76543b4ad97442664db6858`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:53.391097 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-83f410df-0acf-47d6-932c-33a69343a5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:53.423570 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 900/1769] 10.222.0.55 () {58 vars in 1015 bytes} [Thu Sep 15 00:44:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:53.424245 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-7a9262a2-34ea-422d-8e66-6621f7a08328 None None] MFA Rules not processed for user `c16047d7587747f88fc8237cfc28b7d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:53.431371 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7a9262a2-34ea-422d-8e66-6621f7a08328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:53.445607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f410df-0acf-47d6-932c-33a69343a5f0 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:53.447933 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-83f410df-0acf-47d6-932c-33a69343a5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:53.474721 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f410df-0acf-47d6-932c-33a69343a5f0 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:53.486530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1705a1-0973-456b-a1f1-ba1c5602466a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:53.487425 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1705a1-0973-456b-a1f1-ba1c5602466a service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:53.487795 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1705a1-0973-456b-a1f1-ba1c5602466a service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:53.488237 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1705a1-0973-456b-a1f1-ba1c5602466a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:53.507140 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1705a1-0973-456b-a1f1-ba1c5602466a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:53.508987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1705a1-0973-456b-a1f1-ba1c5602466a service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:53.520912 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 901/1770] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:53.686263 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 870/1771] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:53 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:53.687586 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1705a1-0973-456b-a1f1-ba1c5602466a service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:53.718273 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1705a1-0973-456b-a1f1-ba1c5602466a service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:53.728069 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e5cd1-67be-4a2e-8daa-dd8c36ce1ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:53.729508 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e5cd1-67be-4a2e-8daa-dd8c36ce1ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:53.730759 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e5cd1-67be-4a2e-8daa-dd8c36ce1ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:53.730973 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e5cd1-67be-4a2e-8daa-dd8c36ce1ed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:53.731608 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e5cd1-67be-4a2e-8daa-dd8c36ce1ed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:53.733609 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e5cd1-67be-4a2e-8daa-dd8c36ce1ed7 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:53.808080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 902/1772] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:44:53 2022] POST /identity/v3/projects => generated 405 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:53.815682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9262a2-34ea-422d-8e66-6621f7a08328 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:53.829116 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9262a2-34ea-422d-8e66-6621f7a08328 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:53.921192 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef2d5a-98e5-4bb6-9d78-84e3cd658afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:53.922113 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef2d5a-98e5-4bb6-9d78-84e3cd658afe admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:53.922384 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef2d5a-98e5-4bb6-9d78-84e3cd658afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:53.924871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef2d5a-98e5-4bb6-9d78-84e3cd658afe admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:53.926758 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef2d5a-98e5-4bb6-9d78-84e3cd658afe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:53.929485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e5cd1-67be-4a2e-8daa-dd8c36ce1ed7 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:53.942137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef2d5a-98e5-4bb6-9d78-84e3cd658afe admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:54.045914 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 871/1773] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:44:53 2022] POST /identity/v3/users => generated 309 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:44:54.054921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef2d5a-98e5-4bb6-9d78-84e3cd658afe admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:54.092750 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef2d5a-98e5-4bb6-9d78-84e3cd658afe admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:54.114643 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6d136-3b13-4e39-9dfe-aacf8749b96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:54.115398 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6d136-3b13-4e39-9dfe-aacf8749b96a admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:54.115685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6d136-3b13-4e39-9dfe-aacf8749b96a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:54.115958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6d136-3b13-4e39-9dfe-aacf8749b96a admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:54.116721 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6d136-3b13-4e39-9dfe-aacf8749b96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:54.121493 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6d136-3b13-4e39-9dfe-aacf8749b96a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:54.144311 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 872/1774] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:54.144968 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6d136-3b13-4e39-9dfe-aacf8749b96a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:54.150282 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e5cd1-67be-4a2e-8daa-dd8c36ce1ed7 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:54.154925 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5d8ad-c107-4139-84b9-24e7fe8404c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:54.155591 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5d8ad-c107-4139-84b9-24e7fe8404c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:54.155909 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5d8ad-c107-4139-84b9-24e7fe8404c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:54.156211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5d8ad-c107-4139-84b9-24e7fe8404c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:54.160740 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b6f5d8ad-c107-4139-84b9-24e7fe8404c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:54.172907 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6d136-3b13-4e39-9dfe-aacf8749b96a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:54.183295 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e197764-29f0-47dd-8279-ebcbc15b25c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:54.184265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e197764-29f0-47dd-8279-ebcbc15b25c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:54.184502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e197764-29f0-47dd-8279-ebcbc15b25c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:54.185703 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e197764-29f0-47dd-8279-ebcbc15b25c4 admin admin] PATH_INFO: `/v3/projects/fe846e823dea4e9d9df198beaf167872/users/5e6ff1be317643d480987e48e0faf8c1/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:54.211805 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e197764-29f0-47dd-8279-ebcbc15b25c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe846e823dea4e9d9df198beaf167872, user_id=5e6ff1be317643d480987e48e0faf8c1, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:54.220058 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e197764-29f0-47dd-8279-ebcbc15b25c4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:54.256862 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 873/1775] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:54 2022] PUT /identity/v3/projects/fe846e823dea4e9d9df198beaf167872/users/5e6ff1be317643d480987e48e0faf8c1/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:54.279916 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e197764-29f0-47dd-8279-ebcbc15b25c4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:54.350363 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5d8ad-c107-4139-84b9-24e7fe8404c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:54.357591 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f5d8ad-c107-4139-84b9-24e7fe8404c4 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:54.385694 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 903/1776] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:44:54.470251 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:54.507683 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e197764-29f0-47dd-8279-ebcbc15b25c4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:54.509510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5d8ad-c107-4139-84b9-24e7fe8404c4 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:54.511377 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b6f5d8ad-c107-4139-84b9-24e7fe8404c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:54.527431 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb5b40-a409-454d-87dd-b79f1cb23a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:54.528290 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb5b40-a409-454d-87dd-b79f1cb23a24 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:54.528580 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb5b40-a409-454d-87dd-b79f1cb23a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:54.529180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb5b40-a409-454d-87dd-b79f1cb23a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:54.529572 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb5b40-a409-454d-87dd-b79f1cb23a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:54.531387 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb5b40-a409-454d-87dd-b79f1cb23a24 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:54.547943 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5d8ad-c107-4139-84b9-24e7fe8404c4 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:54.552537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 874/1777] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:44:54.558323 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb5b40-a409-454d-87dd-b79f1cb23a24 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:54.571009 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70053727-171b-4926-bba4-3430c85d4c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:54.575705 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb5b40-a409-454d-87dd-b79f1cb23a24 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:54.582055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc40afe-a63e-43a1-b9e1-297c1cae02e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:54.582725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc40afe-a63e-43a1-b9e1-297c1cae02e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:54.583141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc40afe-a63e-43a1-b9e1-297c1cae02e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:54.583380 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc40afe-a63e-43a1-b9e1-297c1cae02e2 admin admin] PATH_INFO: `/v3/projects/fe846e823dea4e9d9df198beaf167872/users/5e6ff1be317643d480987e48e0faf8c1/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:54.585818 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc40afe-a63e-43a1-b9e1-297c1cae02e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe846e823dea4e9d9df198beaf167872, user_id=5e6ff1be317643d480987e48e0faf8c1, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:54.587368 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70053727-171b-4926-bba4-3430c85d4c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:54.588345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70053727-171b-4926-bba4-3430c85d4c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:54.592659 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc40afe-a63e-43a1-b9e1-297c1cae02e2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:54.593233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70053727-171b-4926-bba4-3430c85d4c8c admin admin] PATH_INFO: `/v3/users/66f57131b23e49fda8b5045f20cd4284` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:54.602553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70053727-171b-4926-bba4-3430c85d4c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f57131b23e49fda8b5045f20cd4284)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:54.606410 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 875/1778] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:44:54 2022] PUT /identity/v3/projects/fe846e823dea4e9d9df198beaf167872/users/5e6ff1be317643d480987e48e0faf8c1/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:54.608311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70053727-171b-4926-bba4-3430c85d4c8c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:54.738307 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-70053727-171b-4926-bba4-3430c85d4c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f57131b23e49fda8b5045f20cd4284'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:54.746284 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:54.755688 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-70053727-171b-4926-bba4-3430c85d4c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f57131b23e49fda8b5045f20cd4284'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:54.756613 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-70053727-171b-4926-bba4-3430c85d4c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f57131b23e49fda8b5045f20cd4284'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:54.757648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-70053727-171b-4926-bba4-3430c85d4c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f57131b23e49fda8b5045f20cd4284'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:54.773402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-70053727-171b-4926-bba4-3430c85d4c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f57131b23e49fda8b5045f20cd4284'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:54.821309 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 904/1779] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:44:54 2022] DELETE /identity/v3/users/66f57131b23e49fda8b5045f20cd4284 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:54.827496 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac56ae9-3fe9-4850-a3b8-aebaf2f93f72 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:54.828461 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac56ae9-3fe9-4850-a3b8-aebaf2f93f72 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:54.829381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac56ae9-3fe9-4850-a3b8-aebaf2f93f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:54.863296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-7ac56ae9-3fe9-4850-a3b8-aebaf2f93f72 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:54.864893 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7ac56ae9-3fe9-4850-a3b8-aebaf2f93f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:55.036063 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 876/1780] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:44:55.130647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70053727-171b-4926-bba4-3430c85d4c8c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:55.132417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-70053727-171b-4926-bba4-3430c85d4c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:55.287329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70053727-171b-4926-bba4-3430c85d4c8c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:55.302541 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbac694-ac96-4b95-b6be-9c185a6e94a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:55.303269 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbac694-ac96-4b95-b6be-9c185a6e94a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:55.303555 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbac694-ac96-4b95-b6be-9c185a6e94a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:55.303837 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbac694-ac96-4b95-b6be-9c185a6e94a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:55.325076 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbac694-ac96-4b95-b6be-9c185a6e94a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:55.327027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbac694-ac96-4b95-b6be-9c185a6e94a6 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:55.390908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 905/1781] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:56.583011 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46007b4-c1c1-4cf0-90f3-0bfcc4bbe923 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:56.583545 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46007b4-c1c1-4cf0-90f3-0bfcc4bbe923 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:56.583708 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46007b4-c1c1-4cf0-90f3-0bfcc4bbe923 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:56.585876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 877/1782] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 15 00:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:44:56.623583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece22955-89fc-49fe-99c9-4180f9788c71 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:56.624188 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece22955-89fc-49fe-99c9-4180f9788c71 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:56.624286 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece22955-89fc-49fe-99c9-4180f9788c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:56.686046 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ece22955-89fc-49fe-99c9-4180f9788c71 None None] MFA Rules not processed for user `bfcfcf8061f24231858b9b0205a8abaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:56.687544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ece22955-89fc-49fe-99c9-4180f9788c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:56.987491 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 906/1783] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 15 00:44:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:57.021806 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46007b4-c1c1-4cf0-90f3-0bfcc4bbe923 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:57.024899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d46007b4-c1c1-4cf0-90f3-0bfcc4bbe923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:57.090239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46007b4-c1c1-4cf0-90f3-0bfcc4bbe923 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:57.124805 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51910b8f-e4f0-4720-a48d-fa584a66d316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:57.125556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51910b8f-e4f0-4720-a48d-fa584a66d316 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:57.125854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51910b8f-e4f0-4720-a48d-fa584a66d316 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:57.126131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51910b8f-e4f0-4720-a48d-fa584a66d316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:57.166882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51910b8f-e4f0-4720-a48d-fa584a66d316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:57.168538 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51910b8f-e4f0-4720-a48d-fa584a66d316 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:57.216056 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 878/1784] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:44:57.474821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece22955-89fc-49fe-99c9-4180f9788c71 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:57.476539 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ece22955-89fc-49fe-99c9-4180f9788c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:57.548898 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece22955-89fc-49fe-99c9-4180f9788c71 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:57.606545 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108efd24-afd5-4d2c-8783-6ed640f79cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:57.607741 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108efd24-afd5-4d2c-8783-6ed640f79cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:57.608183 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108efd24-afd5-4d2c-8783-6ed640f79cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:57.608605 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108efd24-afd5-4d2c-8783-6ed640f79cf3 admin admin] PATH_INFO: `/v3/projects/b026d9a70159464dadd756899dea2ca2` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:57.610720 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108efd24-afd5-4d2c-8783-6ed640f79cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b026d9a70159464dadd756899dea2ca2)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:57.612874 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108efd24-afd5-4d2c-8783-6ed640f79cf3 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:57.706351 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-108efd24-afd5-4d2c-8783-6ed640f79cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b026d9a70159464dadd756899dea2ca2', 'request_id': 'req-108efd24-afd5-4d2c-8783-6ed640f79cf3'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:57.720007 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:DELETE=9,keystone:SELECT=91 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:57.722680 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-108efd24-afd5-4d2c-8783-6ed640f79cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b026d9a70159464dadd756899dea2ca2', 'request_id': 'req-108efd24-afd5-4d2c-8783-6ed640f79cf3'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:57.740045 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-108efd24-afd5-4d2c-8783-6ed640f79cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b026d9a70159464dadd756899dea2ca2', 'request_id': 'req-108efd24-afd5-4d2c-8783-6ed640f79cf3'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:57.783855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-108efd24-afd5-4d2c-8783-6ed640f79cf3 admin admin] The token cache is being invalidate because project b026d9a70159464dadd756899dea2ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:44:57.784596 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-108efd24-afd5-4d2c-8783-6ed640f79cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:57.785540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-108efd24-afd5-4d2c-8783-6ed640f79cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:57.789531 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 907/1785] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:44:57 2022] DELETE /identity/v3/projects/b026d9a70159464dadd756899dea2ca2 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:57.794431 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51910b8f-e4f0-4720-a48d-fa584a66d316 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:57.824118 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51910b8f-e4f0-4720-a48d-fa584a66d316 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:57.880119 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ac6f6-46b2-4b53-afe8-94689ac2f4cb None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:57.880681 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ac6f6-46b2-4b53-afe8-94689ac2f4cb None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:57.881203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ac6f6-46b2-4b53-afe8-94689ac2f4cb None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:57.883342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 908/1786] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 15 00:44:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 00:44:58.027988 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df9ca6-4db2-4d06-b628-b4b1c07e0556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:58.029727 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df9ca6-4db2-4d06-b628-b4b1c07e0556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:58.030307 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df9ca6-4db2-4d06-b628-b4b1c07e0556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:58.030895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df9ca6-4db2-4d06-b628-b4b1c07e0556 admin admin] PATH_INFO: `/v3/users/209bb32b99a04486bb2f0862ad3875ec` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:58.033364 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df9ca6-4db2-4d06-b628-b4b1c07e0556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=209bb32b99a04486bb2f0862ad3875ec)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:58.038866 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df9ca6-4db2-4d06-b628-b4b1c07e0556 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:58.074270 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e451c-492b-40af-a155-8a11ceb103f4 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:58.074576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e451c-492b-40af-a155-8a11ceb103f4 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:58.075044 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e451c-492b-40af-a155-8a11ceb103f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:58.125199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-6b8e451c-492b-40af-a155-8a11ceb103f4 None None] MFA Rules not processed for user `bfcfcf8061f24231858b9b0205a8abaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:58.128186 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6b8e451c-492b-40af-a155-8a11ceb103f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:58.150169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-92df9ca6-4db2-4d06-b628-b4b1c07e0556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '209bb32b99a04486bb2f0862ad3875ec'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:58.162226 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-92df9ca6-4db2-4d06-b628-b4b1c07e0556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '209bb32b99a04486bb2f0862ad3875ec'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:58.163342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-92df9ca6-4db2-4d06-b628-b4b1c07e0556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '209bb32b99a04486bb2f0862ad3875ec'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:58.163979 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-92df9ca6-4db2-4d06-b628-b4b1c07e0556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '209bb32b99a04486bb2f0862ad3875ec'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:58.166449 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:44:58.178565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-92df9ca6-4db2-4d06-b628-b4b1c07e0556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '209bb32b99a04486bb2f0862ad3875ec'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:44:58.221296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 879/1787] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:44:57 2022] DELETE /identity/v3/users/209bb32b99a04486bb2f0862ad3875ec => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:44:58.256807 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd3aac-1dc2-4797-833f-fe542d3ce711 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:58.257428 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd3aac-1dc2-4797-833f-fe542d3ce711 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:58.260661 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd3aac-1dc2-4797-833f-fe542d3ce711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:58.343075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 909/1788] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 15 00:44:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:58.392558 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-28fd3aac-1dc2-4797-833f-fe542d3ce711 None None] MFA Rules not processed for user `5e6ff1be317643d480987e48e0faf8c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:44:58.396927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-28fd3aac-1dc2-4797-833f-fe542d3ce711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:58.461296 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e451c-492b-40af-a155-8a11ceb103f4 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:44:58.463811 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6b8e451c-492b-40af-a155-8a11ceb103f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:44:58.487179 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e451c-492b-40af-a155-8a11ceb103f4 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:44:58.636663 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 880/1789] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:44:58 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:44:58.686874 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2fcf7-45d8-4c46-a388-396a5739bc9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:44:58.688415 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2fcf7-45d8-4c46-a388-396a5739bc9b service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:44:58.688700 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2fcf7-45d8-4c46-a388-396a5739bc9b service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:44:58.688971 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2fcf7-45d8-4c46-a388-396a5739bc9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:44:58.714303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2fcf7-45d8-4c46-a388-396a5739bc9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:44:58.719626 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2fcf7-45d8-4c46-a388-396a5739bc9b service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:44:58.743909 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 910/1790] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:44:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:00.416933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd3aac-1dc2-4797-833f-fe542d3ce711 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:00.421366 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-28fd3aac-1dc2-4797-833f-fe542d3ce711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:00.491376 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd3aac-1dc2-4797-833f-fe542d3ce711 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:00.495283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d23a3-6610-4a8c-8b70-407b33b19925 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:00.495920 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d23a3-6610-4a8c-8b70-407b33b19925 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:00.496307 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d23a3-6610-4a8c-8b70-407b33b19925 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:00.496601 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d23a3-6610-4a8c-8b70-407b33b19925 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:00.498482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-041d23a3-6610-4a8c-8b70-407b33b19925 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:00.590085 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d23a3-6610-4a8c-8b70-407b33b19925 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:00.592324 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d23a3-6610-4a8c-8b70-407b33b19925 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:00.605717 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 881/1791] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:00.735652 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2fcf7-45d8-4c46-a388-396a5739bc9b service nova] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:00.737337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3ec2fcf7-45d8-4c46-a388-396a5739bc9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:00.906463 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a52dcd-ef0c-457b-b00b-fadd452a0e1e None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:00.906655 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a52dcd-ef0c-457b-b00b-fadd452a0e1e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:00.907349 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a52dcd-ef0c-457b-b00b-fadd452a0e1e None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:00.908960 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 882/1792] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 15 00:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:45:00.919506 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2fcf7-45d8-4c46-a388-396a5739bc9b service nova] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:00.927578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c53ea-3584-4d6a-8834-a6d7a012afdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:00.928453 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c53ea-3584-4d6a-8834-a6d7a012afdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:00.929761 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c53ea-3584-4d6a-8834-a6d7a012afdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:00.930311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c53ea-3584-4d6a-8834-a6d7a012afdd admin admin] PATH_INFO: `/v3/projects/8b33c619268548e59a4892d92486ac6a` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:00.931914 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c53ea-3584-4d6a-8834-a6d7a012afdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b33c619268548e59a4892d92486ac6a)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:00.935609 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c53ea-3584-4d6a-8834-a6d7a012afdd admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:00.939516 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:00.961673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67154adc-e8fb-4098-a79d-3c04db729e43 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:00.961673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67154adc-e8fb-4098-a79d-3c04db729e43 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:00.962467 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67154adc-e8fb-4098-a79d-3c04db729e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:01.021581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-550c53ea-3584-4d6a-8834-a6d7a012afdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b33c619268548e59a4892d92486ac6a', 'request_id': 'req-550c53ea-3584-4d6a-8834-a6d7a012afdd'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:01.029054 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-550c53ea-3584-4d6a-8834-a6d7a012afdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b33c619268548e59a4892d92486ac6a', 'request_id': 'req-550c53ea-3584-4d6a-8834-a6d7a012afdd'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:01.040075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-550c53ea-3584-4d6a-8834-a6d7a012afdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b33c619268548e59a4892d92486ac6a', 'request_id': 'req-550c53ea-3584-4d6a-8834-a6d7a012afdd'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:01.045846 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-67154adc-e8fb-4098-a79d-3c04db729e43 None None] MFA Rules not processed for user `6ed987b44d934ac7b2dc64c0aab28099`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:01.047467 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-67154adc-e8fb-4098-a79d-3c04db729e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:01.058536 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-550c53ea-3584-4d6a-8834-a6d7a012afdd admin admin] The token cache is being invalidate because project 8b33c619268548e59a4892d92486ac6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:01.058833 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-550c53ea-3584-4d6a-8834-a6d7a012afdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:01.063521 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-550c53ea-3584-4d6a-8834-a6d7a012afdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:01.067104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 911/1793] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:00 2022] DELETE /identity/v3/projects/8b33c619268548e59a4892d92486ac6a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:01.073645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a87f48-f899-4626-82fb-c6eb12a88e00 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:01.074289 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a87f48-f899-4626-82fb-c6eb12a88e00 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:01.074694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:01.074803 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a87f48-f899-4626-82fb-c6eb12a88e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:01.138447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-34a87f48-f899-4626-82fb-c6eb12a88e00 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:01.144544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-34a87f48-f899-4626-82fb-c6eb12a88e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:01.315377 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 883/1794] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 15 00:45:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:01.414317 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 912/1795] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:01.422476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89136c8-57cb-4b87-88b6-47d64bde18b6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:01.423032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89136c8-57cb-4b87-88b6-47d64bde18b6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:01.423151 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89136c8-57cb-4b87-88b6-47d64bde18b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:01.473323 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f89136c8-57cb-4b87-88b6-47d64bde18b6 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:01.474547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f89136c8-57cb-4b87-88b6-47d64bde18b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:01.511750 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf045c-9566-4f31-9a40-f41a78a71a19 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:01.512136 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf045c-9566-4f31-9a40-f41a78a71a19 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:01.512430 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf045c-9566-4f31-9a40-f41a78a71a19 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:01.514039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 913/1796] 10.222.0.52 () {54 vars in 961 bytes} [Thu Sep 15 00:45:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:45:01.514779 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf045c-9566-4f31-9a40-f41a78a71a19 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:01.515301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 884/1797] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:01.523013 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cc893-8774-4a4f-a58d-3d34800852f7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:01.523270 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cc893-8774-4a4f-a58d-3d34800852f7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:01.523673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cc893-8774-4a4f-a58d-3d34800852f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:01.570689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf045c-9566-4f31-9a40-f41a78a71a19 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:01.582815 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768a7c7-915c-4566-8aee-59d25ee892d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:01.583453 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768a7c7-915c-4566-8aee-59d25ee892d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:01.583733 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768a7c7-915c-4566-8aee-59d25ee892d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:01.584006 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768a7c7-915c-4566-8aee-59d25ee892d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:01.584800 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768a7c7-915c-4566-8aee-59d25ee892d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:45:01.585129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768a7c7-915c-4566-8aee-59d25ee892d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:01.586451 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-004cc893-8774-4a4f-a58d-3d34800852f7 None None] MFA Rules not processed for user `6ed987b44d934ac7b2dc64c0aab28099`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:01.586817 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768a7c7-915c-4566-8aee-59d25ee892d0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:01.588989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-004cc893-8774-4a4f-a58d-3d34800852f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:01.602444 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 885/1798] 10.222.0.52 () {58 vars in 1058 bytes} [Thu Sep 15 00:45:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:01.610027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 914/1799] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:45:01.613859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cc893-8774-4a4f-a58d-3d34800852f7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:01.616368 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768a7c7-915c-4566-8aee-59d25ee892d0 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:01.629845 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cc893-8774-4a4f-a58d-3d34800852f7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:01.659576 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02795482-2c29-4997-a73a-4e54da1f4e42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed987b44d934ac7b2dc64c0aab28099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:01.661403 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02795482-2c29-4997-a73a-4e54da1f4e42 service placement] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:01.663286 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02795482-2c29-4997-a73a-4e54da1f4e42 service placement] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:01.664070 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02795482-2c29-4997-a73a-4e54da1f4e42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:01.668989 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768a7c7-915c-4566-8aee-59d25ee892d0 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:01.682863 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46caa6b-95ba-4da4-a2e2-f31003b38010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:01.695836 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46caa6b-95ba-4da4-a2e2-f31003b38010 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:01.695836 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46caa6b-95ba-4da4-a2e2-f31003b38010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:01.696415 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46caa6b-95ba-4da4-a2e2-f31003b38010 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:01.697754 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02795482-2c29-4997-a73a-4e54da1f4e42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:01.698067 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46caa6b-95ba-4da4-a2e2-f31003b38010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:01.700506 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46caa6b-95ba-4da4-a2e2-f31003b38010 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:01.702762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02795482-2c29-4997-a73a-4e54da1f4e42 service placement] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:01.740583 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 886/1800] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:45:01.773272 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02795482-2c29-4997-a73a-4e54da1f4e42 service placement] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:01.773845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 915/1801] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:01 2022] POST /identity/v3/projects => generated 389 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:01.788920 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02795482-2c29-4997-a73a-4e54da1f4e42 service placement] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:02.026646 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253eb0aa-ee38-482c-8a81-59cff21a4b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:02.027189 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253eb0aa-ee38-482c-8a81-59cff21a4b9e admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:02.027473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253eb0aa-ee38-482c-8a81-59cff21a4b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:02.027743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253eb0aa-ee38-482c-8a81-59cff21a4b9e admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:02.028383 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253eb0aa-ee38-482c-8a81-59cff21a4b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:02.030344 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253eb0aa-ee38-482c-8a81-59cff21a4b9e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:02.113888 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 887/1802] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:01 2022] POST /identity/v3/users => generated 295 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:02.115513 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46caa6b-95ba-4da4-a2e2-f31003b38010 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:02.150293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46caa6b-95ba-4da4-a2e2-f31003b38010 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:02.151554 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253eb0aa-ee38-482c-8a81-59cff21a4b9e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:02.157948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-253eb0aa-ee38-482c-8a81-59cff21a4b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:02.190172 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c891b-863d-437d-94da-c632b8d75f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:02.190934 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c891b-863d-437d-94da-c632b8d75f72 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:02.191227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c891b-863d-437d-94da-c632b8d75f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:02.191504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c891b-863d-437d-94da-c632b8d75f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:02.192245 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c891b-863d-437d-94da-c632b8d75f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:02.200680 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253eb0aa-ee38-482c-8a81-59cff21a4b9e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:02.206890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c891b-863d-437d-94da-c632b8d75f72 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:02.231105 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ebd54-9736-47ce-9723-03db6840fd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:02.231879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ebd54-9736-47ce-9723-03db6840fd3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:02.232200 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ebd54-9736-47ce-9723-03db6840fd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:02.232558 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ebd54-9736-47ce-9723-03db6840fd3c admin admin] PATH_INFO: `/v3/users/a408f37c235943b39fad27820938b442` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:02.236280 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ebd54-9736-47ce-9723-03db6840fd3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a408f37c235943b39fad27820938b442)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:02.240746 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ebd54-9736-47ce-9723-03db6840fd3c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:02.252413 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 916/1803] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:02.253408 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c891b-863d-437d-94da-c632b8d75f72 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:02.259290 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4c8c891b-863d-437d-94da-c632b8d75f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:02.303277 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c891b-863d-437d-94da-c632b8d75f72 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:02.323486 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80013e-5ff4-4fd7-996a-2eb26c95f59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:02.325277 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80013e-5ff4-4fd7-996a-2eb26c95f59e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:02.326228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80013e-5ff4-4fd7-996a-2eb26c95f59e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:02.326513 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80013e-5ff4-4fd7-996a-2eb26c95f59e admin admin] PATH_INFO: `/v3/users/7c011aa7f15d4e03babae12930978204` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:02.342382 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80013e-5ff4-4fd7-996a-2eb26c95f59e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c011aa7f15d4e03babae12930978204)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:02.347140 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80013e-5ff4-4fd7-996a-2eb26c95f59e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:02.434163 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-600ebd54-9736-47ce-9723-03db6840fd3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a408f37c235943b39fad27820938b442'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:02.455143 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-600ebd54-9736-47ce-9723-03db6840fd3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a408f37c235943b39fad27820938b442'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:02.456266 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-600ebd54-9736-47ce-9723-03db6840fd3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a408f37c235943b39fad27820938b442'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:02.458156 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-600ebd54-9736-47ce-9723-03db6840fd3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a408f37c235943b39fad27820938b442'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:02.469685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-600ebd54-9736-47ce-9723-03db6840fd3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a408f37c235943b39fad27820938b442'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:02.473810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:02.535664 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 888/1804] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:02 2022] DELETE /identity/v3/users/a408f37c235943b39fad27820938b442 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:02.537299 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ebd54-9736-47ce-9723-03db6840fd3c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:02.542807 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-600ebd54-9736-47ce-9723-03db6840fd3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:02.545640 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:02.565779 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7e80013e-5ff4-4fd7-996a-2eb26c95f59e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c011aa7f15d4e03babae12930978204'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:02.591546 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7e80013e-5ff4-4fd7-996a-2eb26c95f59e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c011aa7f15d4e03babae12930978204'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:02.592579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7e80013e-5ff4-4fd7-996a-2eb26c95f59e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c011aa7f15d4e03babae12930978204'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:02.594460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7e80013e-5ff4-4fd7-996a-2eb26c95f59e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c011aa7f15d4e03babae12930978204'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:02.642660 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7e80013e-5ff4-4fd7-996a-2eb26c95f59e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c011aa7f15d4e03babae12930978204'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:02.704996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 917/1805] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:02 2022] DELETE /identity/v3/users/7c011aa7f15d4e03babae12930978204 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:02.720338 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432487b-7a09-45a7-9451-5b6272a5d602 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:02.723497 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432487b-7a09-45a7-9451-5b6272a5d602 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:02.733123 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432487b-7a09-45a7-9451-5b6272a5d602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:02.763047 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ebd54-9736-47ce-9723-03db6840fd3c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:02.783178 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-3432487b-7a09-45a7-9451-5b6272a5d602 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:02.785259 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3432487b-7a09-45a7-9451-5b6272a5d602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:02.934085 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9825713-f704-4f5a-8ced-bcd3659e9882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:02.937305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9825713-f704-4f5a-8ced-bcd3659e9882 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:02.937604 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9825713-f704-4f5a-8ced-bcd3659e9882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:02.937888 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9825713-f704-4f5a-8ced-bcd3659e9882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:02.949145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9825713-f704-4f5a-8ced-bcd3659e9882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:02.949145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9825713-f704-4f5a-8ced-bcd3659e9882 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:02.984093 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 889/1806] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:02.987049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593169f1-0a7b-41e9-8e39-627c12900c28 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:02.989399 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593169f1-0a7b-41e9-8e39-627c12900c28 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:02.989837 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593169f1-0a7b-41e9-8e39-627c12900c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:02.995710 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 918/1807] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:02.996622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432487b-7a09-45a7-9451-5b6272a5d602 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:02.998047 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3432487b-7a09-45a7-9451-5b6272a5d602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:03.044656 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-593169f1-0a7b-41e9-8e39-627c12900c28 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:03.046253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-593169f1-0a7b-41e9-8e39-627c12900c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:03.055083 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432487b-7a09-45a7-9451-5b6272a5d602 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:03.068043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d367ab-5ef0-4eae-9043-179122e7c267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:03.068731 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d367ab-5ef0-4eae-9043-179122e7c267 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:03.069105 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d367ab-5ef0-4eae-9043-179122e7c267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:03.069417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d367ab-5ef0-4eae-9043-179122e7c267 admin admin] PATH_INFO: `/v3/projects/d74cfa95d4e3411294978931a5eb937a/users/d7ef951cde9b4670a897bfb94a07a046/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:03.073782 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 890/1808] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:03.074851 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593169f1-0a7b-41e9-8e39-627c12900c28 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:03.078346 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-593169f1-0a7b-41e9-8e39-627c12900c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:03.106849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d367ab-5ef0-4eae-9043-179122e7c267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74cfa95d4e3411294978931a5eb937a, user_id=d7ef951cde9b4670a897bfb94a07a046, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:03.115121 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d367ab-5ef0-4eae-9043-179122e7c267 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:03.153909 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 919/1809] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:02 2022] PUT /identity/v3/projects/d74cfa95d4e3411294978931a5eb937a/users/d7ef951cde9b4670a897bfb94a07a046/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:03.164149 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d367ab-5ef0-4eae-9043-179122e7c267 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:03.166747 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-67d367ab-5ef0-4eae-9043-179122e7c267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:03.194130 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593169f1-0a7b-41e9-8e39-627c12900c28 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:03.274128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d367ab-5ef0-4eae-9043-179122e7c267 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:03.279743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14b267-2b6b-4a52-be9f-9a27171b316d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:03.280600 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14b267-2b6b-4a52-be9f-9a27171b316d service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:03.280937 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14b267-2b6b-4a52-be9f-9a27171b316d service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:03.281648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14b267-2b6b-4a52-be9f-9a27171b316d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:03.300779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:03.338362 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594f5c2-14b4-435f-a68d-b575dc4f2e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:03.339171 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594f5c2-14b4-435f-a68d-b575dc4f2e4b service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:03.339700 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594f5c2-14b4-435f-a68d-b575dc4f2e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:03.340068 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594f5c2-14b4-435f-a68d-b575dc4f2e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:03.486834 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594f5c2-14b4-435f-a68d-b575dc4f2e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:03.488355 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594f5c2-14b4-435f-a68d-b575dc4f2e4b service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:03.498136 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:03.518268 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 891/1810] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:03.523427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c968ce1-44db-46fe-b691-212d17e0a18c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:03.524263 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c968ce1-44db-46fe-b691-212d17e0a18c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:03.524543 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c968ce1-44db-46fe-b691-212d17e0a18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:03.539366 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14b267-2b6b-4a52-be9f-9a27171b316d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:03.542419 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14b267-2b6b-4a52-be9f-9a27171b316d service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:03.570707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3c968ce1-44db-46fe-b691-212d17e0a18c None None] MFA Rules not processed for user `d7ef951cde9b4670a897bfb94a07a046`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:03.573393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3c968ce1-44db-46fe-b691-212d17e0a18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:03.577240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 920/1811] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:03.680522 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 892/1812] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:03.681797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14b267-2b6b-4a52-be9f-9a27171b316d service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:03.699280 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14b267-2b6b-4a52-be9f-9a27171b316d service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:03.707145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4151f82-6bf4-40f2-ac0f-431fbbe428a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:03.707824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4151f82-6bf4-40f2-ac0f-431fbbe428a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:03.708157 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4151f82-6bf4-40f2-ac0f-431fbbe428a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:03.708329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4151f82-6bf4-40f2-ac0f-431fbbe428a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:03.743333 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4151f82-6bf4-40f2-ac0f-431fbbe428a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:03.751276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4151f82-6bf4-40f2-ac0f-431fbbe428a2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:03.797880 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 921/1813] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:03 2022] POST /identity/v3/projects => generated 389 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:45:03.800187 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c968ce1-44db-46fe-b691-212d17e0a18c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:03.827723 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c968ce1-44db-46fe-b691-212d17e0a18c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:03.948699 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4151f82-6bf4-40f2-ac0f-431fbbe428a2 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:03.950988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b4151f82-6bf4-40f2-ac0f-431fbbe428a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:04.020072 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b4f89-a443-4772-b6bb-ac4dd98d77b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:04.020697 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b4f89-a443-4772-b6bb-ac4dd98d77b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:04.020968 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b4f89-a443-4772-b6bb-ac4dd98d77b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:04.021285 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b4f89-a443-4772-b6bb-ac4dd98d77b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:04.022628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b4f89-a443-4772-b6bb-ac4dd98d77b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:04.026726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b4f89-a443-4772-b6bb-ac4dd98d77b7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:04.082534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 893/1814] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:03 2022] POST /identity/v3/users => generated 301 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:04.083464 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b4f89-a443-4772-b6bb-ac4dd98d77b7 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:04.100269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:04.106205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4151f82-6bf4-40f2-ac0f-431fbbe428a2 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:04.109290 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b4f89-a443-4772-b6bb-ac4dd98d77b7 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:04.119839 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bc338-4b31-4c7d-9a4a-edfe7fd94aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:04.120472 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bc338-4b31-4c7d-9a4a-edfe7fd94aec admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:04.120749 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bc338-4b31-4c7d-9a4a-edfe7fd94aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:04.121025 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bc338-4b31-4c7d-9a4a-edfe7fd94aec admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:04.123912 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf374e78-29ba-4bf8-bf3e-352e5030fb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:04.124648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf374e78-29ba-4bf8-bf3e-352e5030fb0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:04.124931 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf374e78-29ba-4bf8-bf3e-352e5030fb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:04.125231 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf374e78-29ba-4bf8-bf3e-352e5030fb0f admin admin] PATH_INFO: `/v3/users/c16047d7587747f88fc8237cfc28b7d2` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:04.126748 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007bc338-4b31-4c7d-9a4a-edfe7fd94aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:04.128462 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf374e78-29ba-4bf8-bf3e-352e5030fb0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c16047d7587747f88fc8237cfc28b7d2)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:04.130711 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007bc338-4b31-4c7d-9a4a-edfe7fd94aec admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:04.133687 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf374e78-29ba-4bf8-bf3e-352e5030fb0f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:04.166149 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 894/1815] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:04.167137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bc338-4b31-4c7d-9a4a-edfe7fd94aec admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:04.186278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bc338-4b31-4c7d-9a4a-edfe7fd94aec admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:04.221650 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43541351-0f4d-4f17-81ef-4952940f020d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:04.223139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43541351-0f4d-4f17-81ef-4952940f020d admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:04.224212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43541351-0f4d-4f17-81ef-4952940f020d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:04.224958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43541351-0f4d-4f17-81ef-4952940f020d admin admin] PATH_INFO: `/v3/projects/eaebc1f5f4d54cd8b0fa968caede6c8e/users/71e978d3d77b43f5a25fddb8daf9bef3/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:04.266061 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bf374e78-29ba-4bf8-bf3e-352e5030fb0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c16047d7587747f88fc8237cfc28b7d2'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:04.283629 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bf374e78-29ba-4bf8-bf3e-352e5030fb0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c16047d7587747f88fc8237cfc28b7d2'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:04.285308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bf374e78-29ba-4bf8-bf3e-352e5030fb0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c16047d7587747f88fc8237cfc28b7d2'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:04.286115 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bf374e78-29ba-4bf8-bf3e-352e5030fb0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c16047d7587747f88fc8237cfc28b7d2'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:04.293023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43541351-0f4d-4f17-81ef-4952940f020d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaebc1f5f4d54cd8b0fa968caede6c8e, user_id=71e978d3d77b43f5a25fddb8daf9bef3, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:04.301412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43541351-0f4d-4f17-81ef-4952940f020d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:04.330786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bf374e78-29ba-4bf8-bf3e-352e5030fb0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c16047d7587747f88fc8237cfc28b7d2'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:04.338584 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 895/1816] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:04 2022] PUT /identity/v3/projects/eaebc1f5f4d54cd8b0fa968caede6c8e/users/71e978d3d77b43f5a25fddb8daf9bef3/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:04.339797 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43541351-0f4d-4f17-81ef-4952940f020d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:04.343555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-43541351-0f4d-4f17-81ef-4952940f020d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:04.365191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 922/1817] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:03 2022] DELETE /identity/v3/users/c16047d7587747f88fc8237cfc28b7d2 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:45:04.366112 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf374e78-29ba-4bf8-bf3e-352e5030fb0f admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:04.368085 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-bf374e78-29ba-4bf8-bf3e-352e5030fb0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:04.463597 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:04.492977 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf374e78-29ba-4bf8-bf3e-352e5030fb0f admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:04.498666 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8432dfa-069b-47a9-8524-262de0e46811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:04.498666 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8432dfa-069b-47a9-8524-262de0e46811 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:04.499070 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8432dfa-069b-47a9-8524-262de0e46811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:04.499550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8432dfa-069b-47a9-8524-262de0e46811 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:04.500167 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8432dfa-069b-47a9-8524-262de0e46811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:04.501878 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8432dfa-069b-47a9-8524-262de0e46811 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:04.513273 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 923/1818] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:04.514192 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8432dfa-069b-47a9-8524-262de0e46811 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:04.516256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f8432dfa-069b-47a9-8524-262de0e46811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:04.527567 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43541351-0f4d-4f17-81ef-4952940f020d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:04.533812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc073b-c8a6-47aa-beae-d2e6e273124a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:04.534487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc073b-c8a6-47aa-beae-d2e6e273124a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:04.534722 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc073b-c8a6-47aa-beae-d2e6e273124a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:04.535345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc073b-c8a6-47aa-beae-d2e6e273124a admin admin] PATH_INFO: `/v3/projects/b5596c63e12048cfaf90947a28dc2567` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:04.536150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc073b-c8a6-47aa-beae-d2e6e273124a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5596c63e12048cfaf90947a28dc2567)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:04.538243 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc073b-c8a6-47aa-beae-d2e6e273124a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:04.542235 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8432dfa-069b-47a9-8524-262de0e46811 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:04.548656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c303a2-e53e-4417-8e94-aabae67a6469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:04.549666 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c303a2-e53e-4417-8e94-aabae67a6469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:04.550134 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c303a2-e53e-4417-8e94-aabae67a6469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:04.550773 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c303a2-e53e-4417-8e94-aabae67a6469 admin admin] PATH_INFO: `/v3/projects/bbb8c8497c964b5fb191fb8f9abbb84b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:04.552601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c303a2-e53e-4417-8e94-aabae67a6469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb8c8497c964b5fb191fb8f9abbb84b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:04.555330 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c303a2-e53e-4417-8e94-aabae67a6469 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:04.612003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0ebc073b-c8a6-47aa-beae-d2e6e273124a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5596c63e12048cfaf90947a28dc2567', 'request_id': 'req-0ebc073b-c8a6-47aa-beae-d2e6e273124a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:04.624895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0ebc073b-c8a6-47aa-beae-d2e6e273124a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5596c63e12048cfaf90947a28dc2567', 'request_id': 'req-0ebc073b-c8a6-47aa-beae-d2e6e273124a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:04.631070 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0ebc073b-c8a6-47aa-beae-d2e6e273124a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5596c63e12048cfaf90947a28dc2567', 'request_id': 'req-0ebc073b-c8a6-47aa-beae-d2e6e273124a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:04.644561 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a7c303a2-e53e-4417-8e94-aabae67a6469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb8c8497c964b5fb191fb8f9abbb84b', 'request_id': 'req-a7c303a2-e53e-4417-8e94-aabae67a6469'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:04.656799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a7c303a2-e53e-4417-8e94-aabae67a6469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb8c8497c964b5fb191fb8f9abbb84b', 'request_id': 'req-a7c303a2-e53e-4417-8e94-aabae67a6469'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:04.657557 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0ebc073b-c8a6-47aa-beae-d2e6e273124a admin admin] The token cache is being invalidate because project b5596c63e12048cfaf90947a28dc2567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:04.659553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0ebc073b-c8a6-47aa-beae-d2e6e273124a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:04.661078 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0ebc073b-c8a6-47aa-beae-d2e6e273124a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:04.665336 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 896/1819] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:04 2022] DELETE /identity/v3/projects/b5596c63e12048cfaf90947a28dc2567 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:04.667550 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc073b-c8a6-47aa-beae-d2e6e273124a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:04.669107 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0ebc073b-c8a6-47aa-beae-d2e6e273124a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:04.669403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a7c303a2-e53e-4417-8e94-aabae67a6469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb8c8497c964b5fb191fb8f9abbb84b', 'request_id': 'req-a7c303a2-e53e-4417-8e94-aabae67a6469'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:04.717207 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a7c303a2-e53e-4417-8e94-aabae67a6469 admin admin] The token cache is being invalidate because project bbb8c8497c964b5fb191fb8f9abbb84b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:04.717762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a7c303a2-e53e-4417-8e94-aabae67a6469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:04.724591 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a7c303a2-e53e-4417-8e94-aabae67a6469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:04.729573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 924/1820] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:04 2022] DELETE /identity/v3/projects/bbb8c8497c964b5fb191fb8f9abbb84b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:04.729573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c303a2-e53e-4417-8e94-aabae67a6469 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:04.730444 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a7c303a2-e53e-4417-8e94-aabae67a6469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:04.820905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc073b-c8a6-47aa-beae-d2e6e273124a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:04.826006 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:04.878838 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c303a2-e53e-4417-8e94-aabae67a6469 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:04.885525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e79784-38e7-4d20-ac87-df2995fef276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:04.886212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e79784-38e7-4d20-ac87-df2995fef276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:04.886560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e79784-38e7-4d20-ac87-df2995fef276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:04.886815 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e79784-38e7-4d20-ac87-df2995fef276 admin admin] PATH_INFO: `/v3/users/20a0fc4f582d4a0fb0fc16e8cc672d47` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:04.888125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e79784-38e7-4d20-ac87-df2995fef276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20a0fc4f582d4a0fb0fc16e8cc672d47)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:04.890371 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e79784-38e7-4d20-ac87-df2995fef276 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:04.898575 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26614224-19e2-4fce-b758-fd23c5fe677b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:04.899534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26614224-19e2-4fce-b758-fd23c5fe677b admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:04.899839 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26614224-19e2-4fce-b758-fd23c5fe677b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:04.900185 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26614224-19e2-4fce-b758-fd23c5fe677b admin admin] PATH_INFO: `/v3/projects/eaebc1f5f4d54cd8b0fa968caede6c8e/users/71e978d3d77b43f5a25fddb8daf9bef3/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:04.902327 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26614224-19e2-4fce-b758-fd23c5fe677b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaebc1f5f4d54cd8b0fa968caede6c8e, user_id=71e978d3d77b43f5a25fddb8daf9bef3, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:04.905055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26614224-19e2-4fce-b758-fd23c5fe677b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:04.918220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 897/1821] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:04 2022] PUT /identity/v3/projects/eaebc1f5f4d54cd8b0fa968caede6c8e/users/71e978d3d77b43f5a25fddb8daf9bef3/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:04.919136 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26614224-19e2-4fce-b758-fd23c5fe677b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:04.921055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-26614224-19e2-4fce-b758-fd23c5fe677b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:04.959783 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-99e79784-38e7-4d20-ac87-df2995fef276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20a0fc4f582d4a0fb0fc16e8cc672d47'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:04.969657 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-99e79784-38e7-4d20-ac87-df2995fef276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20a0fc4f582d4a0fb0fc16e8cc672d47'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:04.970279 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-99e79784-38e7-4d20-ac87-df2995fef276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20a0fc4f582d4a0fb0fc16e8cc672d47'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:04.970892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-99e79784-38e7-4d20-ac87-df2995fef276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20a0fc4f582d4a0fb0fc16e8cc672d47'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:04.978274 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-99e79784-38e7-4d20-ac87-df2995fef276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20a0fc4f582d4a0fb0fc16e8cc672d47'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:04.979373 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:04.997724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26614224-19e2-4fce-b758-fd23c5fe677b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:04.998056 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 925/1822] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:04 2022] DELETE /identity/v3/users/20a0fc4f582d4a0fb0fc16e8cc672d47 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:04.998901 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e79784-38e7-4d20-ac87-df2995fef276 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:05.000313 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-99e79784-38e7-4d20-ac87-df2995fef276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:05.063552 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62d9bf-5ea5-424b-9428-d775d4d52258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:05.064559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62d9bf-5ea5-424b-9428-d775d4d52258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:05.065181 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62d9bf-5ea5-424b-9428-d775d4d52258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:05.065632 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62d9bf-5ea5-424b-9428-d775d4d52258 admin admin] PATH_INFO: `/v3/projects/2327f065b97a471abae3079d394dcbc6` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:05.066963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62d9bf-5ea5-424b-9428-d775d4d52258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2327f065b97a471abae3079d394dcbc6)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:05.069120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62d9bf-5ea5-424b-9428-d775d4d52258 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:05.085319 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e79784-38e7-4d20-ac87-df2995fef276 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:05.090520 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556aaaab-9f70-4e00-8ed3-0dc519a2f8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:05.091453 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556aaaab-9f70-4e00-8ed3-0dc519a2f8f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:05.091453 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556aaaab-9f70-4e00-8ed3-0dc519a2f8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:05.091703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556aaaab-9f70-4e00-8ed3-0dc519a2f8f5 admin admin] PATH_INFO: `/v3/users/01ab68e564d14c4998b1037ee5ec846a` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:05.093130 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556aaaab-9f70-4e00-8ed3-0dc519a2f8f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01ab68e564d14c4998b1037ee5ec846a)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:05.094842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556aaaab-9f70-4e00-8ed3-0dc519a2f8f5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:05.124813 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ce62d9bf-5ea5-424b-9428-d775d4d52258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2327f065b97a471abae3079d394dcbc6', 'request_id': 'req-ce62d9bf-5ea5-424b-9428-d775d4d52258'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:05.128189 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:05.149363 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ce62d9bf-5ea5-424b-9428-d775d4d52258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2327f065b97a471abae3079d394dcbc6', 'request_id': 'req-ce62d9bf-5ea5-424b-9428-d775d4d52258'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:05.157602 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ce62d9bf-5ea5-424b-9428-d775d4d52258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2327f065b97a471abae3079d394dcbc6', 'request_id': 'req-ce62d9bf-5ea5-424b-9428-d775d4d52258'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:05.173044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ce62d9bf-5ea5-424b-9428-d775d4d52258 admin admin] The token cache is being invalidate because project 2327f065b97a471abae3079d394dcbc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:05.173371 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ce62d9bf-5ea5-424b-9428-d775d4d52258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:05.174054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ce62d9bf-5ea5-424b-9428-d775d4d52258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:05.174238 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-556aaaab-9f70-4e00-8ed3-0dc519a2f8f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01ab68e564d14c4998b1037ee5ec846a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:05.178596 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 898/1823] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:04 2022] DELETE /identity/v3/projects/2327f065b97a471abae3079d394dcbc6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:05.179564 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62d9bf-5ea5-424b-9428-d775d4d52258 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:05.182305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ce62d9bf-5ea5-424b-9428-d775d4d52258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:05.184760 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-556aaaab-9f70-4e00-8ed3-0dc519a2f8f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01ab68e564d14c4998b1037ee5ec846a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:05.185574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-556aaaab-9f70-4e00-8ed3-0dc519a2f8f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01ab68e564d14c4998b1037ee5ec846a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:05.186240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-556aaaab-9f70-4e00-8ed3-0dc519a2f8f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01ab68e564d14c4998b1037ee5ec846a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:05.194717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-556aaaab-9f70-4e00-8ed3-0dc519a2f8f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01ab68e564d14c4998b1037ee5ec846a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:05.224593 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 926/1824] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:04 2022] DELETE /identity/v3/users/01ab68e564d14c4998b1037ee5ec846a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:05.226066 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257f662-b814-452d-a1b8-62f47328e9c9 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:05.227046 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257f662-b814-452d-a1b8-62f47328e9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:05.229517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257f662-b814-452d-a1b8-62f47328e9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:05.278588 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-7257f662-b814-452d-a1b8-62f47328e9c9 None None] MFA Rules not processed for user `71e978d3d77b43f5a25fddb8daf9bef3`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:05.279945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7257f662-b814-452d-a1b8-62f47328e9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:05.300424 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62d9bf-5ea5-424b-9428-d775d4d52258 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:05.362519 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:05.400675 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e74109-6c3d-4c50-8dba-bec506b929a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:05.401685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e74109-6c3d-4c50-8dba-bec506b929a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:05.402194 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e74109-6c3d-4c50-8dba-bec506b929a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:05.402975 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e74109-6c3d-4c50-8dba-bec506b929a5 admin admin] PATH_INFO: `/v3/users/84da5a0fda454362876283214da70cbc` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:05.404852 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e74109-6c3d-4c50-8dba-bec506b929a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84da5a0fda454362876283214da70cbc)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:05.406629 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 927/1825] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:05 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:05.407569 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e74109-6c3d-4c50-8dba-bec506b929a5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:05.418144 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257f662-b814-452d-a1b8-62f47328e9c9 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:05.419558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7257f662-b814-452d-a1b8-62f47328e9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:05.436559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257f662-b814-452d-a1b8-62f47328e9c9 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:05.443199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c109333-b724-490b-91f7-bf02100d52ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:05.443538 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c109333-b724-490b-91f7-bf02100d52ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:05.443855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c109333-b724-490b-91f7-bf02100d52ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:05.446200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c109333-b724-490b-91f7-bf02100d52ef admin admin] PATH_INFO: `/v3/users/5e6ff1be317643d480987e48e0faf8c1` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:05.447662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c109333-b724-490b-91f7-bf02100d52ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e6ff1be317643d480987e48e0faf8c1)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:05.449555 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c109333-b724-490b-91f7-bf02100d52ef admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:05.466970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-09e74109-6c3d-4c50-8dba-bec506b929a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84da5a0fda454362876283214da70cbc'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:05.512143 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-09e74109-6c3d-4c50-8dba-bec506b929a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84da5a0fda454362876283214da70cbc'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:05.513001 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6c109333-b724-490b-91f7-bf02100d52ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e6ff1be317643d480987e48e0faf8c1'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:05.513864 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-09e74109-6c3d-4c50-8dba-bec506b929a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84da5a0fda454362876283214da70cbc'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:05.521155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-09e74109-6c3d-4c50-8dba-bec506b929a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84da5a0fda454362876283214da70cbc'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:05.534144 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6c109333-b724-490b-91f7-bf02100d52ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e6ff1be317643d480987e48e0faf8c1'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:05.534889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6c109333-b724-490b-91f7-bf02100d52ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e6ff1be317643d480987e48e0faf8c1'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:05.535585 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6c109333-b724-490b-91f7-bf02100d52ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e6ff1be317643d480987e48e0faf8c1'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:05.540956 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-09e74109-6c3d-4c50-8dba-bec506b929a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84da5a0fda454362876283214da70cbc'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:05.546609 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6c109333-b724-490b-91f7-bf02100d52ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e6ff1be317643d480987e48e0faf8c1'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:05.573360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 928/1826] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:05 2022] DELETE /identity/v3/users/5e6ff1be317643d480987e48e0faf8c1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:05.573360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c109333-b724-490b-91f7-bf02100d52ef admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:05.582717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6c109333-b724-490b-91f7-bf02100d52ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:05.598765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 899/1827] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:05 2022] DELETE /identity/v3/users/84da5a0fda454362876283214da70cbc => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:05.602523 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e74109-6c3d-4c50-8dba-bec506b929a5 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:05.604718 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-09e74109-6c3d-4c50-8dba-bec506b929a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:05.613057 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:05.724074 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e74109-6c3d-4c50-8dba-bec506b929a5 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:05.731196 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c109333-b724-490b-91f7-bf02100d52ef admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:05.736925 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea112c0-d4ab-463c-a3e4-2fe935e9b400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:05.737929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea112c0-d4ab-463c-a3e4-2fe935e9b400 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:05.738395 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea112c0-d4ab-463c-a3e4-2fe935e9b400 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:05.738855 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea112c0-d4ab-463c-a3e4-2fe935e9b400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:05.742012 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-aea112c0-d4ab-463c-a3e4-2fe935e9b400 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:05.803803 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622572fa-02d4-4caa-9024-984addb3c0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:05.804556 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622572fa-02d4-4caa-9024-984addb3c0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:05.804843 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622572fa-02d4-4caa-9024-984addb3c0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:05.805145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622572fa-02d4-4caa-9024-984addb3c0af admin admin] PATH_INFO: `/v3/projects/9f61b803017b4a9487091510d6d62e10` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:05.806685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622572fa-02d4-4caa-9024-984addb3c0af admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f61b803017b4a9487091510d6d62e10)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:05.808985 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622572fa-02d4-4caa-9024-984addb3c0af admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:05.819359 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:05.853771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea112c0-d4ab-463c-a3e4-2fe935e9b400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:05.855397 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea112c0-d4ab-463c-a3e4-2fe935e9b400 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:05.879908 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 900/1828] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:05 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:05.884598 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8f76b-8f1f-46ee-ab56-58a50b90a360 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:05.884794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8f76b-8f1f-46ee-ab56-58a50b90a360 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:05.885071 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8f76b-8f1f-46ee-ab56-58a50b90a360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:05.957278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-622572fa-02d4-4caa-9024-984addb3c0af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f61b803017b4a9487091510d6d62e10', 'request_id': 'req-622572fa-02d4-4caa-9024-984addb3c0af'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:05.962116 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-cae8f76b-8f1f-46ee-ab56-58a50b90a360 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:05.966000 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-622572fa-02d4-4caa-9024-984addb3c0af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f61b803017b4a9487091510d6d62e10', 'request_id': 'req-622572fa-02d4-4caa-9024-984addb3c0af'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:05.968545 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cae8f76b-8f1f-46ee-ab56-58a50b90a360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:05.984820 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-622572fa-02d4-4caa-9024-984addb3c0af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f61b803017b4a9487091510d6d62e10', 'request_id': 'req-622572fa-02d4-4caa-9024-984addb3c0af'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:06.005119 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-622572fa-02d4-4caa-9024-984addb3c0af admin admin] The token cache is being invalidate because project 9f61b803017b4a9487091510d6d62e10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:06.005515 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-622572fa-02d4-4caa-9024-984addb3c0af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:06.006563 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-622572fa-02d4-4caa-9024-984addb3c0af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:06.010524 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 929/1829] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:05 2022] DELETE /identity/v3/projects/9f61b803017b4a9487091510d6d62e10 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:06.011297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622572fa-02d4-4caa-9024-984addb3c0af admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:06.014342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-622572fa-02d4-4caa-9024-984addb3c0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:06.085904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 901/1830] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:06.086848 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8f76b-8f1f-46ee-ab56-58a50b90a360 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:06.089754 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cae8f76b-8f1f-46ee-ab56-58a50b90a360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:06.105955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8f76b-8f1f-46ee-ab56-58a50b90a360 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:06.112698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e0dde-baab-46df-b6cd-ab89441b370f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:06.113546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e0dde-baab-46df-b6cd-ab89441b370f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:06.113840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e0dde-baab-46df-b6cd-ab89441b370f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:06.114194 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e0dde-baab-46df-b6cd-ab89441b370f admin admin] PATH_INFO: `/v3/projects/fe846e823dea4e9d9df198beaf167872` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:06.115375 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e0dde-baab-46df-b6cd-ab89441b370f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe846e823dea4e9d9df198beaf167872)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:06.117747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e0dde-baab-46df-b6cd-ab89441b370f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:06.139351 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622572fa-02d4-4caa-9024-984addb3c0af admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:06.146873 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5a83e-4429-4a6b-993a-a5bc831a121f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:06.147820 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5a83e-4429-4a6b-993a-a5bc831a121f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:06.147820 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5a83e-4429-4a6b-993a-a5bc831a121f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:06.148006 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5a83e-4429-4a6b-993a-a5bc831a121f admin admin] PATH_INFO: `/v3/projects/fdc363fc7e7b491cb829e9059b256488` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:06.150717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5a83e-4429-4a6b-993a-a5bc831a121f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc363fc7e7b491cb829e9059b256488)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:06.153692 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5a83e-4429-4a6b-993a-a5bc831a121f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:06.188026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6a9e0dde-baab-46df-b6cd-ab89441b370f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe846e823dea4e9d9df198beaf167872', 'request_id': 'req-6a9e0dde-baab-46df-b6cd-ab89441b370f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:06.198931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6a9e0dde-baab-46df-b6cd-ab89441b370f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe846e823dea4e9d9df198beaf167872', 'request_id': 'req-6a9e0dde-baab-46df-b6cd-ab89441b370f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:06.204875 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:06.207369 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6a9e0dde-baab-46df-b6cd-ab89441b370f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe846e823dea4e9d9df198beaf167872', 'request_id': 'req-6a9e0dde-baab-46df-b6cd-ab89441b370f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:06.221350 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-9ba5a83e-4429-4a6b-993a-a5bc831a121f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc363fc7e7b491cb829e9059b256488', 'request_id': 'req-9ba5a83e-4429-4a6b-993a-a5bc831a121f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:06.223310 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6a9e0dde-baab-46df-b6cd-ab89441b370f admin admin] The token cache is being invalidate because project fe846e823dea4e9d9df198beaf167872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:06.223701 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6a9e0dde-baab-46df-b6cd-ab89441b370f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:06.224431 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6a9e0dde-baab-46df-b6cd-ab89441b370f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:06.226217 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 902/1831] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:06 2022] DELETE /identity/v3/projects/fe846e823dea4e9d9df198beaf167872 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:06.227280 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b1cc6-ba67-464d-9cb8-88abbd2070d8 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:06.227682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b1cc6-ba67-464d-9cb8-88abbd2070d8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:06.228046 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b1cc6-ba67-464d-9cb8-88abbd2070d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:06.228840 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-9ba5a83e-4429-4a6b-993a-a5bc831a121f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc363fc7e7b491cb829e9059b256488', 'request_id': 'req-9ba5a83e-4429-4a6b-993a-a5bc831a121f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:06.239256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-9ba5a83e-4429-4a6b-993a-a5bc831a121f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc363fc7e7b491cb829e9059b256488', 'request_id': 'req-9ba5a83e-4429-4a6b-993a-a5bc831a121f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:06.252508 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-151b1cc6-ba67-464d-9cb8-88abbd2070d8 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:06.253882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-151b1cc6-ba67-464d-9cb8-88abbd2070d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:06.255955 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-9ba5a83e-4429-4a6b-993a-a5bc831a121f admin admin] The token cache is being invalidate because project fdc363fc7e7b491cb829e9059b256488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:06.256247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-9ba5a83e-4429-4a6b-993a-a5bc831a121f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:06.256888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-9ba5a83e-4429-4a6b-993a-a5bc831a121f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:06.258578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 930/1832] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:06 2022] DELETE /identity/v3/projects/fdc363fc7e7b491cb829e9059b256488 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:06.259869 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5a83e-4429-4a6b-993a-a5bc831a121f admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:06.261815 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9ba5a83e-4429-4a6b-993a-a5bc831a121f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:06.289298 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:06.316804 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 903/1833] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:06.318031 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b1cc6-ba67-464d-9cb8-88abbd2070d8 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:06.319544 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-151b1cc6-ba67-464d-9cb8-88abbd2070d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:06.321015 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5a83e-4429-4a6b-993a-a5bc831a121f admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:06.325530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b42b0-c334-4976-920e-130ec4ec25d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:06.326171 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b42b0-c334-4976-920e-130ec4ec25d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:06.326449 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b42b0-c334-4976-920e-130ec4ec25d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:06.326722 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b42b0-c334-4976-920e-130ec4ec25d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:06.328535 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-044b42b0-c334-4976-920e-130ec4ec25d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:06.333378 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b1cc6-ba67-464d-9cb8-88abbd2070d8 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:06.341110 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b42b0-c334-4976-920e-130ec4ec25d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:06.342606 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b42b0-c334-4976-920e-130ec4ec25d7 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:06.343876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08753bb-9234-4ae3-9f6e-7bcec4177fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:06.344513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08753bb-9234-4ae3-9f6e-7bcec4177fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:06.344843 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08753bb-9234-4ae3-9f6e-7bcec4177fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:06.345128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08753bb-9234-4ae3-9f6e-7bcec4177fdb admin admin] PATH_INFO: `/v3/users/d7ef951cde9b4670a897bfb94a07a046` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:06.346291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08753bb-9234-4ae3-9f6e-7bcec4177fdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7ef951cde9b4670a897bfb94a07a046)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:06.348602 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08753bb-9234-4ae3-9f6e-7bcec4177fdb admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:06.354164 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 931/1834] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:06.355399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7738944-ec16-4ad2-8cdf-feedba3fc18a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:06.355688 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7738944-ec16-4ad2-8cdf-feedba3fc18a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:06.355962 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7738944-ec16-4ad2-8cdf-feedba3fc18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:06.382462 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b7738944-ec16-4ad2-8cdf-feedba3fc18a None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:06.383715 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b7738944-ec16-4ad2-8cdf-feedba3fc18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:06.399219 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 932/1835] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:06.399219 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85aa09-8a27-4ee9-9ee7-3516d09d57a2 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:06.399219 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85aa09-8a27-4ee9-9ee7-3516d09d57a2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:06.399219 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85aa09-8a27-4ee9-9ee7-3516d09d57a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:06.407879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e08753bb-9234-4ae3-9f6e-7bcec4177fdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7ef951cde9b4670a897bfb94a07a046'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:06.416049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e08753bb-9234-4ae3-9f6e-7bcec4177fdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7ef951cde9b4670a897bfb94a07a046'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:06.417212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e08753bb-9234-4ae3-9f6e-7bcec4177fdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7ef951cde9b4670a897bfb94a07a046'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:06.417944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e08753bb-9234-4ae3-9f6e-7bcec4177fdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7ef951cde9b4670a897bfb94a07a046'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:06.418116 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-dc85aa09-8a27-4ee9-9ee7-3516d09d57a2 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:06.419374 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-dc85aa09-8a27-4ee9-9ee7-3516d09d57a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:06.426556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e08753bb-9234-4ae3-9f6e-7bcec4177fdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7ef951cde9b4670a897bfb94a07a046'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:06.429141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 933/1836] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:06.430633 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206962e-a67a-490c-aa13-b13dc611ab82 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:06.431432 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206962e-a67a-490c-aa13-b13dc611ab82 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:06.431706 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206962e-a67a-490c-aa13-b13dc611ab82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:06.454549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 904/1837] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:06 2022] DELETE /identity/v3/users/d7ef951cde9b4670a897bfb94a07a046 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:06.455913 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf03f5f-42a4-4abf-ad84-1e65724b4b20 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:06.456203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf03f5f-42a4-4abf-ad84-1e65724b4b20 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:06.456475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf03f5f-42a4-4abf-ad84-1e65724b4b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:06.458516 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-4206962e-a67a-490c-aa13-b13dc611ab82 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:06.459834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4206962e-a67a-490c-aa13-b13dc611ab82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:06.478137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ebf03f5f-42a4-4abf-ad84-1e65724b4b20 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:06.479393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ebf03f5f-42a4-4abf-ad84-1e65724b4b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:06.531945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 934/1838] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:06.533412 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0f24a-8bfc-4406-822e-17febacb9d91 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:06.533713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0f24a-8bfc-4406-822e-17febacb9d91 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:06.534012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0f24a-8bfc-4406-822e-17febacb9d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:06.545054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:06.579422 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 905/1839] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:06.580925 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5632725-7a7b-4604-b1a5-a0ee5a384a28 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:06.581316 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5632725-7a7b-4604-b1a5-a0ee5a384a28 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:06.581667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5632725-7a7b-4604-b1a5-a0ee5a384a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:06.585267 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-90c0f24a-8bfc-4406-822e-17febacb9d91 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:06.586663 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-90c0f24a-8bfc-4406-822e-17febacb9d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:06.600062 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 935/1840] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:06.603780 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c5632725-7a7b-4604-b1a5-a0ee5a384a28 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:06.604031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0f24a-8bfc-4406-822e-17febacb9d91 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:06.605167 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c5632725-7a7b-4604-b1a5-a0ee5a384a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:06.613037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 906/1841] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:06.614011 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5632725-7a7b-4604-b1a5-a0ee5a384a28 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:06.624727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0f24a-8bfc-4406-822e-17febacb9d91 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:06.627304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5632725-7a7b-4604-b1a5-a0ee5a384a28 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:06.629716 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca262606-dbc2-4952-89f2-ab844e5621ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:06.630328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca262606-dbc2-4952-89f2-ab844e5621ef admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:06.630626 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca262606-dbc2-4952-89f2-ab844e5621ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:06.630873 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca262606-dbc2-4952-89f2-ab844e5621ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:06.631581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca262606-dbc2-4952-89f2-ab844e5621ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:45:06.631941 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca262606-dbc2-4952-89f2-ab844e5621ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:06.633590 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca262606-dbc2-4952-89f2-ab844e5621ef admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:06.633697 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7b501-aeb2-4fe9-b308-e0df878a59d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:06.634762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7b501-aeb2-4fe9-b308-e0df878a59d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:06.635043 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7b501-aeb2-4fe9-b308-e0df878a59d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:06.635312 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7b501-aeb2-4fe9-b308-e0df878a59d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:06.636778 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7b501-aeb2-4fe9-b308-e0df878a59d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:45:06.637113 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7b501-aeb2-4fe9-b308-e0df878a59d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:06.638742 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7b501-aeb2-4fe9-b308-e0df878a59d2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:06.651201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 936/1842] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:45:06.651201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca262606-dbc2-4952-89f2-ab844e5621ef admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:06.652704 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 907/1843] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:45:06.654072 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7b501-aeb2-4fe9-b308-e0df878a59d2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:06.655564 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-82d7b501-aeb2-4fe9-b308-e0df878a59d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:06.663843 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca262606-dbc2-4952-89f2-ab844e5621ef admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:06.669107 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29489138-f371-49c0-b9b3-84eae9dfd683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:06.669840 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29489138-f371-49c0-b9b3-84eae9dfd683 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:06.670189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29489138-f371-49c0-b9b3-84eae9dfd683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:06.670557 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29489138-f371-49c0-b9b3-84eae9dfd683 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:06.671347 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29489138-f371-49c0-b9b3-84eae9dfd683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:45:06.671725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29489138-f371-49c0-b9b3-84eae9dfd683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:06.674982 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29489138-f371-49c0-b9b3-84eae9dfd683 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:06.697014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 937/1844] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:45:06.698025 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29489138-f371-49c0-b9b3-84eae9dfd683 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:06.711165 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29489138-f371-49c0-b9b3-84eae9dfd683 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:06.716893 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec9e24-2a3d-4e38-9152-3624f4f1fa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:06.717851 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec9e24-2a3d-4e38-9152-3624f4f1fa2d admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:06.718192 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec9e24-2a3d-4e38-9152-3624f4f1fa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:06.719577 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec9e24-2a3d-4e38-9152-3624f4f1fa2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:06.719577 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec9e24-2a3d-4e38-9152-3624f4f1fa2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:06.721328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec9e24-2a3d-4e38-9152-3624f4f1fa2d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:06.733464 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7b501-aeb2-4fe9-b308-e0df878a59d2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:06.740682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8801593-e96e-4c96-9637-3d90c33fb666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:06.740682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8801593-e96e-4c96-9637-3d90c33fb666 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:06.742027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8801593-e96e-4c96-9637-3d90c33fb666 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:06.742363 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8801593-e96e-4c96-9637-3d90c33fb666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:06.757968 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8801593-e96e-4c96-9637-3d90c33fb666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:06.759489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8801593-e96e-4c96-9637-3d90c33fb666 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:06.763155 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 938/1845] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:06 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:06.763155 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec9e24-2a3d-4e38-9152-3624f4f1fa2d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:06.771616 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 908/1846] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:06.772335 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8801593-e96e-4c96-9637-3d90c33fb666 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:06.782801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8801593-e96e-4c96-9637-3d90c33fb666 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:06.844582 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec9e24-2a3d-4e38-9152-3624f4f1fa2d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:06.851496 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee3d37-6b51-4dda-9608-05d8349f9977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:06.852337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee3d37-6b51-4dda-9608-05d8349f9977 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:06.852455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee3d37-6b51-4dda-9608-05d8349f9977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:06.853608 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989467f3-5a2e-4598-9795-ab92445c14cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:06.854069 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee3d37-6b51-4dda-9608-05d8349f9977 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:06.854243 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989467f3-5a2e-4598-9795-ab92445c14cc admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:06.854498 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989467f3-5a2e-4598-9795-ab92445c14cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:06.854766 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989467f3-5a2e-4598-9795-ab92445c14cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:06.854861 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee3d37-6b51-4dda-9608-05d8349f9977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:06.855575 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989467f3-5a2e-4598-9795-ab92445c14cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:06.857326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee3d37-6b51-4dda-9608-05d8349f9977 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:06.857624 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989467f3-5a2e-4598-9795-ab92445c14cc admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:06.862568 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:06.893843 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 909/1847] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:06 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:06.893843 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989467f3-5a2e-4598-9795-ab92445c14cc admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:06.893843 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-989467f3-5a2e-4598-9795-ab92445c14cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:06.899221 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 939/1848] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:06 2022] POST /identity/v3/projects => generated 363 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:06.899221 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee3d37-6b51-4dda-9608-05d8349f9977 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:06.966868 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee3d37-6b51-4dda-9608-05d8349f9977 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:06.967613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989467f3-5a2e-4598-9795-ab92445c14cc admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:06.972491 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71672ad-fe8a-4cb2-970d-cb4c12d79a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:06.973278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71672ad-fe8a-4cb2-970d-cb4c12d79a65 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:06.973498 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd70862-75c3-4c07-a883-70629364dfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:06.973609 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71672ad-fe8a-4cb2-970d-cb4c12d79a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:06.973961 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71672ad-fe8a-4cb2-970d-cb4c12d79a65 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:06.974130 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd70862-75c3-4c07-a883-70629364dfd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:06.974416 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd70862-75c3-4c07-a883-70629364dfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:06.975064 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd70862-75c3-4c07-a883-70629364dfd9 admin admin] PATH_INFO: `/v3/projects/f962ef7473b64ff79eb3e8bc2141898c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:06.975168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71672ad-fe8a-4cb2-970d-cb4c12d79a65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:06.975939 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd70862-75c3-4c07-a883-70629364dfd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f962ef7473b64ff79eb3e8bc2141898c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:06.977391 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71672ad-fe8a-4cb2-970d-cb4c12d79a65 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:06.977941 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd70862-75c3-4c07-a883-70629364dfd9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:06.979771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:07.012195 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 940/1849] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:06 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:07.013380 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71672ad-fe8a-4cb2-970d-cb4c12d79a65 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:07.025340 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71672ad-fe8a-4cb2-970d-cb4c12d79a65 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:07.040400 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6cd70862-75c3-4c07-a883-70629364dfd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f962ef7473b64ff79eb3e8bc2141898c', 'request_id': 'req-6cd70862-75c3-4c07-a883-70629364dfd9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:07.048246 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6cd70862-75c3-4c07-a883-70629364dfd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f962ef7473b64ff79eb3e8bc2141898c', 'request_id': 'req-6cd70862-75c3-4c07-a883-70629364dfd9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:07.054768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6cd70862-75c3-4c07-a883-70629364dfd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f962ef7473b64ff79eb3e8bc2141898c', 'request_id': 'req-6cd70862-75c3-4c07-a883-70629364dfd9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:07.066880 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6cd70862-75c3-4c07-a883-70629364dfd9 admin admin] The token cache is being invalidate because project f962ef7473b64ff79eb3e8bc2141898c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:07.067164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6cd70862-75c3-4c07-a883-70629364dfd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:07.067842 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6cd70862-75c3-4c07-a883-70629364dfd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:07.069388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 910/1850] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:06 2022] DELETE /identity/v3/projects/f962ef7473b64ff79eb3e8bc2141898c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:07.070126 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd70862-75c3-4c07-a883-70629364dfd9 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:07.072229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6cd70862-75c3-4c07-a883-70629364dfd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:07.092274 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd8bb5-d28f-47ec-acea-b4a5c8a522ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:07.092886 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd8bb5-d28f-47ec-acea-b4a5c8a522ee admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:07.093206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd8bb5-d28f-47ec-acea-b4a5c8a522ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:07.093485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd8bb5-d28f-47ec-acea-b4a5c8a522ee admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:07.094333 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd8bb5-d28f-47ec-acea-b4a5c8a522ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:07.096637 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd8bb5-d28f-47ec-acea-b4a5c8a522ee admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:07.127296 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 941/1851] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:07 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:07.127296 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd8bb5-d28f-47ec-acea-b4a5c8a522ee admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:07.127721 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-90cd8bb5-d28f-47ec-acea-b4a5c8a522ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:07.146139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd8bb5-d28f-47ec-acea-b4a5c8a522ee admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:07.150732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd70862-75c3-4c07-a883-70629364dfd9 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:07.151749 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc56fc6-aa43-4b38-8028-516798e219a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:07.152351 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc56fc6-aa43-4b38-8028-516798e219a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:07.152648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc56fc6-aa43-4b38-8028-516798e219a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:07.152905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc56fc6-aa43-4b38-8028-516798e219a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:07.153863 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc56fc6-aa43-4b38-8028-516798e219a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:07.155387 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc56fc6-aa43-4b38-8028-516798e219a1 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:07.155572 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30a61d-338b-4523-be57-b1acc89efc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:07.156181 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30a61d-338b-4523-be57-b1acc89efc6d admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:07.156461 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30a61d-338b-4523-be57-b1acc89efc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:07.156738 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30a61d-338b-4523-be57-b1acc89efc6d admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:07.157840 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30a61d-338b-4523-be57-b1acc89efc6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:07.159485 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30a61d-338b-4523-be57-b1acc89efc6d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:07.166470 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 942/1852] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:07.167428 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc56fc6-aa43-4b38-8028-516798e219a1 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:07.169064 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cfc56fc6-aa43-4b38-8028-516798e219a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:07.182988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc56fc6-aa43-4b38-8028-516798e219a1 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:07.184451 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 911/1853] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:07 2022] POST /identity/v3/users => generated 282 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:07.185350 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30a61d-338b-4523-be57-b1acc89efc6d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:07.186901 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-da30a61d-338b-4523-be57-b1acc89efc6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:07.190880 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b88d0-38bd-4dfd-a4ab-3e46af2cde14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:07.191505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b88d0-38bd-4dfd-a4ab-3e46af2cde14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:07.191784 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b88d0-38bd-4dfd-a4ab-3e46af2cde14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:07.192057 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b88d0-38bd-4dfd-a4ab-3e46af2cde14 admin admin] PATH_INFO: `/v3/users/a8515b0d193a453695f765451f478900` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:07.193274 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b88d0-38bd-4dfd-a4ab-3e46af2cde14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8515b0d193a453695f765451f478900)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:07.195185 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b88d0-38bd-4dfd-a4ab-3e46af2cde14 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:07.199845 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30a61d-338b-4523-be57-b1acc89efc6d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:07.207261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d796b7-a9e4-407e-b8cd-8501e7215d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:07.209690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d796b7-a9e4-407e-b8cd-8501e7215d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:07.209977 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d796b7-a9e4-407e-b8cd-8501e7215d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:07.210254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d796b7-a9e4-407e-b8cd-8501e7215d91 admin admin] PATH_INFO: `/v3/projects/d74cfa95d4e3411294978931a5eb937a` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:07.211408 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d796b7-a9e4-407e-b8cd-8501e7215d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d74cfa95d4e3411294978931a5eb937a)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:07.213626 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d796b7-a9e4-407e-b8cd-8501e7215d91 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:07.247559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-9c7b88d0-38bd-4dfd-a4ab-3e46af2cde14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8515b0d193a453695f765451f478900'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:07.250222 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:07.261423 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-9c7b88d0-38bd-4dfd-a4ab-3e46af2cde14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8515b0d193a453695f765451f478900'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:07.263087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-9c7b88d0-38bd-4dfd-a4ab-3e46af2cde14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8515b0d193a453695f765451f478900'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:07.263750 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-9c7b88d0-38bd-4dfd-a4ab-3e46af2cde14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8515b0d193a453695f765451f478900'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:07.269394 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-85d796b7-a9e4-407e-b8cd-8501e7215d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd74cfa95d4e3411294978931a5eb937a', 'request_id': 'req-85d796b7-a9e4-407e-b8cd-8501e7215d91'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:07.278675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-9c7b88d0-38bd-4dfd-a4ab-3e46af2cde14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8515b0d193a453695f765451f478900'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:07.293592 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-85d796b7-a9e4-407e-b8cd-8501e7215d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd74cfa95d4e3411294978931a5eb937a', 'request_id': 'req-85d796b7-a9e4-407e-b8cd-8501e7215d91'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:07.301487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-85d796b7-a9e4-407e-b8cd-8501e7215d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd74cfa95d4e3411294978931a5eb937a', 'request_id': 'req-85d796b7-a9e4-407e-b8cd-8501e7215d91'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:07.303128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 943/1854] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:07 2022] DELETE /identity/v3/users/a8515b0d193a453695f765451f478900 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:07.304956 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b88d0-38bd-4dfd-a4ab-3e46af2cde14 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:07.306999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9c7b88d0-38bd-4dfd-a4ab-3e46af2cde14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:07.328982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-85d796b7-a9e4-407e-b8cd-8501e7215d91 admin admin] The token cache is being invalidate because project d74cfa95d4e3411294978931a5eb937a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:07.329313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-85d796b7-a9e4-407e-b8cd-8501e7215d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:07.330939 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-85d796b7-a9e4-407e-b8cd-8501e7215d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:07.336527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 912/1855] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:07 2022] DELETE /identity/v3/projects/d74cfa95d4e3411294978931a5eb937a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:07.342322 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d796b7-a9e4-407e-b8cd-8501e7215d91 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:07.345525 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-85d796b7-a9e4-407e-b8cd-8501e7215d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:07.360330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:07.444004 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b88d0-38bd-4dfd-a4ab-3e46af2cde14 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:07.463390 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de71a6-6609-4d92-b421-daf01971c40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:07.464029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de71a6-6609-4d92-b421-daf01971c40e admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:07.464521 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de71a6-6609-4d92-b421-daf01971c40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:07.464799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de71a6-6609-4d92-b421-daf01971c40e admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:07.466851 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de71a6-6609-4d92-b421-daf01971c40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:07.470423 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de71a6-6609-4d92-b421-daf01971c40e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:07.474966 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d796b7-a9e4-407e-b8cd-8501e7215d91 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:07.482464 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc323f-8ec9-46ad-a84f-78a022c0c097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:07.483108 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc323f-8ec9-46ad-a84f-78a022c0c097 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:07.483386 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc323f-8ec9-46ad-a84f-78a022c0c097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:07.483656 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc323f-8ec9-46ad-a84f-78a022c0c097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:07.484334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc323f-8ec9-46ad-a84f-78a022c0c097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:07.485966 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc323f-8ec9-46ad-a84f-78a022c0c097 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:07.486649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 944/1856] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:07.487746 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de71a6-6609-4d92-b421-daf01971c40e admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:07.491178 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a3de71a6-6609-4d92-b421-daf01971c40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:07.507640 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 913/1857] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:07.507640 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc323f-8ec9-46ad-a84f-78a022c0c097 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:07.509220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-74cc323f-8ec9-46ad-a84f-78a022c0c097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:07.525065 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc323f-8ec9-46ad-a84f-78a022c0c097 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:07.525622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de71a6-6609-4d92-b421-daf01971c40e admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:07.535164 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64a445-7ce7-428f-9130-61e4cda68007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:07.535598 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b191b6-9d4c-4d15-9060-7993086c537c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:07.536150 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64a445-7ce7-428f-9130-61e4cda68007 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:07.536255 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b191b6-9d4c-4d15-9060-7993086c537c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:07.536327 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64a445-7ce7-428f-9130-61e4cda68007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:07.536636 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b191b6-9d4c-4d15-9060-7993086c537c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:07.536736 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64a445-7ce7-428f-9130-61e4cda68007 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:07.536825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b191b6-9d4c-4d15-9060-7993086c537c admin admin] PATH_INFO: `/v3/users/71e978d3d77b43f5a25fddb8daf9bef3` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:07.537992 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64a445-7ce7-428f-9130-61e4cda68007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:07.538114 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b191b6-9d4c-4d15-9060-7993086c537c admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e978d3d77b43f5a25fddb8daf9bef3)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:07.539183 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64a445-7ce7-428f-9130-61e4cda68007 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:07.539993 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b191b6-9d4c-4d15-9060-7993086c537c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:07.558501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 945/1858] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:07.559467 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64a445-7ce7-428f-9130-61e4cda68007 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:07.562428 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ad64a445-7ce7-428f-9130-61e4cda68007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:07.577337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64a445-7ce7-428f-9130-61e4cda68007 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:07.582843 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067bbb4-fd9b-45af-8ceb-cc70f15b6cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:07.584164 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067bbb4-fd9b-45af-8ceb-cc70f15b6cea admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:07.584275 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067bbb4-fd9b-45af-8ceb-cc70f15b6cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:07.584557 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067bbb4-fd9b-45af-8ceb-cc70f15b6cea admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:07.585321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067bbb4-fd9b-45af-8ceb-cc70f15b6cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:07.587167 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067bbb4-fd9b-45af-8ceb-cc70f15b6cea admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:07.607527 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 946/1859] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:07.607527 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067bbb4-fd9b-45af-8ceb-cc70f15b6cea admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:07.616481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067bbb4-fd9b-45af-8ceb-cc70f15b6cea admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:07.622734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04579335-03fa-4034-bd10-d905827c8397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:07.623725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04579335-03fa-4034-bd10-d905827c8397 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:07.624129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04579335-03fa-4034-bd10-d905827c8397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:07.624441 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a2b191b6-9d4c-4d15-9060-7993086c537c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e978d3d77b43f5a25fddb8daf9bef3'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:07.624904 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04579335-03fa-4034-bd10-d905827c8397 admin admin] PATH_INFO: `/v3/projects/cb6e078601764cf28033d922fe18e531/users/63e558bb6c92419ebd40faa4fdf82a5c/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:07.643620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a2b191b6-9d4c-4d15-9060-7993086c537c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e978d3d77b43f5a25fddb8daf9bef3'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:07.644525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04579335-03fa-4034-bd10-d905827c8397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb6e078601764cf28033d922fe18e531, user_id=63e558bb6c92419ebd40faa4fdf82a5c, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:07.645375 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a2b191b6-9d4c-4d15-9060-7993086c537c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e978d3d77b43f5a25fddb8daf9bef3'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:07.646423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a2b191b6-9d4c-4d15-9060-7993086c537c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e978d3d77b43f5a25fddb8daf9bef3'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:07.647679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04579335-03fa-4034-bd10-d905827c8397 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:07.671622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 947/1860] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:07 2022] PUT /identity/v3/projects/cb6e078601764cf28033d922fe18e531/users/63e558bb6c92419ebd40faa4fdf82a5c/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:07.671622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04579335-03fa-4034-bd10-d905827c8397 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:07.671816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a2b191b6-9d4c-4d15-9060-7993086c537c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e978d3d77b43f5a25fddb8daf9bef3'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:07.673503 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-04579335-03fa-4034-bd10-d905827c8397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:07.716435 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 914/1861] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:07 2022] DELETE /identity/v3/users/71e978d3d77b43f5a25fddb8daf9bef3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:07.716435 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b191b6-9d4c-4d15-9060-7993086c537c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:07.716435 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a2b191b6-9d4c-4d15-9060-7993086c537c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:07.782770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04579335-03fa-4034-bd10-d905827c8397 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:07.809660 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:07.830729 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b191b6-9d4c-4d15-9060-7993086c537c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:07.844862 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66c6a1-5ca3-45a0-922f-a73b9a8c570c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:07.846223 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66c6a1-5ca3-45a0-922f-a73b9a8c570c admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:07.846513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66c6a1-5ca3-45a0-922f-a73b9a8c570c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:07.847131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66c6a1-5ca3-45a0-922f-a73b9a8c570c admin admin] PATH_INFO: `/v3/projects/a0c3d3f2733e446383a50a5984c52888/users/28292adf9143421a8735ff017f3a440e/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:07.882464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6dbe9-7730-4a0d-a210-85cfd20c026f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:07.882666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66c6a1-5ca3-45a0-922f-a73b9a8c570c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0c3d3f2733e446383a50a5984c52888, user_id=28292adf9143421a8735ff017f3a440e, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:07.883018 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6dbe9-7730-4a0d-a210-85cfd20c026f admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:07.883573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6dbe9-7730-4a0d-a210-85cfd20c026f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:07.883689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6dbe9-7730-4a0d-a210-85cfd20c026f admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:07.884694 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6dbe9-7730-4a0d-a210-85cfd20c026f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:07.884850 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66c6a1-5ca3-45a0-922f-a73b9a8c570c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:07.887025 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6dbe9-7730-4a0d-a210-85cfd20c026f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:07.891604 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:07.904473 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 948/1862] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:07.905656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6dbe9-7730-4a0d-a210-85cfd20c026f admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:07.907808 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e3d6dbe9-7730-4a0d-a210-85cfd20c026f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:07.914473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 915/1863] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:07 2022] PUT /identity/v3/projects/a0c3d3f2733e446383a50a5984c52888/users/28292adf9143421a8735ff017f3a440e/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:07.916327 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9157c95-3f6c-47d1-8dae-958ed5a42b5f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:07.916764 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9157c95-3f6c-47d1-8dae-958ed5a42b5f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:07.917214 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9157c95-3f6c-47d1-8dae-958ed5a42b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:07.939726 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6dbe9-7730-4a0d-a210-85cfd20c026f admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:07.964213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d9157c95-3f6c-47d1-8dae-958ed5a42b5f None None] MFA Rules not processed for user `63e558bb6c92419ebd40faa4fdf82a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:07.966007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d9157c95-3f6c-47d1-8dae-958ed5a42b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:08.032845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bb5d5-747b-4ab4-be34-be867f1a94d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:08.034386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bb5d5-747b-4ab4-be34-be867f1a94d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:08.034681 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bb5d5-747b-4ab4-be34-be867f1a94d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:08.034962 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bb5d5-747b-4ab4-be34-be867f1a94d4 admin admin] PATH_INFO: `/v3/projects/d1ad0507f19247bcbc8c91bd197a04ff` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:08.036618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bb5d5-747b-4ab4-be34-be867f1a94d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ad0507f19247bcbc8c91bd197a04ff)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:08.039087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bb5d5-747b-4ab4-be34-be867f1a94d4 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:08.044862 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 916/1864] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:08.045761 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9157c95-3f6c-47d1-8dae-958ed5a42b5f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:08.075800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9157c95-3f6c-47d1-8dae-958ed5a42b5f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:08.087546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f23867-0ab2-4d42-b77f-46b3e172af94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:08.088293 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f23867-0ab2-4d42-b77f-46b3e172af94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:08.088572 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f23867-0ab2-4d42-b77f-46b3e172af94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:08.088867 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f23867-0ab2-4d42-b77f-46b3e172af94 admin admin] PATH_INFO: `/v3/projects/c8b9c810e6544034a3bff5e64305cb95/users/c16dc048f50746f5b748762845ffd0c9/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:08.110291 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-ab9bb5d5-747b-4ab4-be34-be867f1a94d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ad0507f19247bcbc8c91bd197a04ff', 'request_id': 'req-ab9bb5d5-747b-4ab4-be34-be867f1a94d4'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:08.110983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f23867-0ab2-4d42-b77f-46b3e172af94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b9c810e6544034a3bff5e64305cb95, user_id=c16dc048f50746f5b748762845ffd0c9, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:08.114594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f23867-0ab2-4d42-b77f-46b3e172af94 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:08.121806 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-ab9bb5d5-747b-4ab4-be34-be867f1a94d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ad0507f19247bcbc8c91bd197a04ff', 'request_id': 'req-ab9bb5d5-747b-4ab4-be34-be867f1a94d4'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:08.132127 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-ab9bb5d5-747b-4ab4-be34-be867f1a94d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ad0507f19247bcbc8c91bd197a04ff', 'request_id': 'req-ab9bb5d5-747b-4ab4-be34-be867f1a94d4'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:08.135855 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 917/1865] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:08 2022] PUT /identity/v3/projects/c8b9c810e6544034a3bff5e64305cb95/users/c16dc048f50746f5b748762845ffd0c9/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:08.145319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f810624-a9ac-4a5f-900e-864b5c2b0cd1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:08.145319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f810624-a9ac-4a5f-900e-864b5c2b0cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:08.145319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f810624-a9ac-4a5f-900e-864b5c2b0cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:08.151338 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-ab9bb5d5-747b-4ab4-be34-be867f1a94d4 admin admin] The token cache is being invalidate because project d1ad0507f19247bcbc8c91bd197a04ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:08.151635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-ab9bb5d5-747b-4ab4-be34-be867f1a94d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:08.152623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-ab9bb5d5-747b-4ab4-be34-be867f1a94d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:08.154106 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 949/1866] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:07 2022] DELETE /identity/v3/projects/d1ad0507f19247bcbc8c91bd197a04ff => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:08.154783 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bb5d5-747b-4ab4-be34-be867f1a94d4 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:08.156087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ab9bb5d5-747b-4ab4-be34-be867f1a94d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:08.183579 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1f810624-a9ac-4a5f-900e-864b5c2b0cd1 None None] MFA Rules not processed for user `28292adf9143421a8735ff017f3a440e`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:08.185363 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1f810624-a9ac-4a5f-900e-864b5c2b0cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:08.220989 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:08.240149 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bb5d5-747b-4ab4-be34-be867f1a94d4 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:08.264509 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 918/1867] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:08.265740 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c22e33-22d4-49a3-b5a1-ff3bd33ea344 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:08.266117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c22e33-22d4-49a3-b5a1-ff3bd33ea344 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:08.266460 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c22e33-22d4-49a3-b5a1-ff3bd33ea344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:08.298904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-27c22e33-22d4-49a3-b5a1-ff3bd33ea344 None None] MFA Rules not processed for user `c16dc048f50746f5b748762845ffd0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:08.300261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-27c22e33-22d4-49a3-b5a1-ff3bd33ea344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:08.304635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09f90f-8dca-4fe7-af10-a06df471fe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:08.305227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09f90f-8dca-4fe7-af10-a06df471fe9e admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:08.305826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09f90f-8dca-4fe7-af10-a06df471fe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:08.305949 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09f90f-8dca-4fe7-af10-a06df471fe9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:08.306502 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09f90f-8dca-4fe7-af10-a06df471fe9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:08.308572 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09f90f-8dca-4fe7-af10-a06df471fe9e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:08.351181 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 950/1868] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:08 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:08.351181 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09f90f-8dca-4fe7-af10-a06df471fe9e admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:08.353221 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4b09f90f-8dca-4fe7-af10-a06df471fe9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:08.358240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:08.404653 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 919/1869] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:08.404653 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c22e33-22d4-49a3-b5a1-ff3bd33ea344 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:08.404653 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-27c22e33-22d4-49a3-b5a1-ff3bd33ea344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:08.417997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c22e33-22d4-49a3-b5a1-ff3bd33ea344 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:08.442377 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09f90f-8dca-4fe7-af10-a06df471fe9e admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:08.450496 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f15e2-aac0-4432-bc2e-93a4a97189c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:08.451294 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f15e2-aac0-4432-bc2e-93a4a97189c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:08.451538 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f15e2-aac0-4432-bc2e-93a4a97189c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:08.451821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f15e2-aac0-4432-bc2e-93a4a97189c7 admin admin] PATH_INFO: `/v3/users/9705c576743c435285aa2b99eb542b6e` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:08.453859 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f15e2-aac0-4432-bc2e-93a4a97189c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9705c576743c435285aa2b99eb542b6e)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:08.455471 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f15e2-aac0-4432-bc2e-93a4a97189c7 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:08.490029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd47a6-8b00-4990-b0e4-a06f1b06083a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:08.490915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd47a6-8b00-4990-b0e4-a06f1b06083a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:08.491066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd47a6-8b00-4990-b0e4-a06f1b06083a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:08.491232 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd47a6-8b00-4990-b0e4-a06f1b06083a admin admin] PATH_INFO: `/v3/projects/eaebc1f5f4d54cd8b0fa968caede6c8e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:08.492388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd47a6-8b00-4990-b0e4-a06f1b06083a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaebc1f5f4d54cd8b0fa968caede6c8e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:08.494603 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd47a6-8b00-4990-b0e4-a06f1b06083a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:08.526266 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-b82f15e2-aac0-4432-bc2e-93a4a97189c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9705c576743c435285aa2b99eb542b6e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:08.538219 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-b82f15e2-aac0-4432-bc2e-93a4a97189c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9705c576743c435285aa2b99eb542b6e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:08.539347 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-b82f15e2-aac0-4432-bc2e-93a4a97189c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9705c576743c435285aa2b99eb542b6e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:08.540686 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-b82f15e2-aac0-4432-bc2e-93a4a97189c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9705c576743c435285aa2b99eb542b6e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:08.550722 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-b82f15e2-aac0-4432-bc2e-93a4a97189c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9705c576743c435285aa2b99eb542b6e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:08.567783 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:08.570057 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e6fd47a6-8b00-4990-b0e4-a06f1b06083a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaebc1f5f4d54cd8b0fa968caede6c8e', 'request_id': 'req-e6fd47a6-8b00-4990-b0e4-a06f1b06083a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:08.584589 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e6fd47a6-8b00-4990-b0e4-a06f1b06083a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaebc1f5f4d54cd8b0fa968caede6c8e', 'request_id': 'req-e6fd47a6-8b00-4990-b0e4-a06f1b06083a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:08.585079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 951/1870] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:08 2022] DELETE /identity/v3/users/9705c576743c435285aa2b99eb542b6e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:08.586112 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f15e2-aac0-4432-bc2e-93a4a97189c7 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:08.593927 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b82f15e2-aac0-4432-bc2e-93a4a97189c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:08.596063 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e6fd47a6-8b00-4990-b0e4-a06f1b06083a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaebc1f5f4d54cd8b0fa968caede6c8e', 'request_id': 'req-e6fd47a6-8b00-4990-b0e4-a06f1b06083a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:08.611809 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e6fd47a6-8b00-4990-b0e4-a06f1b06083a admin admin] The token cache is being invalidate because project eaebc1f5f4d54cd8b0fa968caede6c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:08.612636 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e6fd47a6-8b00-4990-b0e4-a06f1b06083a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:08.613657 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e6fd47a6-8b00-4990-b0e4-a06f1b06083a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:08.619570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 920/1871] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:08 2022] DELETE /identity/v3/projects/eaebc1f5f4d54cd8b0fa968caede6c8e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:08.619570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd47a6-8b00-4990-b0e4-a06f1b06083a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:08.619570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e6fd47a6-8b00-4990-b0e4-a06f1b06083a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:08.727209 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd47a6-8b00-4990-b0e4-a06f1b06083a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:08.729019 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f15e2-aac0-4432-bc2e-93a4a97189c7 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:08.732754 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03981f4-68ef-483a-8394-e105b500bfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:08.733490 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03981f4-68ef-483a-8394-e105b500bfd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:08.733834 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03981f4-68ef-483a-8394-e105b500bfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:08.734118 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03981f4-68ef-483a-8394-e105b500bfd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:08.734677 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d684db-2842-4a8d-ae60-8cf3101dd101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:08.734790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03981f4-68ef-483a-8394-e105b500bfd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:08.735394 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d684db-2842-4a8d-ae60-8cf3101dd101 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:08.735748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d684db-2842-4a8d-ae60-8cf3101dd101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:08.736094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d684db-2842-4a8d-ae60-8cf3101dd101 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:08.736895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03981f4-68ef-483a-8394-e105b500bfd2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:08.737001 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d684db-2842-4a8d-ae60-8cf3101dd101 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:08.738822 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d684db-2842-4a8d-ae60-8cf3101dd101 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:08.757805 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:08.766062 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 921/1872] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:08 2022] POST /identity/v3/users => generated 299 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:08.766062 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03981f4-68ef-483a-8394-e105b500bfd2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:08.766655 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b03981f4-68ef-483a-8394-e105b500bfd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:08.770586 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 952/1873] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:08 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:08.772086 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3e413-52f4-4764-a9cb-93a499a99213 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:08.772382 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3e413-52f4-4764-a9cb-93a499a99213 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:08.772680 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3e413-52f4-4764-a9cb-93a499a99213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:08.787465 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03981f4-68ef-483a-8394-e105b500bfd2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:08.794244 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b9f3e413-52f4-4764-a9cb-93a499a99213 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:08.795466 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b9f3e413-52f4-4764-a9cb-93a499a99213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:08.851925 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a72163-62d8-4d29-b060-a06ad04e7737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:08.852568 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a72163-62d8-4d29-b060-a06ad04e7737 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:08.852851 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a72163-62d8-4d29-b060-a06ad04e7737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:08.853151 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a72163-62d8-4d29-b060-a06ad04e7737 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:08.853804 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a72163-62d8-4d29-b060-a06ad04e7737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:08.855899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a72163-62d8-4d29-b060-a06ad04e7737 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:08.865150 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 953/1874] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:08.866099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3e413-52f4-4764-a9cb-93a499a99213 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:08.879135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3e413-52f4-4764-a9cb-93a499a99213 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:08.885820 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350f874-37b4-453f-a141-ed644f913bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:08.886441 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350f874-37b4-453f-a141-ed644f913bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:08.886808 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350f874-37b4-453f-a141-ed644f913bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:08.887089 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350f874-37b4-453f-a141-ed644f913bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:08.887794 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350f874-37b4-453f-a141-ed644f913bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:08.889539 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350f874-37b4-453f-a141-ed644f913bd1 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:08.900140 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 922/1875] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:08 2022] POST /identity/v3/projects => generated 361 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:08.900140 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a72163-62d8-4d29-b060-a06ad04e7737 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:08.905796 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 954/1876] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:08.905796 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7adb1-2b80-4305-8ec0-7c626ec47956 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:08.906017 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d0a72163-62d8-4d29-b060-a06ad04e7737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:08.906106 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7adb1-2b80-4305-8ec0-7c626ec47956 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:08.906106 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7adb1-2b80-4305-8ec0-7c626ec47956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:08.925919 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-e1e7adb1-2b80-4305-8ec0-7c626ec47956 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:08.928069 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e1e7adb1-2b80-4305-8ec0-7c626ec47956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:08.983598 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a72163-62d8-4d29-b060-a06ad04e7737 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:08.988445 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe71682-f7b7-4317-99b5-e5dad8d73d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:08.989114 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe71682-f7b7-4317-99b5-e5dad8d73d2f admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:08.989396 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe71682-f7b7-4317-99b5-e5dad8d73d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:08.989690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe71682-f7b7-4317-99b5-e5dad8d73d2f admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:08.990298 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe71682-f7b7-4317-99b5-e5dad8d73d2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:08.992390 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe71682-f7b7-4317-99b5-e5dad8d73d2f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:09.013666 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 955/1877] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:09.014780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7adb1-2b80-4305-8ec0-7c626ec47956 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:09.019003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 923/1878] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:08 2022] POST /identity/v3/users => generated 295 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:09.020197 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe71682-f7b7-4317-99b5-e5dad8d73d2f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:09.021994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0fe71682-f7b7-4317-99b5-e5dad8d73d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:09.027412 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7adb1-2b80-4305-8ec0-7c626ec47956 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:09.034399 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe71682-f7b7-4317-99b5-e5dad8d73d2f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:09.034895 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cc1ac-4261-4209-b775-29599f483efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:09.036345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cc1ac-4261-4209-b775-29599f483efd admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.036857 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cc1ac-4261-4209-b775-29599f483efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.037173 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cc1ac-4261-4209-b775-29599f483efd admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.037809 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cc1ac-4261-4209-b775-29599f483efd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:09.040691 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e846b7f-66b6-4306-932d-5cd0d9ef6800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:09.040815 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cc1ac-4261-4209-b775-29599f483efd admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:09.041351 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e846b7f-66b6-4306-932d-5cd0d9ef6800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.041637 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e846b7f-66b6-4306-932d-5cd0d9ef6800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.041911 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e846b7f-66b6-4306-932d-5cd0d9ef6800 admin admin] PATH_INFO: `/v3/projects/a64f030efded461f91cdb0985f2a3432` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.043066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e846b7f-66b6-4306-932d-5cd0d9ef6800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a64f030efded461f91cdb0985f2a3432)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:09.044961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e846b7f-66b6-4306-932d-5cd0d9ef6800 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:09.064238 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:09.071439 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 956/1879] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:09 2022] POST /identity/v3/users => generated 287 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:09.072451 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cc1ac-4261-4209-b775-29599f483efd admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:09.085408 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cc1ac-4261-4209-b775-29599f483efd admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:09.093359 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d10b6-67f5-4342-9f38-0fe03866edf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:09.093359 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d10b6-67f5-4342-9f38-0fe03866edf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.093359 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d10b6-67f5-4342-9f38-0fe03866edf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.093359 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d10b6-67f5-4342-9f38-0fe03866edf3 admin admin] PATH_INFO: `/v3/projects/bfb150aeee1240afbdf5baf1905a8e3e/users/8a05b41b326b4a8ea61b4d6a5de5175f/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.120753 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d10b6-67f5-4342-9f38-0fe03866edf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb150aeee1240afbdf5baf1905a8e3e, user_id=8a05b41b326b4a8ea61b4d6a5de5175f, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:09.122263 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6e846b7f-66b6-4306-932d-5cd0d9ef6800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a64f030efded461f91cdb0985f2a3432', 'request_id': 'req-6e846b7f-66b6-4306-932d-5cd0d9ef6800'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:09.124725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d10b6-67f5-4342-9f38-0fe03866edf3 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:09.133373 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6e846b7f-66b6-4306-932d-5cd0d9ef6800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a64f030efded461f91cdb0985f2a3432', 'request_id': 'req-6e846b7f-66b6-4306-932d-5cd0d9ef6800'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:09.145457 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 957/1880] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:09 2022] PUT /identity/v3/projects/bfb150aeee1240afbdf5baf1905a8e3e/users/8a05b41b326b4a8ea61b4d6a5de5175f/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:09.147233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d10b6-67f5-4342-9f38-0fe03866edf3 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:09.147486 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6e846b7f-66b6-4306-932d-5cd0d9ef6800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a64f030efded461f91cdb0985f2a3432', 'request_id': 'req-6e846b7f-66b6-4306-932d-5cd0d9ef6800'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:09.150960 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:09.165520 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6e846b7f-66b6-4306-932d-5cd0d9ef6800 admin admin] The token cache is being invalidate because project a64f030efded461f91cdb0985f2a3432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:09.166257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6e846b7f-66b6-4306-932d-5cd0d9ef6800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:09.167757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6e846b7f-66b6-4306-932d-5cd0d9ef6800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:09.171136 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 924/1881] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:09 2022] DELETE /identity/v3/projects/a64f030efded461f91cdb0985f2a3432 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:09.172177 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e846b7f-66b6-4306-932d-5cd0d9ef6800 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:09.173789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6e846b7f-66b6-4306-932d-5cd0d9ef6800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:09.267778 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d10b6-67f5-4342-9f38-0fe03866edf3 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:09.274636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f287e0e-2476-4ee6-b275-3d726464046c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:09.275497 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f287e0e-2476-4ee6-b275-3d726464046c admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.276340 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f287e0e-2476-4ee6-b275-3d726464046c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.276340 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f287e0e-2476-4ee6-b275-3d726464046c admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.277012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f287e0e-2476-4ee6-b275-3d726464046c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:45:09.277630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f287e0e-2476-4ee6-b275-3d726464046c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:09.279562 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f287e0e-2476-4ee6-b275-3d726464046c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:09.297301 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 958/1882] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:45:09.298256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f287e0e-2476-4ee6-b275-3d726464046c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:09.309690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1f287e0e-2476-4ee6-b275-3d726464046c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:09.331927 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f287e0e-2476-4ee6-b275-3d726464046c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:09.337609 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e32cd-94f0-4732-b089-d8c82fd4492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:09.338439 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e32cd-94f0-4732-b089-d8c82fd4492b admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.338786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e32cd-94f0-4732-b089-d8c82fd4492b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.339118 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e32cd-94f0-4732-b089-d8c82fd4492b admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.339822 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e32cd-94f0-4732-b089-d8c82fd4492b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:09.341685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e32cd-94f0-4732-b089-d8c82fd4492b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:09.346367 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e846b7f-66b6-4306-932d-5cd0d9ef6800 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:09.352003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031a6f9-87ab-4a38-afde-6b01b5dac4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:09.353187 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031a6f9-87ab-4a38-afde-6b01b5dac4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.353478 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031a6f9-87ab-4a38-afde-6b01b5dac4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.353810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031a6f9-87ab-4a38-afde-6b01b5dac4e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.355161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031a6f9-87ab-4a38-afde-6b01b5dac4e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:09.356074 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031a6f9-87ab-4a38-afde-6b01b5dac4e2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:09.356868 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 959/1883] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:09.357977 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e32cd-94f0-4732-b089-d8c82fd4492b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:09.359808 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b71e32cd-94f0-4732-b089-d8c82fd4492b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:09.372038 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 925/1884] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:09.373324 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d55598-fd4f-4f03-82fa-31d488fa9263 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.373614 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d55598-fd4f-4f03-82fa-31d488fa9263 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.373961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d55598-fd4f-4f03-82fa-31d488fa9263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.376999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e32cd-94f0-4732-b089-d8c82fd4492b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:09.385568 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a27be8-e7f3-486b-b0c5-5db4e49b3d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:09.386499 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a27be8-e7f3-486b-b0c5-5db4e49b3d4c admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.386945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a27be8-e7f3-486b-b0c5-5db4e49b3d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.387379 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a27be8-e7f3-486b-b0c5-5db4e49b3d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.388328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a27be8-e7f3-486b-b0c5-5db4e49b3d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:09.391012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a27be8-e7f3-486b-b0c5-5db4e49b3d4c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:09.394371 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-35d55598-fd4f-4f03-82fa-31d488fa9263 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:09.395647 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-35d55598-fd4f-4f03-82fa-31d488fa9263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:09.409047 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 960/1885] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:09.409047 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a27be8-e7f3-486b-b0c5-5db4e49b3d4c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:09.418133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 926/1886] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:09.418133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d55598-fd4f-4f03-82fa-31d488fa9263 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:09.418377 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-65a27be8-e7f3-486b-b0c5-5db4e49b3d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:09.429613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d55598-fd4f-4f03-82fa-31d488fa9263 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:09.429807 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a27be8-e7f3-486b-b0c5-5db4e49b3d4c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:09.434875 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2e9ea-3127-4c7a-8991-5fc21b6d491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:09.435231 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a926c0-26d4-4542-90e8-a8a50ccdf184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:09.435741 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2e9ea-3127-4c7a-8991-5fc21b6d491f admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.436615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a926c0-26d4-4542-90e8-a8a50ccdf184 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.436726 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2e9ea-3127-4c7a-8991-5fc21b6d491f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.436726 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2e9ea-3127-4c7a-8991-5fc21b6d491f admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.436873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a926c0-26d4-4542-90e8-a8a50ccdf184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.437047 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2e9ea-3127-4c7a-8991-5fc21b6d491f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:09.437219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a926c0-26d4-4542-90e8-a8a50ccdf184 admin admin] PATH_INFO: `/v3/projects/4b27246d434a481cbb5f2d73bee91213/users/760b8b8d059649668355a6c631b9a623/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.439377 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2e9ea-3127-4c7a-8991-5fc21b6d491f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:09.454432 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a926c0-26d4-4542-90e8-a8a50ccdf184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b27246d434a481cbb5f2d73bee91213, user_id=760b8b8d059649668355a6c631b9a623, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:09.457689 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a926c0-26d4-4542-90e8-a8a50ccdf184 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:09.474114 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 927/1887] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:09 2022] PUT /identity/v3/projects/4b27246d434a481cbb5f2d73bee91213/users/760b8b8d059649668355a6c631b9a623/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:09.478396 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 961/1888] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:09 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:09.478396 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2e9ea-3127-4c7a-8991-5fc21b6d491f admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:09.478913 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a926c0-26d4-4542-90e8-a8a50ccdf184 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:09.560418 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a926c0-26d4-4542-90e8-a8a50ccdf184 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:09.562402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2e9ea-3127-4c7a-8991-5fc21b6d491f admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:09.566639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c8115-e0a2-4f1b-83b3-a7bfe1bfb4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:09.567248 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd47140-e326-430d-9418-83eb0f1413b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:09.567383 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c8115-e0a2-4f1b-83b3-a7bfe1bfb4f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.567666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c8115-e0a2-4f1b-83b3-a7bfe1bfb4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.567912 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd47140-e326-430d-9418-83eb0f1413b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.568086 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c8115-e0a2-4f1b-83b3-a7bfe1bfb4f8 admin admin] PATH_INFO: `/v3/projects/5284271477794d858c691a677b25fcd7/users/aae369f2c8de4ef391347ea3eeacf606/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.568189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd47140-e326-430d-9418-83eb0f1413b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.568470 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd47140-e326-430d-9418-83eb0f1413b8 admin admin] PATH_INFO: `/v3/projects/bfb150aeee1240afbdf5baf1905a8e3e/users/8a05b41b326b4a8ea61b4d6a5de5175f/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.570380 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd47140-e326-430d-9418-83eb0f1413b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb150aeee1240afbdf5baf1905a8e3e, user_id=8a05b41b326b4a8ea61b4d6a5de5175f, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:09.573095 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd47140-e326-430d-9418-83eb0f1413b8 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:09.585068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 962/1889] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:09 2022] PUT /identity/v3/projects/bfb150aeee1240afbdf5baf1905a8e3e/users/8a05b41b326b4a8ea61b4d6a5de5175f/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:09.588401 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c8115-e0a2-4f1b-83b3-a7bfe1bfb4f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5284271477794d858c691a677b25fcd7, user_id=aae369f2c8de4ef391347ea3eeacf606, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:09.590425 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82022d2-dec4-40c2-95b5-5c38e71ef09a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.590787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82022d2-dec4-40c2-95b5-5c38e71ef09a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.591139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82022d2-dec4-40c2-95b5-5c38e71ef09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.591598 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c8115-e0a2-4f1b-83b3-a7bfe1bfb4f8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:09.610303 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 928/1890] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:09 2022] PUT /identity/v3/projects/5284271477794d858c691a677b25fcd7/users/aae369f2c8de4ef391347ea3eeacf606/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:09.610782 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c8115-e0a2-4f1b-83b3-a7bfe1bfb4f8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:09.613024 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f82022d2-dec4-40c2-95b5-5c38e71ef09a None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:09.614297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f82022d2-dec4-40c2-95b5-5c38e71ef09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:09.628752 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:09.659539 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:09.678382 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c8115-e0a2-4f1b-83b3-a7bfe1bfb4f8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:09.680912 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 963/1891] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:09.681781 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82022d2-dec4-40c2-95b5-5c38e71ef09a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:09.683215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846d4da-f43e-4d0a-875c-3a50751dd5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:09.683821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846d4da-f43e-4d0a-875c-3a50751dd5ee admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.684123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846d4da-f43e-4d0a-875c-3a50751dd5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.684366 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846d4da-f43e-4d0a-875c-3a50751dd5ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.685105 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846d4da-f43e-4d0a-875c-3a50751dd5ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:09.686796 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846d4da-f43e-4d0a-875c-3a50751dd5ee admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:09.691501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82022d2-dec4-40c2-95b5-5c38e71ef09a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:09.697855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455141db-5699-40df-a713-98012575a1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:09.698509 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 929/1892] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:09.698601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455141db-5699-40df-a713-98012575a1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.698786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455141db-5699-40df-a713-98012575a1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.699000 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455141db-5699-40df-a713-98012575a1d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.699633 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455141db-5699-40df-a713-98012575a1d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:09.699746 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39872949-dfe0-4556-9eb7-353be0756942 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.700055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39872949-dfe0-4556-9eb7-353be0756942 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.700415 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39872949-dfe0-4556-9eb7-353be0756942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.701807 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455141db-5699-40df-a713-98012575a1d2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:09.729747 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 964/1893] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:09 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:09.729747 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455141db-5699-40df-a713-98012575a1d2 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:09.733950 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-39872949-dfe0-4556-9eb7-353be0756942 None None] MFA Rules not processed for user `8a05b41b326b4a8ea61b4d6a5de5175f`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:09.735095 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-39872949-dfe0-4556-9eb7-353be0756942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:09.740060 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455141db-5699-40df-a713-98012575a1d2 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:09.747333 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573ee08-b485-4c5f-a63e-c1e36f33e0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:09.748060 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573ee08-b485-4c5f-a63e-c1e36f33e0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.748347 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573ee08-b485-4c5f-a63e-c1e36f33e0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.748617 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573ee08-b485-4c5f-a63e-c1e36f33e0c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.749324 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573ee08-b485-4c5f-a63e-c1e36f33e0c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:09.751529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573ee08-b485-4c5f-a63e-c1e36f33e0c0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:09.769232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 965/1894] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:09.769232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573ee08-b485-4c5f-a63e-c1e36f33e0c0 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:09.780428 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573ee08-b485-4c5f-a63e-c1e36f33e0c0 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:09.785241 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739fe00-1488-42bc-8b1a-c730df4461b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:09.785846 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739fe00-1488-42bc-8b1a-c730df4461b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.786127 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739fe00-1488-42bc-8b1a-c730df4461b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.786407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739fe00-1488-42bc-8b1a-c730df4461b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.787054 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739fe00-1488-42bc-8b1a-c730df4461b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:45:09.787362 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739fe00-1488-42bc-8b1a-c730df4461b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:09.788938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739fe00-1488-42bc-8b1a-c730df4461b7 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:09.800777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 966/1895] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:45:09.801627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739fe00-1488-42bc-8b1a-c730df4461b7 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:09.811431 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739fe00-1488-42bc-8b1a-c730df4461b7 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:09.816535 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5fc61-1fea-46dd-a181-43bc3b7df51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:09.817309 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5fc61-1fea-46dd-a181-43bc3b7df51f admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.817507 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 930/1896] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:09.817611 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5fc61-1fea-46dd-a181-43bc3b7df51f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.817866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5fc61-1fea-46dd-a181-43bc3b7df51f admin admin] PATH_INFO: `/v3/projects/4b27246d434a481cbb5f2d73bee91213/users/760b8b8d059649668355a6c631b9a623/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.818457 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39872949-dfe0-4556-9eb7-353be0756942 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:09.823381 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5fc61-1fea-46dd-a181-43bc3b7df51f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b27246d434a481cbb5f2d73bee91213, user_id=760b8b8d059649668355a6c631b9a623, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:09.826096 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5fc61-1fea-46dd-a181-43bc3b7df51f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:09.830735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39872949-dfe0-4556-9eb7-353be0756942 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:09.838940 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 967/1897] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:09 2022] PUT /identity/v3/projects/4b27246d434a481cbb5f2d73bee91213/users/760b8b8d059649668355a6c631b9a623/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:09.839738 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5fc61-1fea-46dd-a181-43bc3b7df51f admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:09.893776 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143ee6d-b2d2-431a-b324-054bf6bfb882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:09.894484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143ee6d-b2d2-431a-b324-054bf6bfb882 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.894769 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143ee6d-b2d2-431a-b324-054bf6bfb882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.895045 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143ee6d-b2d2-431a-b324-054bf6bfb882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.895730 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143ee6d-b2d2-431a-b324-054bf6bfb882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:09.897299 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143ee6d-b2d2-431a-b324-054bf6bfb882 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:09.911758 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 931/1898] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:09.911758 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143ee6d-b2d2-431a-b324-054bf6bfb882 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:09.917173 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5fc61-1fea-46dd-a181-43bc3b7df51f admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:09.921644 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143ee6d-b2d2-431a-b324-054bf6bfb882 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:09.922403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934327c-95b0-4c33-abd8-5489b6977af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:09.923071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934327c-95b0-4c33-abd8-5489b6977af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.923358 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934327c-95b0-4c33-abd8-5489b6977af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.923638 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934327c-95b0-4c33-abd8-5489b6977af7 admin admin] PATH_INFO: `/v3/projects/5284271477794d858c691a677b25fcd7/users/aae369f2c8de4ef391347ea3eeacf606/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.925581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934327c-95b0-4c33-abd8-5489b6977af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5284271477794d858c691a677b25fcd7, user_id=aae369f2c8de4ef391347ea3eeacf606, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:09.926517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635427f-52fc-4be5-adec-4667ec831c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:09.927101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635427f-52fc-4be5-adec-4667ec831c87 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.927403 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635427f-52fc-4be5-adec-4667ec831c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.927676 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635427f-52fc-4be5-adec-4667ec831c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.928231 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934327c-95b0-4c33-abd8-5489b6977af7 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:09.928343 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635427f-52fc-4be5-adec-4667ec831c87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:09.930365 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635427f-52fc-4be5-adec-4667ec831c87 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:09.938487 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 968/1899] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:09 2022] PUT /identity/v3/projects/5284271477794d858c691a677b25fcd7/users/aae369f2c8de4ef391347ea3eeacf606/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:09.939288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934327c-95b0-4c33-abd8-5489b6977af7 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:09.949285 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1934327c-95b0-4c33-abd8-5489b6977af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:09.961755 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 932/1900] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:09 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:09.961755 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d47f5-39d1-4af4-b60a-96706fcd6337 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:09.961755 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d47f5-39d1-4af4-b60a-96706fcd6337 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:09.961755 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d47f5-39d1-4af4-b60a-96706fcd6337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:09.991357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a11d47f5-39d1-4af4-b60a-96706fcd6337 None None] MFA Rules not processed for user `760b8b8d059649668355a6c631b9a623`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:09.992577 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a11d47f5-39d1-4af4-b60a-96706fcd6337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:10.016730 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934327c-95b0-4c33-abd8-5489b6977af7 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:10.023470 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:10.026379 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:10.066033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 933/1901] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:09 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:10.067536 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cae619-36a7-4912-8b42-4f66820ea055 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:10.068148 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cae619-36a7-4912-8b42-4f66820ea055 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:10.068432 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cae619-36a7-4912-8b42-4f66820ea055 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:10.068774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cae619-36a7-4912-8b42-4f66820ea055 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:10.070986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d47f5-39d1-4af4-b60a-96706fcd6337 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:10.133182 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cae619-36a7-4912-8b42-4f66820ea055 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:10.135133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cae619-36a7-4912-8b42-4f66820ea055 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:10.136705 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d47f5-39d1-4af4-b60a-96706fcd6337 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:10.141286 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce80dec-d4a0-462b-bc66-add01652ef50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:10.141941 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce80dec-d4a0-462b-bc66-add01652ef50 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:10.142219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce80dec-d4a0-462b-bc66-add01652ef50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:10.142490 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce80dec-d4a0-462b-bc66-add01652ef50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:10.143129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce80dec-d4a0-462b-bc66-add01652ef50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:10.144724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce80dec-d4a0-462b-bc66-add01652ef50 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:10.145309 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 969/1902] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:10.146627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc60cd-0416-4ada-8837-8e0324fde66e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:10.146914 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc60cd-0416-4ada-8837-8e0324fde66e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:10.147190 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc60cd-0416-4ada-8837-8e0324fde66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:10.155715 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 934/1903] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:10.156525 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce80dec-d4a0-462b-bc66-add01652ef50 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:10.166496 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce80dec-d4a0-462b-bc66-add01652ef50 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:10.171542 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e0f9f-da5b-459b-a9ff-620eaa3df115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:10.172207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e0f9f-da5b-459b-a9ff-620eaa3df115 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:10.172513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e0f9f-da5b-459b-a9ff-620eaa3df115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:10.172789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e0f9f-da5b-459b-a9ff-620eaa3df115 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:10.173482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e0f9f-da5b-459b-a9ff-620eaa3df115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:10.175850 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e0f9f-da5b-459b-a9ff-620eaa3df115 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:10.179509 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-4fbc60cd-0416-4ada-8837-8e0324fde66e None None] MFA Rules not processed for user `aae369f2c8de4ef391347ea3eeacf606`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:10.181275 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4fbc60cd-0416-4ada-8837-8e0324fde66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:10.199392 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 935/1904] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:10 2022] POST /identity/v3/users => generated 297 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:10.200690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e0f9f-da5b-459b-a9ff-620eaa3df115 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:10.202280 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-922e0f9f-da5b-459b-a9ff-620eaa3df115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:10.213994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e0f9f-da5b-459b-a9ff-620eaa3df115 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:10.217740 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49deca94-f9b9-49d6-b22e-901fcc56a4e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:10.218319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49deca94-f9b9-49d6-b22e-901fcc56a4e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:10.218593 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49deca94-f9b9-49d6-b22e-901fcc56a4e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:10.218866 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49deca94-f9b9-49d6-b22e-901fcc56a4e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:10.228190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49deca94-f9b9-49d6-b22e-901fcc56a4e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:10.229660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49deca94-f9b9-49d6-b22e-901fcc56a4e3 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:10.244669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 936/1905] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:10 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:10.245716 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49deca94-f9b9-49d6-b22e-901fcc56a4e3 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:10.260068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 970/1906] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:10.261169 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc60cd-0416-4ada-8837-8e0324fde66e None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:10.267990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49deca94-f9b9-49d6-b22e-901fcc56a4e3 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:10.274945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc60cd-0416-4ada-8837-8e0324fde66e None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:10.275474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926dde6-767e-4184-a535-09286570a89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:10.276266 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926dde6-767e-4184-a535-09286570a89c admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:10.276641 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926dde6-767e-4184-a535-09286570a89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:10.276923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926dde6-767e-4184-a535-09286570a89c admin admin] PATH_INFO: `/v3/projects/fd33a60c4321433b8990b25ca710ad6b/users/c37586b2400247e981f3720c19831e58/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:10.280818 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571424fb-3b7e-4eba-a5c5-21c192582d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:10.281774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571424fb-3b7e-4eba-a5c5-21c192582d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:10.282132 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571424fb-3b7e-4eba-a5c5-21c192582d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:10.282479 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571424fb-3b7e-4eba-a5c5-21c192582d3e admin admin] PATH_INFO: `/v3/users/63e558bb6c92419ebd40faa4fdf82a5c` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:10.284849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571424fb-3b7e-4eba-a5c5-21c192582d3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=63e558bb6c92419ebd40faa4fdf82a5c)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:10.286994 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571424fb-3b7e-4eba-a5c5-21c192582d3e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:10.318903 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926dde6-767e-4184-a535-09286570a89c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd33a60c4321433b8990b25ca710ad6b, user_id=c37586b2400247e981f3720c19831e58, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:10.330417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926dde6-767e-4184-a535-09286570a89c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:10.440353 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 937/1907] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:10 2022] PUT /identity/v3/projects/fd33a60c4321433b8990b25ca710ad6b/users/c37586b2400247e981f3720c19831e58/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:10.440890 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926dde6-767e-4184-a535-09286570a89c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:10.478853 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:10.482163 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-571424fb-3b7e-4eba-a5c5-21c192582d3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63e558bb6c92419ebd40faa4fdf82a5c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:10.503997 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-571424fb-3b7e-4eba-a5c5-21c192582d3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63e558bb6c92419ebd40faa4fdf82a5c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:10.504866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-571424fb-3b7e-4eba-a5c5-21c192582d3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63e558bb6c92419ebd40faa4fdf82a5c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:10.505812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-571424fb-3b7e-4eba-a5c5-21c192582d3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63e558bb6c92419ebd40faa4fdf82a5c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:10.526950 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-571424fb-3b7e-4eba-a5c5-21c192582d3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63e558bb6c92419ebd40faa4fdf82a5c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:10.563080 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926dde6-767e-4184-a535-09286570a89c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:10.570032 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 971/1908] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:10 2022] DELETE /identity/v3/users/63e558bb6c92419ebd40faa4fdf82a5c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:10.570032 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571424fb-3b7e-4eba-a5c5-21c192582d3e admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:10.570032 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-571424fb-3b7e-4eba-a5c5-21c192582d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:10.572578 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a97e15-3345-4bca-aa69-d91bb90e9806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:10.573462 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a97e15-3345-4bca-aa69-d91bb90e9806 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:10.573923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a97e15-3345-4bca-aa69-d91bb90e9806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:10.574391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a97e15-3345-4bca-aa69-d91bb90e9806 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:10.575223 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a97e15-3345-4bca-aa69-d91bb90e9806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:10.577037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a97e15-3345-4bca-aa69-d91bb90e9806 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:10.592902 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 938/1909] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:10.594584 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613dde2a-841c-4d04-aa11-bd20237c811d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:10.595057 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613dde2a-841c-4d04-aa11-bd20237c811d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:10.595479 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613dde2a-841c-4d04-aa11-bd20237c811d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:10.604449 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:10.636628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-613dde2a-841c-4d04-aa11-bd20237c811d None None] MFA Rules not processed for user `c37586b2400247e981f3720c19831e58`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:10.638481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-613dde2a-841c-4d04-aa11-bd20237c811d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:10.654148 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571424fb-3b7e-4eba-a5c5-21c192582d3e admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:10.658509 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61b3c6-aefd-49ff-a925-941e880c7055 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:10.659581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61b3c6-aefd-49ff-a925-941e880c7055 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:10.660219 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61b3c6-aefd-49ff-a925-941e880c7055 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:10.660599 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61b3c6-aefd-49ff-a925-941e880c7055 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:10.662591 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cf61b3c6-aefd-49ff-a925-941e880c7055 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:10.731184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 939/1910] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:10.732028 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613dde2a-841c-4d04-aa11-bd20237c811d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:10.733305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-613dde2a-841c-4d04-aa11-bd20237c811d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:10.745127 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61b3c6-aefd-49ff-a925-941e880c7055 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:10.745643 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613dde2a-841c-4d04-aa11-bd20237c811d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:10.746818 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61b3c6-aefd-49ff-a925-941e880c7055 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:10.750004 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d49226-0dc9-420b-ad52-d22ca6782676 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:10.750759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d49226-0dc9-420b-ad52-d22ca6782676 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:10.751042 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d49226-0dc9-420b-ad52-d22ca6782676 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:10.751319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d49226-0dc9-420b-ad52-d22ca6782676 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:10.753427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-95d49226-0dc9-420b-ad52-d22ca6782676 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:10.759235 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 972/1911] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:10.761227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb29ef-2f80-4e02-b1dc-0b6ed43ab75e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:10.761809 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb29ef-2f80-4e02-b1dc-0b6ed43ab75e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:10.762146 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb29ef-2f80-4e02-b1dc-0b6ed43ab75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:10.786549 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-53bb29ef-2f80-4e02-b1dc-0b6ed43ab75e None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:10.787843 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-53bb29ef-2f80-4e02-b1dc-0b6ed43ab75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:10.825421 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d49226-0dc9-420b-ad52-d22ca6782676 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:10.827699 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d49226-0dc9-420b-ad52-d22ca6782676 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:10.839100 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 940/1912] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:10.853481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d49226-0dc9-420b-ad52-d22ca6782676 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:10.858119 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-95d49226-0dc9-420b-ad52-d22ca6782676 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:10.872150 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 973/1913] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:10.875702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92511bf9-7559-4e89-8a6f-e9f5a3e7dd8e None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:10.875702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92511bf9-7559-4e89-8a6f-e9f5a3e7dd8e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:10.875860 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92511bf9-7559-4e89-8a6f-e9f5a3e7dd8e None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:10.882288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 974/1914] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 15 00:45:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:45:10.883173 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92511bf9-7559-4e89-8a6f-e9f5a3e7dd8e None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:10.890298 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-92511bf9-7559-4e89-8a6f-e9f5a3e7dd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:10.893217 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d49226-0dc9-420b-ad52-d22ca6782676 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:10.901398 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1326f6-8742-4fb1-b05e-a097b3f4e657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:10.902515 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1326f6-8742-4fb1-b05e-a097b3f4e657 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:10.902701 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1326f6-8742-4fb1-b05e-a097b3f4e657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:10.902978 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1326f6-8742-4fb1-b05e-a097b3f4e657 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:10.903799 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1326f6-8742-4fb1-b05e-a097b3f4e657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:10.908976 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1326f6-8742-4fb1-b05e-a097b3f4e657 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:10.928850 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 941/1915] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:10.932175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c901ab2-3c96-4186-b0ed-5fafbf1560a4 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:10.932459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c901ab2-3c96-4186-b0ed-5fafbf1560a4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:10.932758 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c901ab2-3c96-4186-b0ed-5fafbf1560a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:10.933325 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:10.976157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2c901ab2-3c96-4186-b0ed-5fafbf1560a4 None None] MFA Rules not processed for user `bfcfcf8061f24231858b9b0205a8abaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:10.978035 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2c901ab2-3c96-4186-b0ed-5fafbf1560a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:11.019240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92511bf9-7559-4e89-8a6f-e9f5a3e7dd8e None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:11.029152 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c1f9d-a2dd-4b22-b96a-74120ee39254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:11.029152 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c1f9d-a2dd-4b22-b96a-74120ee39254 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:11.029152 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c1f9d-a2dd-4b22-b96a-74120ee39254 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:11.029152 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c1f9d-a2dd-4b22-b96a-74120ee39254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:11.050948 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c1f9d-a2dd-4b22-b96a-74120ee39254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:11.052887 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c1f9d-a2dd-4b22-b96a-74120ee39254 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:11.081793 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 975/1916] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:11.082661 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c1f9d-a2dd-4b22-b96a-74120ee39254 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:11.098847 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c1f9d-a2dd-4b22-b96a-74120ee39254 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:11.111804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2dd0a-eb0f-42ff-addd-52de24220af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:11.112594 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2dd0a-eb0f-42ff-addd-52de24220af0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:11.112878 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2dd0a-eb0f-42ff-addd-52de24220af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:11.113274 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2dd0a-eb0f-42ff-addd-52de24220af0 admin admin] PATH_INFO: `/v3/projects/c67b304368a745ae90f04ae2aae80ccc/users/8ba64f2684f3458cba26cd1697ba446d/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:11.135641 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2dd0a-eb0f-42ff-addd-52de24220af0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67b304368a745ae90f04ae2aae80ccc, user_id=8ba64f2684f3458cba26cd1697ba446d, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:11.138548 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2dd0a-eb0f-42ff-addd-52de24220af0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:11.145877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 942/1917] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 15 00:45:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:11.150032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c901ab2-3c96-4186-b0ed-5fafbf1560a4 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:11.168388 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 976/1918] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:11 2022] PUT /identity/v3/projects/c67b304368a745ae90f04ae2aae80ccc/users/8ba64f2684f3458cba26cd1697ba446d/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:11.171716 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71da71-f5c9-4063-beb7-0ebf389f64f6 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:11.172737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71da71-f5c9-4063-beb7-0ebf389f64f6 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:11.172737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71da71-f5c9-4063-beb7-0ebf389f64f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:11.177218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c901ab2-3c96-4186-b0ed-5fafbf1560a4 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:11.202698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:11.234851 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2d71da71-f5c9-4063-beb7-0ebf389f64f6 None None] MFA Rules not processed for user `8ba64f2684f3458cba26cd1697ba446d`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:11.237164 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2d71da71-f5c9-4063-beb7-0ebf389f64f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:11.319354 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75169c9-a078-44bd-ae8f-c856a0586cf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:11.320182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75169c9-a078-44bd-ae8f-c856a0586cf8 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:11.320614 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75169c9-a078-44bd-ae8f-c856a0586cf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:11.321036 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75169c9-a078-44bd-ae8f-c856a0586cf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:11.359452 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 977/1919] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:11.360426 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71da71-f5c9-4063-beb7-0ebf389f64f6 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:11.364467 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2d71da71-f5c9-4063-beb7-0ebf389f64f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:11.435056 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75169c9-a078-44bd-ae8f-c856a0586cf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:11.437463 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75169c9-a078-44bd-ae8f-c856a0586cf8 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:11.453246 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 943/1920] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:11.457639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75169c9-a078-44bd-ae8f-c856a0586cf8 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:11.471226 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71da71-f5c9-4063-beb7-0ebf389f64f6 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:11.478314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3fa74-0c5c-46b4-b89f-2a4cdbf2a701 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:11.479084 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3fa74-0c5c-46b4-b89f-2a4cdbf2a701 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:11.479449 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3fa74-0c5c-46b4-b89f-2a4cdbf2a701 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:11.479635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3fa74-0c5c-46b4-b89f-2a4cdbf2a701 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:11.494270 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3fa74-0c5c-46b4-b89f-2a4cdbf2a701 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:11.495886 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3fa74-0c5c-46b4-b89f-2a4cdbf2a701 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:11.515970 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 978/1921] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:11.516968 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3fa74-0c5c-46b4-b89f-2a4cdbf2a701 service nova] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:11.518440 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-eef3fa74-0c5c-46b4-b89f-2a4cdbf2a701 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:11.539321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:11.592428 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75169c9-a078-44bd-ae8f-c856a0586cf8 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:11.606865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96cfef-077d-4b91-a4b9-0e7202395e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:11.607607 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96cfef-077d-4b91-a4b9-0e7202395e55 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:11.607884 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96cfef-077d-4b91-a4b9-0e7202395e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:11.608195 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96cfef-077d-4b91-a4b9-0e7202395e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:11.609051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96cfef-077d-4b91-a4b9-0e7202395e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:11.613630 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96cfef-077d-4b91-a4b9-0e7202395e55 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:11.641130 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3fa74-0c5c-46b4-b89f-2a4cdbf2a701 service nova] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:11.646749 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa842b7a-bbf3-4982-b950-c210383f13e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:11.647551 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa842b7a-bbf3-4982-b950-c210383f13e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:11.647839 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa842b7a-bbf3-4982-b950-c210383f13e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:11.648121 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa842b7a-bbf3-4982-b950-c210383f13e1 admin admin] PATH_INFO: `/v3/users/c37586b2400247e981f3720c19831e58` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:11.649861 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa842b7a-bbf3-4982-b950-c210383f13e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c37586b2400247e981f3720c19831e58)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:11.651812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa842b7a-bbf3-4982-b950-c210383f13e1 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:11.673193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 944/1922] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:11 2022] POST /identity/v3/projects => generated 393 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:11.674406 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96cfef-077d-4b91-a4b9-0e7202395e55 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:11.676695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cf96cfef-077d-4b91-a4b9-0e7202395e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:11.748049 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fa842b7a-bbf3-4982-b950-c210383f13e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c37586b2400247e981f3720c19831e58'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:11.754183 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:11.767711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fa842b7a-bbf3-4982-b950-c210383f13e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c37586b2400247e981f3720c19831e58'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:11.769811 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fa842b7a-bbf3-4982-b950-c210383f13e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c37586b2400247e981f3720c19831e58'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:11.771947 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fa842b7a-bbf3-4982-b950-c210383f13e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c37586b2400247e981f3720c19831e58'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:11.783274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96cfef-077d-4b91-a4b9-0e7202395e55 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:11.790470 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fa842b7a-bbf3-4982-b950-c210383f13e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c37586b2400247e981f3720c19831e58'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:11.791969 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33042b2-0fa2-4448-8eb4-f43d92f8ee1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:11.792625 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33042b2-0fa2-4448-8eb4-f43d92f8ee1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:11.792908 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33042b2-0fa2-4448-8eb4-f43d92f8ee1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:11.793236 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33042b2-0fa2-4448-8eb4-f43d92f8ee1d admin admin] PATH_INFO: `/v3/projects/cb6e078601764cf28033d922fe18e531` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:11.794412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33042b2-0fa2-4448-8eb4-f43d92f8ee1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb6e078601764cf28033d922fe18e531)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:11.796343 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33042b2-0fa2-4448-8eb4-f43d92f8ee1d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:11.821849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 979/1923] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:11 2022] DELETE /identity/v3/users/c37586b2400247e981f3720c19831e58 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:11.823134 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa842b7a-bbf3-4982-b950-c210383f13e1 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:11.824797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-fa842b7a-bbf3-4982-b950-c210383f13e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:11.891901 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b33042b2-0fa2-4448-8eb4-f43d92f8ee1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb6e078601764cf28033d922fe18e531', 'request_id': 'req-b33042b2-0fa2-4448-8eb4-f43d92f8ee1d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:11.903855 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b33042b2-0fa2-4448-8eb4-f43d92f8ee1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb6e078601764cf28033d922fe18e531', 'request_id': 'req-b33042b2-0fa2-4448-8eb4-f43d92f8ee1d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:11.912738 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b33042b2-0fa2-4448-8eb4-f43d92f8ee1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb6e078601764cf28033d922fe18e531', 'request_id': 'req-b33042b2-0fa2-4448-8eb4-f43d92f8ee1d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:11.927889 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b33042b2-0fa2-4448-8eb4-f43d92f8ee1d admin admin] The token cache is being invalidate because project cb6e078601764cf28033d922fe18e531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:11.928957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b33042b2-0fa2-4448-8eb4-f43d92f8ee1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:11.929783 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b33042b2-0fa2-4448-8eb4-f43d92f8ee1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:11.932473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 945/1924] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:11 2022] DELETE /identity/v3/projects/cb6e078601764cf28033d922fe18e531 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:11.934161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad773e-85bb-4988-91b3-0cc8aacd2d1a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:11.934785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad773e-85bb-4988-91b3-0cc8aacd2d1a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:11.934901 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad773e-85bb-4988-91b3-0cc8aacd2d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:11.984108 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-04ad773e-85bb-4988-91b3-0cc8aacd2d1a None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:11.985902 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-04ad773e-85bb-4988-91b3-0cc8aacd2d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:11.996943 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa842b7a-bbf3-4982-b950-c210383f13e1 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:12.039178 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:12.080224 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f0185-ea4c-43e6-8772-ffd255d4933c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:12.081879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f0185-ea4c-43e6-8772-ffd255d4933c admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:12.083449 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f0185-ea4c-43e6-8772-ffd255d4933c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:12.083928 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f0185-ea4c-43e6-8772-ffd255d4933c admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:12.084824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f0185-ea4c-43e6-8772-ffd255d4933c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:12.087346 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 946/1925] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:12.088552 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f0185-ea4c-43e6-8772-ffd255d4933c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:12.091900 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad773e-85bb-4988-91b3-0cc8aacd2d1a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:12.093325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-04ad773e-85bb-4988-91b3-0cc8aacd2d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:12.107865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad773e-85bb-4988-91b3-0cc8aacd2d1a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:12.115470 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ddd93-dcf1-493f-a215-00f4b254cdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:12.116288 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ddd93-dcf1-493f-a215-00f4b254cdb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:12.116691 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ddd93-dcf1-493f-a215-00f4b254cdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:12.116993 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ddd93-dcf1-493f-a215-00f4b254cdb7 admin admin] PATH_INFO: `/v3/users/8a05b41b326b4a8ea61b4d6a5de5175f` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:12.118267 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ddd93-dcf1-493f-a215-00f4b254cdb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a05b41b326b4a8ea61b4d6a5de5175f)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:12.120149 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 980/1926] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:11 2022] POST /identity/v3/users => generated 303 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:12.120332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ddd93-dcf1-493f-a215-00f4b254cdb7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:12.124016 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f0185-ea4c-43e6-8772-ffd255d4933c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:12.125760 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3e4f0185-ea4c-43e6-8772-ffd255d4933c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:12.138931 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f0185-ea4c-43e6-8772-ffd255d4933c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:12.145505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfc2dd-aaf8-4fdc-9203-74995592b1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:12.146428 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfc2dd-aaf8-4fdc-9203-74995592b1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:12.147008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfc2dd-aaf8-4fdc-9203-74995592b1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:12.147535 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfc2dd-aaf8-4fdc-9203-74995592b1ff admin admin] PATH_INFO: `/v3/users/8f337b4fe77349349455227eeebe4c79` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:12.148954 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cfc2dd-aaf8-4fdc-9203-74995592b1ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f337b4fe77349349455227eeebe4c79)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:12.151683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cfc2dd-aaf8-4fdc-9203-74995592b1ff admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:12.193128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f62ddd93-dcf1-493f-a215-00f4b254cdb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a05b41b326b4a8ea61b4d6a5de5175f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:12.203302 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f62ddd93-dcf1-493f-a215-00f4b254cdb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a05b41b326b4a8ea61b4d6a5de5175f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:12.204195 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f62ddd93-dcf1-493f-a215-00f4b254cdb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a05b41b326b4a8ea61b4d6a5de5175f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:12.205940 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f62ddd93-dcf1-493f-a215-00f4b254cdb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a05b41b326b4a8ea61b4d6a5de5175f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:12.221503 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f62ddd93-dcf1-493f-a215-00f4b254cdb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a05b41b326b4a8ea61b4d6a5de5175f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:12.225608 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-38cfc2dd-aaf8-4fdc-9203-74995592b1ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f337b4fe77349349455227eeebe4c79'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:12.236157 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-38cfc2dd-aaf8-4fdc-9203-74995592b1ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f337b4fe77349349455227eeebe4c79'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:12.236853 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-38cfc2dd-aaf8-4fdc-9203-74995592b1ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f337b4fe77349349455227eeebe4c79'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:12.237477 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-38cfc2dd-aaf8-4fdc-9203-74995592b1ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f337b4fe77349349455227eeebe4c79'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:12.238459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:12.246772 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-38cfc2dd-aaf8-4fdc-9203-74995592b1ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f337b4fe77349349455227eeebe4c79'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:12.251318 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 947/1927] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:12 2022] DELETE /identity/v3/users/8a05b41b326b4a8ea61b4d6a5de5175f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:12.252249 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ddd93-dcf1-493f-a215-00f4b254cdb7 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:12.253604 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f62ddd93-dcf1-493f-a215-00f4b254cdb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:12.270219 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 981/1928] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:12 2022] DELETE /identity/v3/users/8f337b4fe77349349455227eeebe4c79 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:12.271690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfc2dd-aaf8-4fdc-9203-74995592b1ff admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:12.273965 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-38cfc2dd-aaf8-4fdc-9203-74995592b1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:12.334320 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ddd93-dcf1-493f-a215-00f4b254cdb7 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:12.366868 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfc2dd-aaf8-4fdc-9203-74995592b1ff admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:12.372791 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def36d3-98db-42b7-bcc8-4a5452de59fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:12.373623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def36d3-98db-42b7-bcc8-4a5452de59fb admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:12.373929 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def36d3-98db-42b7-bcc8-4a5452de59fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:12.374208 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def36d3-98db-42b7-bcc8-4a5452de59fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:12.374859 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def36d3-98db-42b7-bcc8-4a5452de59fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:12.376469 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def36d3-98db-42b7-bcc8-4a5452de59fb admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:12.388289 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 982/1929] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:12.389580 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76597db8-ee55-4359-ac0f-0cd3b41fb4c2 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:12.389869 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76597db8-ee55-4359-ac0f-0cd3b41fb4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:12.390142 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76597db8-ee55-4359-ac0f-0cd3b41fb4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:12.410462 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-76597db8-ee55-4359-ac0f-0cd3b41fb4c2 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:12.411679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-76597db8-ee55-4359-ac0f-0cd3b41fb4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:12.413922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3983442-9b4a-4cd9-b9e5-ad49cebf8f09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:12.414528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3983442-9b4a-4cd9-b9e5-ad49cebf8f09 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:12.414875 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3983442-9b4a-4cd9-b9e5-ad49cebf8f09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:12.415099 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3983442-9b4a-4cd9-b9e5-ad49cebf8f09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:12.416778 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b3983442-9b4a-4cd9-b9e5-ad49cebf8f09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:12.423724 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 983/1930] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:12.424496 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76597db8-ee55-4359-ac0f-0cd3b41fb4c2 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:12.431354 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3983442-9b4a-4cd9-b9e5-ad49cebf8f09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:12.433409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3983442-9b4a-4cd9-b9e5-ad49cebf8f09 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:12.435829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76597db8-ee55-4359-ac0f-0cd3b41fb4c2 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:12.441686 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d9ee2-ff17-4870-b3fe-1598b0a45194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:12.442390 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d9ee2-ff17-4870-b3fe-1598b0a45194 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:12.442674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d9ee2-ff17-4870-b3fe-1598b0a45194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:12.442946 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d9ee2-ff17-4870-b3fe-1598b0a45194 admin admin] PATH_INFO: `/v3/projects/08291ee1f4124b33bb64cbb8764d24ab/users/93bb2c994fe3481a81e368d484213565/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:12.444113 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 948/1931] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:12.444800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3983442-9b4a-4cd9-b9e5-ad49cebf8f09 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:12.447552 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b3983442-9b4a-4cd9-b9e5-ad49cebf8f09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:12.464037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3983442-9b4a-4cd9-b9e5-ad49cebf8f09 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:12.466990 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d9ee2-ff17-4870-b3fe-1598b0a45194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08291ee1f4124b33bb64cbb8764d24ab, user_id=93bb2c994fe3481a81e368d484213565, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:12.471193 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d9ee2-ff17-4870-b3fe-1598b0a45194 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:12.474138 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84061c2-3536-413b-bfae-f082762f396f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:12.474755 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84061c2-3536-413b-bfae-f082762f396f service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:12.475030 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84061c2-3536-413b-bfae-f082762f396f service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:12.475298 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84061c2-3536-413b-bfae-f082762f396f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:12.488473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84061c2-3536-413b-bfae-f082762f396f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:12.498188 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84061c2-3536-413b-bfae-f082762f396f service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:12.502778 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 984/1932] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:12 2022] PUT /identity/v3/projects/08291ee1f4124b33bb64cbb8764d24ab/users/93bb2c994fe3481a81e368d484213565/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:12.517409 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d9ee2-ff17-4870-b3fe-1598b0a45194 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:12.517409 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:12.527883 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 949/1933] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:12.600590 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d9ee2-ff17-4870-b3fe-1598b0a45194 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:12.606958 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86582ed-2e24-457f-8a2d-87e0dc84072b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:12.608007 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86582ed-2e24-457f-8a2d-87e0dc84072b admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:12.608356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86582ed-2e24-457f-8a2d-87e0dc84072b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:12.608642 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86582ed-2e24-457f-8a2d-87e0dc84072b admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:12.609455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86582ed-2e24-457f-8a2d-87e0dc84072b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:12.611201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86582ed-2e24-457f-8a2d-87e0dc84072b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:12.626906 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 985/1934] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:12.628567 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84061c2-3536-413b-bfae-f082762f396f service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:12.640493 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84061c2-3536-413b-bfae-f082762f396f service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:12.647295 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9554913-6bc0-4c6b-9496-0e6027e8552c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:12.648429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9554913-6bc0-4c6b-9496-0e6027e8552c admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:12.649066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9554913-6bc0-4c6b-9496-0e6027e8552c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:12.649717 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9554913-6bc0-4c6b-9496-0e6027e8552c admin admin] PATH_INFO: `/v3/projects/08291ee1f4124b33bb64cbb8764d24ab/users/93bb2c994fe3481a81e368d484213565/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:12.652499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9554913-6bc0-4c6b-9496-0e6027e8552c admin admin] RBAC: Authorizing `identity:create_grant(project_id=08291ee1f4124b33bb64cbb8764d24ab, user_id=93bb2c994fe3481a81e368d484213565, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:12.655577 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9554913-6bc0-4c6b-9496-0e6027e8552c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:12.667504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 950/1935] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:12 2022] PUT /identity/v3/projects/08291ee1f4124b33bb64cbb8764d24ab/users/93bb2c994fe3481a81e368d484213565/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:12.679944 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8042607-dba6-4acb-a299-389c8127bb0a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:12.681299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8042607-dba6-4acb-a299-389c8127bb0a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:12.681585 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8042607-dba6-4acb-a299-389c8127bb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:12.720561 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-e8042607-dba6-4acb-a299-389c8127bb0a None None] MFA Rules not processed for user `93bb2c994fe3481a81e368d484213565`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:12.722942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e8042607-dba6-4acb-a299-389c8127bb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:12.811871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 986/1936] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:12 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:12.824053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9554913-6bc0-4c6b-9496-0e6027e8552c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:12.825824 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a9554913-6bc0-4c6b-9496-0e6027e8552c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:12.895027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8042607-dba6-4acb-a299-389c8127bb0a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:12.896657 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e8042607-dba6-4acb-a299-389c8127bb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:12.900297 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9554913-6bc0-4c6b-9496-0e6027e8552c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:12.905294 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467799fe-ed2b-48fc-aa00-da0904846bf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:12.906131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467799fe-ed2b-48fc-aa00-da0904846bf2 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:12.906438 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467799fe-ed2b-48fc-aa00-da0904846bf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:12.906791 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467799fe-ed2b-48fc-aa00-da0904846bf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:12.918412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467799fe-ed2b-48fc-aa00-da0904846bf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:12.919956 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467799fe-ed2b-48fc-aa00-da0904846bf2 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:12.945909 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 951/1937] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:12 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:13.010546 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8042607-dba6-4acb-a299-389c8127bb0a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:13.017904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467799fe-ed2b-48fc-aa00-da0904846bf2 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:13.018074 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cfdf6-a4c3-4ec0-9a9b-55ff44d9f2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:13.019320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cfdf6-a4c3-4ec0-9a9b-55ff44d9f2f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:13.019561 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cfdf6-a4c3-4ec0-9a9b-55ff44d9f2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:13.020068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cfdf6-a4c3-4ec0-9a9b-55ff44d9f2f6 admin admin] PATH_INFO: `/v3/projects/bfb150aeee1240afbdf5baf1905a8e3e` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:13.021233 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-467799fe-ed2b-48fc-aa00-da0904846bf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:13.021908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cfdf6-a4c3-4ec0-9a9b-55ff44d9f2f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb150aeee1240afbdf5baf1905a8e3e)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:13.024795 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cfdf6-a4c3-4ec0-9a9b-55ff44d9f2f6 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:13.043939 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467799fe-ed2b-48fc-aa00-da0904846bf2 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:13.057864 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a1e11-fb17-47b3-8cf6-b5d2d395492e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:13.058867 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a1e11-fb17-47b3-8cf6-b5d2d395492e service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:13.060534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a1e11-fb17-47b3-8cf6-b5d2d395492e service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:13.061254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a1e11-fb17-47b3-8cf6-b5d2d395492e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:13.063419 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e00a1e11-fb17-47b3-8cf6-b5d2d395492e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:13.065952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:13.099843 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-718cfdf6-a4c3-4ec0-9a9b-55ff44d9f2f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb150aeee1240afbdf5baf1905a8e3e', 'request_id': 'req-718cfdf6-a4c3-4ec0-9a9b-55ff44d9f2f6'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.105549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:13.120721 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-718cfdf6-a4c3-4ec0-9a9b-55ff44d9f2f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb150aeee1240afbdf5baf1905a8e3e', 'request_id': 'req-718cfdf6-a4c3-4ec0-9a9b-55ff44d9f2f6'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.131633 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-718cfdf6-a4c3-4ec0-9a9b-55ff44d9f2f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb150aeee1240afbdf5baf1905a8e3e', 'request_id': 'req-718cfdf6-a4c3-4ec0-9a9b-55ff44d9f2f6'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.148446 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-718cfdf6-a4c3-4ec0-9a9b-55ff44d9f2f6 admin admin] The token cache is being invalidate because project bfb150aeee1240afbdf5baf1905a8e3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:13.148831 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-718cfdf6-a4c3-4ec0-9a9b-55ff44d9f2f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.149669 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-718cfdf6-a4c3-4ec0-9a9b-55ff44d9f2f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.151648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 987/1938] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:12 2022] DELETE /identity/v3/projects/bfb150aeee1240afbdf5baf1905a8e3e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:13.152441 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cfdf6-a4c3-4ec0-9a9b-55ff44d9f2f6 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:13.153821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-718cfdf6-a4c3-4ec0-9a9b-55ff44d9f2f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:13.185628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a1e11-fb17-47b3-8cf6-b5d2d395492e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:13.187772 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a1e11-fb17-47b3-8cf6-b5d2d395492e service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:13.200199 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 952/1939] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:13 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:45:13.201150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a1e11-fb17-47b3-8cf6-b5d2d395492e service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:13.202713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e00a1e11-fb17-47b3-8cf6-b5d2d395492e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:13.217579 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a1e11-fb17-47b3-8cf6-b5d2d395492e service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:13.253912 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cfdf6-a4c3-4ec0-9a9b-55ff44d9f2f6 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:13.262365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6590c-b007-45de-8df6-3a2c26cb3465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:13.263419 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6590c-b007-45de-8df6-3a2c26cb3465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:13.264022 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6590c-b007-45de-8df6-3a2c26cb3465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:13.264473 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6590c-b007-45de-8df6-3a2c26cb3465 admin admin] PATH_INFO: `/v3/projects/fd33a60c4321433b8990b25ca710ad6b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:13.265992 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6590c-b007-45de-8df6-3a2c26cb3465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd33a60c4321433b8990b25ca710ad6b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:13.267998 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6590c-b007-45de-8df6-3a2c26cb3465 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:13.286099 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207efae-722b-42c2-a9fd-e67f3bc392a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:13.286830 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207efae-722b-42c2-a9fd-e67f3bc392a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:13.287182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207efae-722b-42c2-a9fd-e67f3bc392a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:13.287550 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207efae-722b-42c2-a9fd-e67f3bc392a6 admin admin] PATH_INFO: `/v3/projects/b0829ac0231d4396b7056b1adda89771` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:13.288830 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207efae-722b-42c2-a9fd-e67f3bc392a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0829ac0231d4396b7056b1adda89771)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:13.291610 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207efae-722b-42c2-a9fd-e67f3bc392a6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:13.353045 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-24f6590c-b007-45de-8df6-3a2c26cb3465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd33a60c4321433b8990b25ca710ad6b', 'request_id': 'req-24f6590c-b007-45de-8df6-3a2c26cb3465'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.362836 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-24f6590c-b007-45de-8df6-3a2c26cb3465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd33a60c4321433b8990b25ca710ad6b', 'request_id': 'req-24f6590c-b007-45de-8df6-3a2c26cb3465'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.366841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3207efae-722b-42c2-a9fd-e67f3bc392a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0829ac0231d4396b7056b1adda89771', 'request_id': 'req-3207efae-722b-42c2-a9fd-e67f3bc392a6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.375664 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-24f6590c-b007-45de-8df6-3a2c26cb3465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd33a60c4321433b8990b25ca710ad6b', 'request_id': 'req-24f6590c-b007-45de-8df6-3a2c26cb3465'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.379503 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3207efae-722b-42c2-a9fd-e67f3bc392a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0829ac0231d4396b7056b1adda89771', 'request_id': 'req-3207efae-722b-42c2-a9fd-e67f3bc392a6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.388168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3207efae-722b-42c2-a9fd-e67f3bc392a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0829ac0231d4396b7056b1adda89771', 'request_id': 'req-3207efae-722b-42c2-a9fd-e67f3bc392a6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.392884 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-24f6590c-b007-45de-8df6-3a2c26cb3465 admin admin] The token cache is being invalidate because project fd33a60c4321433b8990b25ca710ad6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:13.392884 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-24f6590c-b007-45de-8df6-3a2c26cb3465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.393782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-24f6590c-b007-45de-8df6-3a2c26cb3465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.396078 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 988/1940] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:13 2022] DELETE /identity/v3/projects/fd33a60c4321433b8990b25ca710ad6b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:13.397438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf40539-7c39-472c-96f6-169de74374f2 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:13.397795 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf40539-7c39-472c-96f6-169de74374f2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:13.399315 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf40539-7c39-472c-96f6-169de74374f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:13.408797 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3207efae-722b-42c2-a9fd-e67f3bc392a6 admin admin] The token cache is being invalidate because project b0829ac0231d4396b7056b1adda89771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:13.409098 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3207efae-722b-42c2-a9fd-e67f3bc392a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.409767 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3207efae-722b-42c2-a9fd-e67f3bc392a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.411607 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 953/1941] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:13 2022] DELETE /identity/v3/projects/b0829ac0231d4396b7056b1adda89771 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:13.412600 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b571c6-761e-444c-8b80-f439a5ad70bb None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:13.412878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b571c6-761e-444c-8b80-f439a5ad70bb None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:13.413182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b571c6-761e-444c-8b80-f439a5ad70bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:13.421354 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-dbf40539-7c39-472c-96f6-169de74374f2 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:13.422667 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-dbf40539-7c39-472c-96f6-169de74374f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:13.433721 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-94b571c6-761e-444c-8b80-f439a5ad70bb None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:13.434891 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-94b571c6-761e-444c-8b80-f439a5ad70bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:13.469855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:13.492914 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 989/1942] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:13.494639 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf40539-7c39-472c-96f6-169de74374f2 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:13.496076 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-dbf40539-7c39-472c-96f6-169de74374f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:13.501136 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:13.509594 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf40539-7c39-472c-96f6-169de74374f2 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:13.512834 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 954/1943] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:13.514451 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b571c6-761e-444c-8b80-f439a5ad70bb None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:13.515658 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabfc65-3091-45fb-bb09-5ac872e1cad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:13.516090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-94b571c6-761e-444c-8b80-f439a5ad70bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:13.516332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabfc65-3091-45fb-bb09-5ac872e1cad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:13.516609 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabfc65-3091-45fb-bb09-5ac872e1cad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:13.516880 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabfc65-3091-45fb-bb09-5ac872e1cad6 admin admin] PATH_INFO: `/v3/users/c16dc048f50746f5b748762845ffd0c9` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:13.518053 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabfc65-3091-45fb-bb09-5ac872e1cad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c16dc048f50746f5b748762845ffd0c9)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:13.520075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabfc65-3091-45fb-bb09-5ac872e1cad6 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:13.529873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b571c6-761e-444c-8b80-f439a5ad70bb None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:13.536464 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead708ad-9d0c-4cd4-9990-bb7f1bb8d6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:13.537123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead708ad-9d0c-4cd4-9990-bb7f1bb8d6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:13.537434 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead708ad-9d0c-4cd4-9990-bb7f1bb8d6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:13.537713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead708ad-9d0c-4cd4-9990-bb7f1bb8d6ba admin admin] PATH_INFO: `/v3/users/2b1ea15527194d5f990eae5ec93204e6` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:13.538987 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead708ad-9d0c-4cd4-9990-bb7f1bb8d6ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b1ea15527194d5f990eae5ec93204e6)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:13.541560 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead708ad-9d0c-4cd4-9990-bb7f1bb8d6ba admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:13.586017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4fabfc65-3091-45fb-bb09-5ac872e1cad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c16dc048f50746f5b748762845ffd0c9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.606601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4fabfc65-3091-45fb-bb09-5ac872e1cad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c16dc048f50746f5b748762845ffd0c9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.607818 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4fabfc65-3091-45fb-bb09-5ac872e1cad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c16dc048f50746f5b748762845ffd0c9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.608854 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4fabfc65-3091-45fb-bb09-5ac872e1cad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c16dc048f50746f5b748762845ffd0c9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.629673 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4fabfc65-3091-45fb-bb09-5ac872e1cad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c16dc048f50746f5b748762845ffd0c9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.635573 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ead708ad-9d0c-4cd4-9990-bb7f1bb8d6ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b1ea15527194d5f990eae5ec93204e6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.664486 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ead708ad-9d0c-4cd4-9990-bb7f1bb8d6ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b1ea15527194d5f990eae5ec93204e6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.666297 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ead708ad-9d0c-4cd4-9990-bb7f1bb8d6ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b1ea15527194d5f990eae5ec93204e6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.667247 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ead708ad-9d0c-4cd4-9990-bb7f1bb8d6ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b1ea15527194d5f990eae5ec93204e6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.678418 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ead708ad-9d0c-4cd4-9990-bb7f1bb8d6ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b1ea15527194d5f990eae5ec93204e6'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:13.679421 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 990/1944] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:13 2022] DELETE /identity/v3/users/c16dc048f50746f5b748762845ffd0c9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:13.682162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5162570-9f77-4517-8c8a-04acc2a09911 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:13.682456 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5162570-9f77-4517-8c8a-04acc2a09911 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:13.682739 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5162570-9f77-4517-8c8a-04acc2a09911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:13.704254 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-e5162570-9f77-4517-8c8a-04acc2a09911 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:13.705636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e5162570-9f77-4517-8c8a-04acc2a09911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:13.722855 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 955/1945] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:13 2022] DELETE /identity/v3/users/2b1ea15527194d5f990eae5ec93204e6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:13.722855 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cccb8-6358-459b-b3e0-6aa3c396d8fa None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:13.722855 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cccb8-6358-459b-b3e0-6aa3c396d8fa None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:13.722855 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cccb8-6358-459b-b3e0-6aa3c396d8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:13.771849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-179cccb8-6358-459b-b3e0-6aa3c396d8fa None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:13.774529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-179cccb8-6358-459b-b3e0-6aa3c396d8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:13.792201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 991/1946] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:13.793560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa83e0-f863-4cc3-81be-e4fd1af7d88a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:13.794008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa83e0-f863-4cc3-81be-e4fd1af7d88a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:13.794292 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa83e0-f863-4cc3-81be-e4fd1af7d88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:13.817272 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-39aa83e0-f863-4cc3-81be-e4fd1af7d88a None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:13.818685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-39aa83e0-f863-4cc3-81be-e4fd1af7d88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:13.855719 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 956/1947] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:13.859270 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cccb8-6358-459b-b3e0-6aa3c396d8fa None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:13.867315 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cccb8-6358-459b-b3e0-6aa3c396d8fa None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:13.873295 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912fd0b1-00b4-4f57-87b2-80c17ceb252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:13.873910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fd0b1-00b4-4f57-87b2-80c17ceb252e admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:13.874246 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fd0b1-00b4-4f57-87b2-80c17ceb252e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:13.874524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fd0b1-00b4-4f57-87b2-80c17ceb252e admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:13.875205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912fd0b1-00b4-4f57-87b2-80c17ceb252e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:45:13.875512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912fd0b1-00b4-4f57-87b2-80c17ceb252e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:13.877337 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912fd0b1-00b4-4f57-87b2-80c17ceb252e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:13.893250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 957/1948] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:45:13.894526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912fd0b1-00b4-4f57-87b2-80c17ceb252e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:13.897312 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-912fd0b1-00b4-4f57-87b2-80c17ceb252e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:13.900077 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:13.913264 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 992/1949] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:13.915454 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa83e0-f863-4cc3-81be-e4fd1af7d88a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:13.929706 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa83e0-f863-4cc3-81be-e4fd1af7d88a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:13.935289 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6326e6-1f37-40f0-b094-b47cc4e6b3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:13.936282 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6326e6-1f37-40f0-b094-b47cc4e6b3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:13.936749 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6326e6-1f37-40f0-b094-b47cc4e6b3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:13.937289 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6326e6-1f37-40f0-b094-b47cc4e6b3d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:13.937952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6326e6-1f37-40f0-b094-b47cc4e6b3d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:45:13.938326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6326e6-1f37-40f0-b094-b47cc4e6b3d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:13.939937 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6326e6-1f37-40f0-b094-b47cc4e6b3d0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:13.954931 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 993/1950] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:45:13.956213 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6326e6-1f37-40f0-b094-b47cc4e6b3d0 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:13.967720 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6326e6-1f37-40f0-b094-b47cc4e6b3d0 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:13.973976 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc4bdf-4af6-4e9d-8ff3-4129ffb2ca9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:13.974242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc4bdf-4af6-4e9d-8ff3-4129ffb2ca9a admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:13.974594 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc4bdf-4af6-4e9d-8ff3-4129ffb2ca9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:13.974985 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc4bdf-4af6-4e9d-8ff3-4129ffb2ca9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:13.975729 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc4bdf-4af6-4e9d-8ff3-4129ffb2ca9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:13.978276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc4bdf-4af6-4e9d-8ff3-4129ffb2ca9a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:13.979422 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912fd0b1-00b4-4f57-87b2-80c17ceb252e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:13.983477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82cf2bf-a3a3-4cb5-9dba-1673cb8580fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:13.984320 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cf2bf-a3a3-4cb5-9dba-1673cb8580fc service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:13.984802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cf2bf-a3a3-4cb5-9dba-1673cb8580fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:13.985285 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cf2bf-a3a3-4cb5-9dba-1673cb8580fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:13.987236 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b82cf2bf-a3a3-4cb5-9dba-1673cb8580fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:14.001466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:14.013687 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 994/1951] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:13 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:14.018071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc4bdf-4af6-4e9d-8ff3-4129ffb2ca9a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:14.019811 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-31fc4bdf-4af6-4e9d-8ff3-4129ffb2ca9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:14.067940 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82cf2bf-a3a3-4cb5-9dba-1673cb8580fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:14.069952 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82cf2bf-a3a3-4cb5-9dba-1673cb8580fc service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:14.080972 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 958/1952] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:14.081672 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82cf2bf-a3a3-4cb5-9dba-1673cb8580fc service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:14.091560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc4bdf-4af6-4e9d-8ff3-4129ffb2ca9a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:14.092791 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82cf2bf-a3a3-4cb5-9dba-1673cb8580fc service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:14.096183 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ece44e-6d69-4129-a1bb-cf0cc9b0acb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:14.097407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ece44e-6d69-4129-a1bb-cf0cc9b0acb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:14.097755 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ece44e-6d69-4129-a1bb-cf0cc9b0acb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:14.098187 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ece44e-6d69-4129-a1bb-cf0cc9b0acb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:14.187416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ece44e-6d69-4129-a1bb-cf0cc9b0acb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:14.188934 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ece44e-6d69-4129-a1bb-cf0cc9b0acb0 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:14.192184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2f2b1-9b9a-428f-935d-fdebde5d8a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:14.192890 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2f2b1-9b9a-428f-935d-fdebde5d8a78 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:14.193274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2f2b1-9b9a-428f-935d-fdebde5d8a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:14.193612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2f2b1-9b9a-428f-935d-fdebde5d8a78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:14.194333 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2f2b1-9b9a-428f-935d-fdebde5d8a78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:14.196935 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2f2b1-9b9a-428f-935d-fdebde5d8a78 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:14.201561 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 995/1953] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:14.202708 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ece44e-6d69-4129-a1bb-cf0cc9b0acb0 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:14.215571 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ece44e-6d69-4129-a1bb-cf0cc9b0acb0 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:14.221343 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023a63d-fdaa-4a2c-a23b-ca3bc39e4abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:14.222385 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023a63d-fdaa-4a2c-a23b-ca3bc39e4abe admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:14.222671 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023a63d-fdaa-4a2c-a23b-ca3bc39e4abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:14.222972 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023a63d-fdaa-4a2c-a23b-ca3bc39e4abe admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:14.223595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023a63d-fdaa-4a2c-a23b-ca3bc39e4abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:14.226680 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023a63d-fdaa-4a2c-a23b-ca3bc39e4abe admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:14.233343 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 959/1954] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:14 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:14.234354 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2f2b1-9b9a-428f-935d-fdebde5d8a78 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:14.236165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-91b2f2b1-9b9a-428f-935d-fdebde5d8a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:14.261261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 996/1955] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:14 2022] POST /identity/v3/users => generated 290 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:14.263967 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023a63d-fdaa-4a2c-a23b-ca3bc39e4abe admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:14.295024 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023a63d-fdaa-4a2c-a23b-ca3bc39e4abe admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:14.341233 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2f2b1-9b9a-428f-935d-fdebde5d8a78 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:14.355732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24dc5e-25a7-4385-af04-5512724ad874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:14.356505 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24dc5e-25a7-4385-af04-5512724ad874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:14.356962 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24dc5e-25a7-4385-af04-5512724ad874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:14.358461 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24dc5e-25a7-4385-af04-5512724ad874 admin admin] PATH_INFO: `/v3/projects/36c3ced678ce428da972c59cd993365d` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:14.360544 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24dc5e-25a7-4385-af04-5512724ad874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36c3ced678ce428da972c59cd993365d)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:14.366271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24dc5e-25a7-4385-af04-5512724ad874 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:14.453483 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:14.453743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:14.498893 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e09ff0-586f-4085-a2fb-ebfe488b280f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:14.499982 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e09ff0-586f-4085-a2fb-ebfe488b280f admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:14.502843 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e09ff0-586f-4085-a2fb-ebfe488b280f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:14.503324 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e09ff0-586f-4085-a2fb-ebfe488b280f admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:14.504153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e09ff0-586f-4085-a2fb-ebfe488b280f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:14.508630 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9b24dc5e-25a7-4385-af04-5512724ad874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36c3ced678ce428da972c59cd993365d', 'request_id': 'req-9b24dc5e-25a7-4385-af04-5512724ad874'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:14.510492 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e09ff0-586f-4085-a2fb-ebfe488b280f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:14.535357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9b24dc5e-25a7-4385-af04-5512724ad874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36c3ced678ce428da972c59cd993365d', 'request_id': 'req-9b24dc5e-25a7-4385-af04-5512724ad874'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:14.543894 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9b24dc5e-25a7-4385-af04-5512724ad874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36c3ced678ce428da972c59cd993365d', 'request_id': 'req-9b24dc5e-25a7-4385-af04-5512724ad874'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:14.566609 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 997/1956] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:14 2022] POST /identity/v3/users => generated 292 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:14.570555 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e09ff0-586f-4085-a2fb-ebfe488b280f admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:14.573005 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9b24dc5e-25a7-4385-af04-5512724ad874 admin admin] The token cache is being invalidate because project 36c3ced678ce428da972c59cd993365d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:14.573953 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9b24dc5e-25a7-4385-af04-5512724ad874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:14.579192 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9b24dc5e-25a7-4385-af04-5512724ad874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:14.584892 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 960/1957] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:14 2022] DELETE /identity/v3/projects/36c3ced678ce428da972c59cd993365d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:14.586304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24dc5e-25a7-4385-af04-5512724ad874 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:14.591920 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9b24dc5e-25a7-4385-af04-5512724ad874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:14.601007 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e09ff0-586f-4085-a2fb-ebfe488b280f admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:14.700198 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24dc5e-25a7-4385-af04-5512724ad874 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:14.707151 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597a44b-199a-46c2-88b3-1aaa21e0cb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:14.708108 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597a44b-199a-46c2-88b3-1aaa21e0cb7f admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:14.708392 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597a44b-199a-46c2-88b3-1aaa21e0cb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:14.708665 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597a44b-199a-46c2-88b3-1aaa21e0cb7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:14.709341 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597a44b-199a-46c2-88b3-1aaa21e0cb7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:14.711162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597a44b-199a-46c2-88b3-1aaa21e0cb7f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:14.715151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbda830-f059-4382-9950-2087a53950f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:14.716739 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbda830-f059-4382-9950-2087a53950f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:14.717153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbda830-f059-4382-9950-2087a53950f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:14.717534 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbda830-f059-4382-9950-2087a53950f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:14.718294 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbda830-f059-4382-9950-2087a53950f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:14.720705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbda830-f059-4382-9950-2087a53950f4 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:14.741503 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 961/1958] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:14.744436 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01d19f-a4d1-4e10-9f66-c5a3b9c686cf None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:14.745004 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01d19f-a4d1-4e10-9f66-c5a3b9c686cf None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:14.745455 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01d19f-a4d1-4e10-9f66-c5a3b9c686cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:14.747070 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 998/1959] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:14.747656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbda830-f059-4382-9950-2087a53950f4 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:14.781001 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3b01d19f-a4d1-4e10-9f66-c5a3b9c686cf None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:14.782641 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3b01d19f-a4d1-4e10-9f66-c5a3b9c686cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:14.787174 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbda830-f059-4382-9950-2087a53950f4 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:14.795778 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcaf22b-2509-4aab-8da5-f39a3c109fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:14.796546 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcaf22b-2509-4aab-8da5-f39a3c109fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:14.796857 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcaf22b-2509-4aab-8da5-f39a3c109fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:14.797204 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcaf22b-2509-4aab-8da5-f39a3c109fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:14.798027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcaf22b-2509-4aab-8da5-f39a3c109fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:14.800279 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcaf22b-2509-4aab-8da5-f39a3c109fd5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:14.817036 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 962/1960] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:14.817036 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01d19f-a4d1-4e10-9f66-c5a3b9c686cf None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:14.817036 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3b01d19f-a4d1-4e10-9f66-c5a3b9c686cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:14.824405 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 999/1961] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:14.824556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01d19f-a4d1-4e10-9f66-c5a3b9c686cf None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:14.824647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcaf22b-2509-4aab-8da5-f39a3c109fd5 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:14.824647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-bfcaf22b-2509-4aab-8da5-f39a3c109fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:14.830073 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90e4af-8ca1-4adc-9889-0db729e02fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:14.830829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90e4af-8ca1-4adc-9889-0db729e02fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:14.831108 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90e4af-8ca1-4adc-9889-0db729e02fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:14.831388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90e4af-8ca1-4adc-9889-0db729e02fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:14.832121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90e4af-8ca1-4adc-9889-0db729e02fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:14.833792 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90e4af-8ca1-4adc-9889-0db729e02fb0 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:14.858128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 963/1962] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:14.858128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02914851-357e-42d1-a3b6-3305272a385d None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:14.858128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02914851-357e-42d1-a3b6-3305272a385d None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:14.858128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02914851-357e-42d1-a3b6-3305272a385d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:14.867678 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcaf22b-2509-4aab-8da5-f39a3c109fd5 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:14.880951 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d4bd6-71b6-4c1c-97b7-b7fc2eb591bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:14.881898 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d4bd6-71b6-4c1c-97b7-b7fc2eb591bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:14.882484 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d4bd6-71b6-4c1c-97b7-b7fc2eb591bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:14.882905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d4bd6-71b6-4c1c-97b7-b7fc2eb591bd admin admin] PATH_INFO: `/v3/projects/c8b9c810e6544034a3bff5e64305cb95` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:14.883156 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-02914851-357e-42d1-a3b6-3305272a385d None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:14.885122 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-02914851-357e-42d1-a3b6-3305272a385d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:14.885709 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d4bd6-71b6-4c1c-97b7-b7fc2eb591bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8b9c810e6544034a3bff5e64305cb95)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:14.888749 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d4bd6-71b6-4c1c-97b7-b7fc2eb591bd admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:14.899503 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 964/1963] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:14.900528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02914851-357e-42d1-a3b6-3305272a385d None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:14.911354 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02914851-357e-42d1-a3b6-3305272a385d None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:14.916475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55f1cb-f971-4e88-9aaf-34c13b2ac2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:14.917301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55f1cb-f971-4e88-9aaf-34c13b2ac2e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:14.917608 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55f1cb-f971-4e88-9aaf-34c13b2ac2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:14.917892 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55f1cb-f971-4e88-9aaf-34c13b2ac2e5 admin admin] PATH_INFO: `/v3/projects/7da18274b60449aaa85d0705a641e32c/users/14047d34c71345f49bcd4d4bf7bca89a/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:14.936384 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55f1cb-f971-4e88-9aaf-34c13b2ac2e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7da18274b60449aaa85d0705a641e32c, user_id=14047d34c71345f49bcd4d4bf7bca89a, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:14.940261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55f1cb-f971-4e88-9aaf-34c13b2ac2e5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:14.958028 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 965/1964] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:14 2022] PUT /identity/v3/projects/7da18274b60449aaa85d0705a641e32c/users/14047d34c71345f49bcd4d4bf7bca89a/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:14.959375 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55f1cb-f971-4e88-9aaf-34c13b2ac2e5 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:14.970638 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-984d4bd6-71b6-4c1c-97b7-b7fc2eb591bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8b9c810e6544034a3bff5e64305cb95', 'request_id': 'req-984d4bd6-71b6-4c1c-97b7-b7fc2eb591bd'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:14.978819 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-984d4bd6-71b6-4c1c-97b7-b7fc2eb591bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8b9c810e6544034a3bff5e64305cb95', 'request_id': 'req-984d4bd6-71b6-4c1c-97b7-b7fc2eb591bd'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:14.991301 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-984d4bd6-71b6-4c1c-97b7-b7fc2eb591bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8b9c810e6544034a3bff5e64305cb95', 'request_id': 'req-984d4bd6-71b6-4c1c-97b7-b7fc2eb591bd'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:15.007673 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-984d4bd6-71b6-4c1c-97b7-b7fc2eb591bd admin admin] The token cache is being invalidate because project c8b9c810e6544034a3bff5e64305cb95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:15.007809 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-984d4bd6-71b6-4c1c-97b7-b7fc2eb591bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:15.009005 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-984d4bd6-71b6-4c1c-97b7-b7fc2eb591bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:15.012209 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1000/1965] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:14 2022] DELETE /identity/v3/projects/c8b9c810e6544034a3bff5e64305cb95 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:15.013043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d4bd6-71b6-4c1c-97b7-b7fc2eb591bd admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:15.014642 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-984d4bd6-71b6-4c1c-97b7-b7fc2eb591bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:15.066378 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55f1cb-f971-4e88-9aaf-34c13b2ac2e5 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:15.076037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:15.082478 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:15.091677 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d4bd6-71b6-4c1c-97b7-b7fc2eb591bd admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:15.104010 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867793af-8bca-4eee-9596-50569ac553ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:15.105256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867793af-8bca-4eee-9596-50569ac553ad admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:15.105586 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867793af-8bca-4eee-9596-50569ac553ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:15.105868 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867793af-8bca-4eee-9596-50569ac553ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:15.107015 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867793af-8bca-4eee-9596-50569ac553ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:45:15.107442 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867793af-8bca-4eee-9596-50569ac553ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:15.109822 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867793af-8bca-4eee-9596-50569ac553ad admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:15.132529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1001/1966] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:45:15.132529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853733cf-8ac8-482c-a7a2-3cf4e3c1affd None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:15.132529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853733cf-8ac8-482c-a7a2-3cf4e3c1affd None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:15.132529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853733cf-8ac8-482c-a7a2-3cf4e3c1affd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:15.146499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb7cb9-e00b-43d9-bef8-cb2d53de2a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:15.147360 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb7cb9-e00b-43d9-bef8-cb2d53de2a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:15.147637 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb7cb9-e00b-43d9-bef8-cb2d53de2a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:15.148007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb7cb9-e00b-43d9-bef8-cb2d53de2a56 admin admin] PATH_INFO: `/v3/projects/bf36da302e044f419f42c2c5e8aeac93/users/3e0ddd5e5db5496eadeee868de20eec1/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:15.160285 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-853733cf-8ac8-482c-a7a2-3cf4e3c1affd None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:15.165724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb7cb9-e00b-43d9-bef8-cb2d53de2a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf36da302e044f419f42c2c5e8aeac93, user_id=3e0ddd5e5db5496eadeee868de20eec1, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:15.166168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-853733cf-8ac8-482c-a7a2-3cf4e3c1affd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:15.168621 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb7cb9-e00b-43d9-bef8-cb2d53de2a56 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:15.178317 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1002/1967] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:15.179201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853733cf-8ac8-482c-a7a2-3cf4e3c1affd None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:15.181264 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-853733cf-8ac8-482c-a7a2-3cf4e3c1affd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:15.192177 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 966/1968] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:14 2022] PUT /identity/v3/projects/bf36da302e044f419f42c2c5e8aeac93/users/3e0ddd5e5db5496eadeee868de20eec1/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:15.192964 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb7cb9-e00b-43d9-bef8-cb2d53de2a56 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:15.212127 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853733cf-8ac8-482c-a7a2-3cf4e3c1affd None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:15.279722 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb7cb9-e00b-43d9-bef8-cb2d53de2a56 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:15.284728 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97e185-8d90-4dd7-ab51-bbf2402f0466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:15.285447 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97e185-8d90-4dd7-ab51-bbf2402f0466 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:15.285803 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97e185-8d90-4dd7-ab51-bbf2402f0466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:15.286150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97e185-8d90-4dd7-ab51-bbf2402f0466 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:15.286962 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97e185-8d90-4dd7-ab51-bbf2402f0466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:15.289568 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97e185-8d90-4dd7-ab51-bbf2402f0466 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:15.303517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d23f9-f7bf-4749-a439-2636adccd114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:15.304690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d23f9-f7bf-4749-a439-2636adccd114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:15.305197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d23f9-f7bf-4749-a439-2636adccd114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:15.306273 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d23f9-f7bf-4749-a439-2636adccd114 admin admin] PATH_INFO: `/v3/users/760b8b8d059649668355a6c631b9a623` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:15.307672 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d23f9-f7bf-4749-a439-2636adccd114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=760b8b8d059649668355a6c631b9a623)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:15.309725 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d23f9-f7bf-4749-a439-2636adccd114 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:15.338633 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 967/1969] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:15 2022] POST /identity/v3/projects => generated 365 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:15.343212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97e185-8d90-4dd7-ab51-bbf2402f0466 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:15.347558 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1e97e185-8d90-4dd7-ab51-bbf2402f0466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:15.397708 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1e7d23f9-f7bf-4749-a439-2636adccd114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '760b8b8d059649668355a6c631b9a623'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:15.428361 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1e7d23f9-f7bf-4749-a439-2636adccd114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '760b8b8d059649668355a6c631b9a623'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:15.429013 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1e7d23f9-f7bf-4749-a439-2636adccd114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '760b8b8d059649668355a6c631b9a623'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:15.429897 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1e7d23f9-f7bf-4749-a439-2636adccd114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '760b8b8d059649668355a6c631b9a623'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:15.442047 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1e7d23f9-f7bf-4749-a439-2636adccd114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '760b8b8d059649668355a6c631b9a623'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:15.444069 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97e185-8d90-4dd7-ab51-bbf2402f0466 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:15.448867 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83842985-8979-44df-9d62-5c3f2250d873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:15.449505 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83842985-8979-44df-9d62-5c3f2250d873 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:15.449790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83842985-8979-44df-9d62-5c3f2250d873 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:15.450057 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83842985-8979-44df-9d62-5c3f2250d873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:15.452279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-83842985-8979-44df-9d62-5c3f2250d873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:15.488524 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1003/1970] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:15 2022] DELETE /identity/v3/users/760b8b8d059649668355a6c631b9a623 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:15.489907 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09bb7f-d56f-480f-923b-8fb0095dcdf6 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:15.490208 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09bb7f-d56f-480f-923b-8fb0095dcdf6 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:15.490513 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09bb7f-d56f-480f-923b-8fb0095dcdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:15.522127 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:15.554158 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-cd09bb7f-d56f-480f-923b-8fb0095dcdf6 None None] MFA Rules not processed for user `3e0ddd5e5db5496eadeee868de20eec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:15.557771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cd09bb7f-d56f-480f-923b-8fb0095dcdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:15.560534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83842985-8979-44df-9d62-5c3f2250d873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:15.562412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83842985-8979-44df-9d62-5c3f2250d873 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:15.573814 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 968/1971] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:15.574549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83842985-8979-44df-9d62-5c3f2250d873 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:15.576289 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-83842985-8979-44df-9d62-5c3f2250d873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:15.590086 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83842985-8979-44df-9d62-5c3f2250d873 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:15.636198 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:15.668258 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1004/1972] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:15.685055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09bb7f-d56f-480f-923b-8fb0095dcdf6 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:15.689712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cd09bb7f-d56f-480f-923b-8fb0095dcdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:15.697493 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67bdccf-8342-467b-b2a5-929e552f252c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:15.698127 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bdccf-8342-467b-b2a5-929e552f252c admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:15.698575 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bdccf-8342-467b-b2a5-929e552f252c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:15.698854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bdccf-8342-467b-b2a5-929e552f252c admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:15.699565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67bdccf-8342-467b-b2a5-929e552f252c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:15.701824 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67bdccf-8342-467b-b2a5-929e552f252c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:15.722178 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09bb7f-d56f-480f-923b-8fb0095dcdf6 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:15.729371 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5829bd7-c993-4456-8703-2e44acc25810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:15.731235 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5829bd7-c993-4456-8703-2e44acc25810 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:15.734504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5829bd7-c993-4456-8703-2e44acc25810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:15.735176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5829bd7-c993-4456-8703-2e44acc25810 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:15.737596 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5829bd7-c993-4456-8703-2e44acc25810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:15.746352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5829bd7-c993-4456-8703-2e44acc25810 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:15.762085 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 969/1973] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:15 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:15.763832 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67bdccf-8342-467b-b2a5-929e552f252c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:15.780217 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67bdccf-8342-467b-b2a5-929e552f252c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:15.792174 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59198379-f74e-4b69-a8d9-bf8f1bd031d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:15.793002 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59198379-f74e-4b69-a8d9-bf8f1bd031d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:15.793456 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59198379-f74e-4b69-a8d9-bf8f1bd031d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:15.798542 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59198379-f74e-4b69-a8d9-bf8f1bd031d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:15.801859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59198379-f74e-4b69-a8d9-bf8f1bd031d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:15.805845 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59198379-f74e-4b69-a8d9-bf8f1bd031d7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:15.825161 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1005/1974] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:15 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:15.825507 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 970/1975] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:15.827152 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5829bd7-c993-4456-8703-2e44acc25810 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:15.828748 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59198379-f74e-4b69-a8d9-bf8f1bd031d7 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:15.854713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59198379-f74e-4b69-a8d9-bf8f1bd031d7 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:15.976205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5829bd7-c993-4456-8703-2e44acc25810 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:15.988846 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701abe16-4a1a-4652-b3d4-606602dfa682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:15.988846 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701abe16-4a1a-4652-b3d4-606602dfa682 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:15.988846 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701abe16-4a1a-4652-b3d4-606602dfa682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:15.988846 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701abe16-4a1a-4652-b3d4-606602dfa682 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:15.989958 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701abe16-4a1a-4652-b3d4-606602dfa682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:15.992314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701abe16-4a1a-4652-b3d4-606602dfa682 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:16.007322 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42080439-4623-48a2-a5fa-2d76dcfd3608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:16.009430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42080439-4623-48a2-a5fa-2d76dcfd3608 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:16.009711 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42080439-4623-48a2-a5fa-2d76dcfd3608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:16.010032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42080439-4623-48a2-a5fa-2d76dcfd3608 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:16.010929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42080439-4623-48a2-a5fa-2d76dcfd3608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:16.014354 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42080439-4623-48a2-a5fa-2d76dcfd3608 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:16.033297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1006/1976] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:15 2022] POST /identity/v3/users => generated 296 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:45:16.033391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 971/1977] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:16.033499 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701abe16-4a1a-4652-b3d4-606602dfa682 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:16.034487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42080439-4623-48a2-a5fa-2d76dcfd3608 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:16.044001 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-701abe16-4a1a-4652-b3d4-606602dfa682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:16.057403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701abe16-4a1a-4652-b3d4-606602dfa682 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:16.060542 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42080439-4623-48a2-a5fa-2d76dcfd3608 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:16.068345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf4e08-1c6a-44a1-971c-c6d5ba857ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:16.069121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf4e08-1c6a-44a1-971c-c6d5ba857ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:16.069400 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf4e08-1c6a-44a1-971c-c6d5ba857ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:16.069687 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf4e08-1c6a-44a1-971c-c6d5ba857ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:16.070821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf4e08-1c6a-44a1-971c-c6d5ba857ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:16.073697 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf4e08-1c6a-44a1-971c-c6d5ba857ea3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:16.091832 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7de95d-d0aa-45b9-9c7b-c96dad5ba659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:16.092762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7de95d-d0aa-45b9-9c7b-c96dad5ba659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:16.093339 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7de95d-d0aa-45b9-9c7b-c96dad5ba659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:16.093787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7de95d-d0aa-45b9-9c7b-c96dad5ba659 admin admin] PATH_INFO: `/v3/projects/4b27246d434a481cbb5f2d73bee91213` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:16.095221 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7de95d-d0aa-45b9-9c7b-c96dad5ba659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b27246d434a481cbb5f2d73bee91213)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:16.097255 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 972/1978] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:16.097927 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7de95d-d0aa-45b9-9c7b-c96dad5ba659 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:16.098768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf4e08-1c6a-44a1-971c-c6d5ba857ea3 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:16.116371 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf4e08-1c6a-44a1-971c-c6d5ba857ea3 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:16.126544 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b0407-d697-4db6-94fa-41d40dbd877b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:16.127979 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b0407-d697-4db6-94fa-41d40dbd877b admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:16.128551 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b0407-d697-4db6-94fa-41d40dbd877b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:16.128858 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b0407-d697-4db6-94fa-41d40dbd877b admin admin] PATH_INFO: `/v3/projects/f74cb7fbff3743f5be3cd581f9b26cd6/users/cbb6d699643744c7abe63beab87021da/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:16.149706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b0407-d697-4db6-94fa-41d40dbd877b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f74cb7fbff3743f5be3cd581f9b26cd6, user_id=cbb6d699643744c7abe63beab87021da, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:16.152896 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b0407-d697-4db6-94fa-41d40dbd877b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:16.189480 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 973/1979] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:16 2022] PUT /identity/v3/projects/f74cb7fbff3743f5be3cd581f9b26cd6/users/cbb6d699643744c7abe63beab87021da/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:16.189480 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b0407-d697-4db6-94fa-41d40dbd877b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:16.201937 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4e7de95d-d0aa-45b9-9c7b-c96dad5ba659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b27246d434a481cbb5f2d73bee91213', 'request_id': 'req-4e7de95d-d0aa-45b9-9c7b-c96dad5ba659'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:16.204350 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:16.214171 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4e7de95d-d0aa-45b9-9c7b-c96dad5ba659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b27246d434a481cbb5f2d73bee91213', 'request_id': 'req-4e7de95d-d0aa-45b9-9c7b-c96dad5ba659'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:16.225125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4e7de95d-d0aa-45b9-9c7b-c96dad5ba659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b27246d434a481cbb5f2d73bee91213', 'request_id': 'req-4e7de95d-d0aa-45b9-9c7b-c96dad5ba659'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:16.240922 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4e7de95d-d0aa-45b9-9c7b-c96dad5ba659 admin admin] The token cache is being invalidate because project 4b27246d434a481cbb5f2d73bee91213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:16.241298 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4e7de95d-d0aa-45b9-9c7b-c96dad5ba659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:16.242110 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4e7de95d-d0aa-45b9-9c7b-c96dad5ba659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:16.244285 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1007/1980] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:16 2022] DELETE /identity/v3/projects/4b27246d434a481cbb5f2d73bee91213 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:16.245580 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e1c89-83bf-43c4-bf50-8440eee1d714 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:16.245890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e1c89-83bf-43c4-bf50-8440eee1d714 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:16.246116 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e1c89-83bf-43c4-bf50-8440eee1d714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:16.269741 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b0407-d697-4db6-94fa-41d40dbd877b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:16.282530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06164d-c7f1-466e-985c-adac422e1d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:16.283556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06164d-c7f1-466e-985c-adac422e1d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:16.284707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06164d-c7f1-466e-985c-adac422e1d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:16.285523 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06164d-c7f1-466e-985c-adac422e1d1c admin admin] PATH_INFO: `/v3/projects/a7c311c55f9d45fe961e2afe13aa0f51/users/c111e917506f45d2b1f9bc4868c2e3b1/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:16.318203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06164d-c7f1-466e-985c-adac422e1d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7c311c55f9d45fe961e2afe13aa0f51, user_id=c111e917506f45d2b1f9bc4868c2e3b1, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:16.322545 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06164d-c7f1-466e-985c-adac422e1d1c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:16.323378 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f81e1c89-83bf-43c4-bf50-8440eee1d714 None None] MFA Rules not processed for user `cbb6d699643744c7abe63beab87021da`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:16.326050 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f81e1c89-83bf-43c4-bf50-8440eee1d714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:16.348388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 974/1981] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:16 2022] PUT /identity/v3/projects/a7c311c55f9d45fe961e2afe13aa0f51/users/c111e917506f45d2b1f9bc4868c2e3b1/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:16.353820 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baf343-d8c2-4ac1-8550-12020df2f6a4 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:16.354471 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baf343-d8c2-4ac1-8550-12020df2f6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:16.355139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baf343-d8c2-4ac1-8550-12020df2f6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:16.373746 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:16.393012 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-60baf343-d8c2-4ac1-8550-12020df2f6a4 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:16.394773 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-60baf343-d8c2-4ac1-8550-12020df2f6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:16.449692 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1008/1982] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:16.451082 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e1c89-83bf-43c4-bf50-8440eee1d714 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:16.453021 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f81e1c89-83bf-43c4-bf50-8440eee1d714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:16.472416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e1c89-83bf-43c4-bf50-8440eee1d714 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:16.495381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 975/1983] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:16.496625 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60baf343-d8c2-4ac1-8550-12020df2f6a4 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:16.497979 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-60baf343-d8c2-4ac1-8550-12020df2f6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:16.514124 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60baf343-d8c2-4ac1-8550-12020df2f6a4 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:16.521661 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc63c9-dc7d-489e-8c9b-2fe1e6f7b5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:16.522278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc63c9-dc7d-489e-8c9b-2fe1e6f7b5da admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:16.522556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc63c9-dc7d-489e-8c9b-2fe1e6f7b5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:16.522826 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc63c9-dc7d-489e-8c9b-2fe1e6f7b5da admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:16.523465 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc63c9-dc7d-489e-8c9b-2fe1e6f7b5da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:16.525583 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc63c9-dc7d-489e-8c9b-2fe1e6f7b5da admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:16.573499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 976/1984] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:16 2022] POST /identity/v3/projects => generated 369 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:16.573499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfdab4-1b01-402b-a2fd-c68ee14e0f23 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:16.573499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfdab4-1b01-402b-a2fd-c68ee14e0f23 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:16.573499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfdab4-1b01-402b-a2fd-c68ee14e0f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:16.581351 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328b940-cf00-49a3-a0b9-7b6c58c7dbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:16.581973 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328b940-cf00-49a3-a0b9-7b6c58c7dbd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:16.582255 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328b940-cf00-49a3-a0b9-7b6c58c7dbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:16.582529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328b940-cf00-49a3-a0b9-7b6c58c7dbd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:16.583178 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328b940-cf00-49a3-a0b9-7b6c58c7dbd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:16.584768 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328b940-cf00-49a3-a0b9-7b6c58c7dbd3 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:16.606457 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1009/1985] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:16.606457 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328b940-cf00-49a3-a0b9-7b6c58c7dbd3 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:16.609906 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-14cfdab4-1b01-402b-a2fd-c68ee14e0f23 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:16.613494 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-14cfdab4-1b01-402b-a2fd-c68ee14e0f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:16.620879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328b940-cf00-49a3-a0b9-7b6c58c7dbd3 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:16.699227 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 977/1986] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:16.700162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfdab4-1b01-402b-a2fd-c68ee14e0f23 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:16.723019 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfdab4-1b01-402b-a2fd-c68ee14e0f23 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:16.733904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbe505-84f4-406a-9ad6-79c3839522e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:16.734582 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbe505-84f4-406a-9ad6-79c3839522e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:16.734865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbe505-84f4-406a-9ad6-79c3839522e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:16.735139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbe505-84f4-406a-9ad6-79c3839522e0 admin admin] PATH_INFO: `/v3/projects/a7c311c55f9d45fe961e2afe13aa0f51/users/c111e917506f45d2b1f9bc4868c2e3b1/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:16.738579 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfbe505-84f4-406a-9ad6-79c3839522e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7c311c55f9d45fe961e2afe13aa0f51, user_id=c111e917506f45d2b1f9bc4868c2e3b1, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:16.739542 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85739a6-4600-4011-aaa8-ce02d5aa168d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:16.741368 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfbe505-84f4-406a-9ad6-79c3839522e0 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:16.742254 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85739a6-4600-4011-aaa8-ce02d5aa168d admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:16.743462 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85739a6-4600-4011-aaa8-ce02d5aa168d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:16.746069 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85739a6-4600-4011-aaa8-ce02d5aa168d admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:16.746957 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85739a6-4600-4011-aaa8-ce02d5aa168d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:16.749102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85739a6-4600-4011-aaa8-ce02d5aa168d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:16.758538 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 978/1987] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:16 2022] PUT /identity/v3/projects/a7c311c55f9d45fe961e2afe13aa0f51/users/c111e917506f45d2b1f9bc4868c2e3b1/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:16.760342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbe505-84f4-406a-9ad6-79c3839522e0 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:16.777634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:16.795766 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1010/1988] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:16 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:16.795766 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a5f29-0b58-4da1-9b7c-09819fb775f4 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:16.795766 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a5f29-0b58-4da1-9b7c-09819fb775f4 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:16.795766 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a5f29-0b58-4da1-9b7c-09819fb775f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:16.850015 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-066a5f29-0b58-4da1-9b7c-09819fb775f4 None None] MFA Rules not processed for user `c111e917506f45d2b1f9bc4868c2e3b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:16.851414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-066a5f29-0b58-4da1-9b7c-09819fb775f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:16.893474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbe505-84f4-406a-9ad6-79c3839522e0 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:16.898604 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c7c39-efd1-493e-82a2-8a9b19f754b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:16.899776 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c7c39-efd1-493e-82a2-8a9b19f754b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:16.900032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c7c39-efd1-493e-82a2-8a9b19f754b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:16.900304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c7c39-efd1-493e-82a2-8a9b19f754b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:16.900953 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c7c39-efd1-493e-82a2-8a9b19f754b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:45:16.901279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c7c39-efd1-493e-82a2-8a9b19f754b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:16.904193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c7c39-efd1-493e-82a2-8a9b19f754b6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:16.925658 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 979/1989] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:45:16.926856 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c7c39-efd1-493e-82a2-8a9b19f754b6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:16.930766 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:16.948394 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c7c39-efd1-493e-82a2-8a9b19f754b6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:16.956646 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f69d24-1c6f-4aa0-aa8f-a36afe9e6663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:16.957742 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f69d24-1c6f-4aa0-aa8f-a36afe9e6663 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:16.958027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f69d24-1c6f-4aa0-aa8f-a36afe9e6663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:16.958323 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f69d24-1c6f-4aa0-aa8f-a36afe9e6663 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:16.959020 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f69d24-1c6f-4aa0-aa8f-a36afe9e6663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:16.960824 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f69d24-1c6f-4aa0-aa8f-a36afe9e6663 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:16.970908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1011/1990] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:16.972991 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a5f29-0b58-4da1-9b7c-09819fb775f4 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:16.984072 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 980/1991] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:16.984072 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f69d24-1c6f-4aa0-aa8f-a36afe9e6663 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:16.986949 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-60f69d24-1c6f-4aa0-aa8f-a36afe9e6663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:16.987707 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a5f29-0b58-4da1-9b7c-09819fb775f4 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:16.994517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689648a-645a-4c6c-9808-a2477b2c31a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:16.995793 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689648a-645a-4c6c-9808-a2477b2c31a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:16.996090 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689648a-645a-4c6c-9808-a2477b2c31a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:16.996405 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689648a-645a-4c6c-9808-a2477b2c31a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:16.997056 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689648a-645a-4c6c-9808-a2477b2c31a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:16.999056 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689648a-645a-4c6c-9808-a2477b2c31a4 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:17.043220 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1012/1992] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:16 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:17.044185 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689648a-645a-4c6c-9808-a2477b2c31a4 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:17.076027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f69d24-1c6f-4aa0-aa8f-a36afe9e6663 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:17.179619 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689648a-645a-4c6c-9808-a2477b2c31a4 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:17.196636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563f5ae-4efa-41b9-b3ef-7ccb1286fe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:17.198401 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563f5ae-4efa-41b9-b3ef-7ccb1286fe18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:17.201123 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563f5ae-4efa-41b9-b3ef-7ccb1286fe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:17.201466 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563f5ae-4efa-41b9-b3ef-7ccb1286fe18 admin admin] PATH_INFO: `/v3/projects/93060aa6b40f4ad2a5d06423c1e32979/users/697925e0cc184564b935e1d7bf0ef438/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:17.202103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77ded5-b861-473a-a08c-99badacffef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:17.204659 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77ded5-b861-473a-a08c-99badacffef5 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:17.205004 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77ded5-b861-473a-a08c-99badacffef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:17.205326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77ded5-b861-473a-a08c-99badacffef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:17.207957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9a77ded5-b861-473a-a08c-99badacffef5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:17.231706 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563f5ae-4efa-41b9-b3ef-7ccb1286fe18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93060aa6b40f4ad2a5d06423c1e32979, user_id=697925e0cc184564b935e1d7bf0ef438, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:17.236182 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563f5ae-4efa-41b9-b3ef-7ccb1286fe18 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:17.267129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1013/1993] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:17 2022] PUT /identity/v3/projects/93060aa6b40f4ad2a5d06423c1e32979/users/697925e0cc184564b935e1d7bf0ef438/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:17.267129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563f5ae-4efa-41b9-b3ef-7ccb1286fe18 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:17.323570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77ded5-b861-473a-a08c-99badacffef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:17.328509 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77ded5-b861-473a-a08c-99badacffef5 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:17.343257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:17.355750 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 981/1994] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:17.358284 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77ded5-b861-473a-a08c-99badacffef5 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:17.386581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77ded5-b861-473a-a08c-99badacffef5 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:17.411091 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563f5ae-4efa-41b9-b3ef-7ccb1286fe18 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:17.426461 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46290375-942c-47bb-b670-9fad137f5224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:17.428619 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46290375-942c-47bb-b670-9fad137f5224 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:17.428905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46290375-942c-47bb-b670-9fad137f5224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:17.437305 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46290375-942c-47bb-b670-9fad137f5224 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:17.440551 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46290375-942c-47bb-b670-9fad137f5224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:17.442555 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46290375-942c-47bb-b670-9fad137f5224 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:17.509068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1014/1995] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:17 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:17.510205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46290375-942c-47bb-b670-9fad137f5224 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:17.512947 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-46290375-942c-47bb-b670-9fad137f5224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:17.547327 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5911ee-4ef1-49b3-addd-9e64cc622761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:17.548029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5911ee-4ef1-49b3-addd-9e64cc622761 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:17.548311 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5911ee-4ef1-49b3-addd-9e64cc622761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:17.548419 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46290375-942c-47bb-b670-9fad137f5224 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:17.548580 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5911ee-4ef1-49b3-addd-9e64cc622761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:17.549258 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5911ee-4ef1-49b3-addd-9e64cc622761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:17.550873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5911ee-4ef1-49b3-addd-9e64cc622761 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:17.570215 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ef0fa-6425-41af-9981-549f5b047819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:17.571872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ef0fa-6425-41af-9981-549f5b047819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:17.572257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ef0fa-6425-41af-9981-549f5b047819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:17.572809 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ef0fa-6425-41af-9981-549f5b047819 admin admin] PATH_INFO: `/v3/users/8ba64f2684f3458cba26cd1697ba446d` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:17.575138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ef0fa-6425-41af-9981-549f5b047819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ba64f2684f3458cba26cd1697ba446d)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:17.577962 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ef0fa-6425-41af-9981-549f5b047819 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:17.599536 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 982/1996] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:17.599536 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5911ee-4ef1-49b3-addd-9e64cc622761 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:17.627931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5911ee-4ef1-49b3-addd-9e64cc622761 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:17.645253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b300f75-d996-49c0-9115-d34e926699c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:17.646128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b300f75-d996-49c0-9115-d34e926699c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:17.646619 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b300f75-d996-49c0-9115-d34e926699c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:17.646899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b300f75-d996-49c0-9115-d34e926699c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:17.648791 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b300f75-d996-49c0-9115-d34e926699c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:17.652064 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b300f75-d996-49c0-9115-d34e926699c0 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:17.652991 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:17.676346 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 983/1997] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:17.679736 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b300f75-d996-49c0-9115-d34e926699c0 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:17.692244 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-731ef0fa-6425-41af-9981-549f5b047819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ba64f2684f3458cba26cd1697ba446d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:17.699575 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b300f75-d996-49c0-9115-d34e926699c0 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:17.706992 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b8372-6e1b-4ecf-9599-1cb5b938196f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:17.708096 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b8372-6e1b-4ecf-9599-1cb5b938196f admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:17.708383 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b8372-6e1b-4ecf-9599-1cb5b938196f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:17.708516 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-731ef0fa-6425-41af-9981-549f5b047819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ba64f2684f3458cba26cd1697ba446d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:17.708788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b8372-6e1b-4ecf-9599-1cb5b938196f admin admin] PATH_INFO: `/v3/projects/93060aa6b40f4ad2a5d06423c1e32979/users/697925e0cc184564b935e1d7bf0ef438/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:17.710008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-731ef0fa-6425-41af-9981-549f5b047819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ba64f2684f3458cba26cd1697ba446d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:17.710950 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-731ef0fa-6425-41af-9981-549f5b047819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ba64f2684f3458cba26cd1697ba446d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:17.730570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b8372-6e1b-4ecf-9599-1cb5b938196f admin admin] RBAC: Authorizing `identity:create_grant(project_id=93060aa6b40f4ad2a5d06423c1e32979, user_id=697925e0cc184564b935e1d7bf0ef438, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:17.738347 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-731ef0fa-6425-41af-9981-549f5b047819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ba64f2684f3458cba26cd1697ba446d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:17.738674 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b8372-6e1b-4ecf-9599-1cb5b938196f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:17.774651 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 984/1998] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:17 2022] PUT /identity/v3/projects/93060aa6b40f4ad2a5d06423c1e32979/users/697925e0cc184564b935e1d7bf0ef438/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:17.774651 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b8372-6e1b-4ecf-9599-1cb5b938196f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:17.774651 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-639b8372-6e1b-4ecf-9599-1cb5b938196f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:17.808650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1015/1999] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:17 2022] DELETE /identity/v3/users/8ba64f2684f3458cba26cd1697ba446d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:17.810353 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2c28a-68b0-46bb-b390-e9959d50f440 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:17.810771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2c28a-68b0-46bb-b390-e9959d50f440 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:17.811245 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2c28a-68b0-46bb-b390-e9959d50f440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:17.888152 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-59a2c28a-68b0-46bb-b390-e9959d50f440 None None] MFA Rules not processed for user `697925e0cc184564b935e1d7bf0ef438`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:17.892359 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-59a2c28a-68b0-46bb-b390-e9959d50f440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:17.959921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b8372-6e1b-4ecf-9599-1cb5b938196f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:18.078509 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1016/2000] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:18.080487 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ab8be-5b85-4088-8eb9-4c1002f1372d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:18.082503 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ab8be-5b85-4088-8eb9-4c1002f1372d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:18.086836 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ab8be-5b85-4088-8eb9-4c1002f1372d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:18.155001 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83414a28-6706-4e34-a9eb-a5c278019705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:18.155687 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83414a28-6706-4e34-a9eb-a5c278019705 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:18.155936 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83414a28-6706-4e34-a9eb-a5c278019705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:18.158015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83414a28-6706-4e34-a9eb-a5c278019705 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:18.158692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83414a28-6706-4e34-a9eb-a5c278019705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:18.160774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-6a5ab8be-5b85-4088-8eb9-4c1002f1372d None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:18.164190 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6a5ab8be-5b85-4088-8eb9-4c1002f1372d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:18.168190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83414a28-6706-4e34-a9eb-a5c278019705 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:18.203929 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1017/2001] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:18.204068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ab8be-5b85-4088-8eb9-4c1002f1372d None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:18.212330 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6a5ab8be-5b85-4088-8eb9-4c1002f1372d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:18.217140 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 985/2002] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:18.218746 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83414a28-6706-4e34-a9eb-a5c278019705 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:18.271824 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83414a28-6706-4e34-a9eb-a5c278019705 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:18.291244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03523017-0f69-4eac-90d1-3ea1d5f3a94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:18.292161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03523017-0f69-4eac-90d1-3ea1d5f3a94c admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:18.292471 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03523017-0f69-4eac-90d1-3ea1d5f3a94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:18.292799 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03523017-0f69-4eac-90d1-3ea1d5f3a94c admin admin] PATH_INFO: `/v3/projects/13e2f06e301d4741968472015aae6bd4/users/7388e62d6dd34b428c33c29639c0a997/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:18.351891 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:18.376005 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03523017-0f69-4eac-90d1-3ea1d5f3a94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e2f06e301d4741968472015aae6bd4, user_id=7388e62d6dd34b428c33c29639c0a997, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:18.378751 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03523017-0f69-4eac-90d1-3ea1d5f3a94c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:18.415936 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 986/2003] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:18 2022] PUT /identity/v3/projects/13e2f06e301d4741968472015aae6bd4/users/7388e62d6dd34b428c33c29639c0a997/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:18.417057 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03523017-0f69-4eac-90d1-3ea1d5f3a94c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:18.419987 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-03523017-0f69-4eac-90d1-3ea1d5f3a94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:18.444020 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ab8be-5b85-4088-8eb9-4c1002f1372d None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:18.497408 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:18.519812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cfc67-38c4-410f-9d17-e447fb072866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:18.520633 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cfc67-38c4-410f-9d17-e447fb072866 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:18.520919 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cfc67-38c4-410f-9d17-e447fb072866 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:18.521230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cfc67-38c4-410f-9d17-e447fb072866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:18.527075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03523017-0f69-4eac-90d1-3ea1d5f3a94c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:18.537821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb5d90-4901-4356-99a9-bb53adb3e77d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:18.538575 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb5d90-4901-4356-99a9-bb53adb3e77d service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:18.538957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb5d90-4901-4356-99a9-bb53adb3e77d service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:18.539248 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb5d90-4901-4356-99a9-bb53adb3e77d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:18.605975 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760cfc67-38c4-410f-9d17-e447fb072866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:18.608173 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760cfc67-38c4-410f-9d17-e447fb072866 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:18.622239 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1018/2004] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:18.634759 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d0a03-7d4a-4884-a62f-c712ac0bdb69 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:18.636713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d0a03-7d4a-4884-a62f-c712ac0bdb69 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:18.636713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d0a03-7d4a-4884-a62f-c712ac0bdb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:18.639201 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb5d90-4901-4356-99a9-bb53adb3e77d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:18.640807 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb5d90-4901-4356-99a9-bb53adb3e77d service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:18.662944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 987/2005] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:18.715672 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-c79d0a03-7d4a-4884-a62f-c712ac0bdb69 None None] MFA Rules not processed for user `7388e62d6dd34b428c33c29639c0a997`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:18.720358 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c79d0a03-7d4a-4884-a62f-c712ac0bdb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:18.825577 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb5d90-4901-4356-99a9-bb53adb3e77d service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:18.846053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb5d90-4901-4356-99a9-bb53adb3e77d service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:18.852760 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542b933-3344-43f2-9550-8c21f64f911b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:18.853402 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542b933-3344-43f2-9550-8c21f64f911b service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:18.853684 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542b933-3344-43f2-9550-8c21f64f911b service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:18.853959 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542b933-3344-43f2-9550-8c21f64f911b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:18.856729 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0542b933-3344-43f2-9550-8c21f64f911b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:18.869192 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1019/2006] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:18.873190 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d0a03-7d4a-4884-a62f-c712ac0bdb69 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:18.886686 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d0a03-7d4a-4884-a62f-c712ac0bdb69 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:18.901276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ebf28-8f5a-49bd-b081-71b7eb8bb381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:18.902238 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ebf28-8f5a-49bd-b081-71b7eb8bb381 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:18.902746 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ebf28-8f5a-49bd-b081-71b7eb8bb381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:18.903225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ebf28-8f5a-49bd-b081-71b7eb8bb381 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:18.904066 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ebf28-8f5a-49bd-b081-71b7eb8bb381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:18.906241 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ebf28-8f5a-49bd-b081-71b7eb8bb381 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:18.949553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1020/2007] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:18 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:18.953618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ebf28-8f5a-49bd-b081-71b7eb8bb381 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:18.956412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542b933-3344-43f2-9550-8c21f64f911b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:18.959356 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542b933-3344-43f2-9550-8c21f64f911b service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:18.979648 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 988/2008] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:45:19.043633 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:19.060544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ebf28-8f5a-49bd-b081-71b7eb8bb381 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:19.076664 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bfa01-5d3b-4b2b-94db-d42bfca0a4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:19.077836 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bfa01-5d3b-4b2b-94db-d42bfca0a4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:19.078404 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bfa01-5d3b-4b2b-94db-d42bfca0a4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:19.078688 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bfa01-5d3b-4b2b-94db-d42bfca0a4c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:19.080280 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bfa01-5d3b-4b2b-94db-d42bfca0a4c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:19.083251 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bfa01-5d3b-4b2b-94db-d42bfca0a4c8 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:19.134932 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542b933-3344-43f2-9550-8c21f64f911b service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:19.136114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1021/2009] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:18 2022] POST /identity/v3/users => generated 299 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:45:19.140114 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0542b933-3344-43f2-9550-8c21f64f911b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:19.140901 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bfa01-5d3b-4b2b-94db-d42bfca0a4c8 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:19.159031 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542b933-3344-43f2-9550-8c21f64f911b service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:19.164388 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bfa01-5d3b-4b2b-94db-d42bfca0a4c8 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:19.175964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e37196-adfc-4237-b388-5b1b539a3ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:19.176606 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e37196-adfc-4237-b388-5b1b539a3ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:19.176926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e37196-adfc-4237-b388-5b1b539a3ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:19.177271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e37196-adfc-4237-b388-5b1b539a3ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:19.177954 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e37196-adfc-4237-b388-5b1b539a3ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:19.183460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e37196-adfc-4237-b388-5b1b539a3ca4 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:19.207634 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1022/2010] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:19.211453 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e37196-adfc-4237-b388-5b1b539a3ca4 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:19.237982 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e37196-adfc-4237-b388-5b1b539a3ca4 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:19.244654 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:19.249363 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec693c1-f2d8-4140-b7d1-fd73ba882f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:19.250162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec693c1-f2d8-4140-b7d1-fd73ba882f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:19.250477 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec693c1-f2d8-4140-b7d1-fd73ba882f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:19.250750 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec693c1-f2d8-4140-b7d1-fd73ba882f7f admin admin] PATH_INFO: `/v3/projects/b785f30f650440fb8072e1fb9e5d1c25/users/8bd287c2844540db8e181ff7e3420a7a/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:19.290441 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec693c1-f2d8-4140-b7d1-fd73ba882f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b785f30f650440fb8072e1fb9e5d1c25, user_id=8bd287c2844540db8e181ff7e3420a7a, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:19.293511 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec693c1-f2d8-4140-b7d1-fd73ba882f7f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:19.318539 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1023/2011] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:19 2022] PUT /identity/v3/projects/b785f30f650440fb8072e1fb9e5d1c25/users/8bd287c2844540db8e181ff7e3420a7a/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:45:19.323647 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854b220-897d-4051-b1a6-293e0b05dd7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:19.328782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec693c1-f2d8-4140-b7d1-fd73ba882f7f admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:19.329580 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854b220-897d-4051-b1a6-293e0b05dd7a service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:19.330213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854b220-897d-4051-b1a6-293e0b05dd7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:19.330693 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854b220-897d-4051-b1a6-293e0b05dd7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:19.333912 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6854b220-897d-4051-b1a6-293e0b05dd7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:19.498452 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854b220-897d-4051-b1a6-293e0b05dd7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:19.500284 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854b220-897d-4051-b1a6-293e0b05dd7a service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:19.514454 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 989/2012] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:19.590040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec693c1-f2d8-4140-b7d1-fd73ba882f7f admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:19.600596 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96e887-b1b5-4b56-a9f3-a422203883f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:19.602726 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96e887-b1b5-4b56-a9f3-a422203883f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:19.605017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96e887-b1b5-4b56-a9f3-a422203883f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:19.619316 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96e887-b1b5-4b56-a9f3-a422203883f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:19.622212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96e887-b1b5-4b56-a9f3-a422203883f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:19.627111 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96e887-b1b5-4b56-a9f3-a422203883f2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:19.647915 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1024/2013] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:19.652198 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854b220-897d-4051-b1a6-293e0b05dd7a service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:19.676970 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854b220-897d-4051-b1a6-293e0b05dd7a service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:19.709365 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de4f02-c05e-49b5-824c-5df05ecc6508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:19.710157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de4f02-c05e-49b5-824c-5df05ecc6508 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:19.712961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de4f02-c05e-49b5-824c-5df05ecc6508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:19.713328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de4f02-c05e-49b5-824c-5df05ecc6508 admin admin] PATH_INFO: `/v3/projects/b785f30f650440fb8072e1fb9e5d1c25/users/8bd287c2844540db8e181ff7e3420a7a/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:19.722783 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de4f02-c05e-49b5-824c-5df05ecc6508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b785f30f650440fb8072e1fb9e5d1c25, user_id=8bd287c2844540db8e181ff7e3420a7a, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:19.737717 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de4f02-c05e-49b5-824c-5df05ecc6508 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:19.752245 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96e887-b1b5-4b56-a9f3-a422203883f2 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:19.755749 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9f96e887-b1b5-4b56-a9f3-a422203883f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:19.780973 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 990/2014] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:19 2022] PUT /identity/v3/projects/b785f30f650440fb8072e1fb9e5d1c25/users/8bd287c2844540db8e181ff7e3420a7a/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:19.782814 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f891f-da5e-4efe-9940-ea99977aa7d3 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:19.783104 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f891f-da5e-4efe-9940-ea99977aa7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:19.783522 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f891f-da5e-4efe-9940-ea99977aa7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:19.795379 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96e887-b1b5-4b56-a9f3-a422203883f2 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:19.851072 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-297f891f-da5e-4efe-9940-ea99977aa7d3 None None] MFA Rules not processed for user `8bd287c2844540db8e181ff7e3420a7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:19.852948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-297f891f-da5e-4efe-9940-ea99977aa7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:20.013338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 991/2015] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:45:20.015548 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c50765-4cc9-44fd-bf09-f3823ed6f451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:20.016203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c50765-4cc9-44fd-bf09-f3823ed6f451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:20.016603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c50765-4cc9-44fd-bf09-f3823ed6f451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:20.016860 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c50765-4cc9-44fd-bf09-f3823ed6f451 admin admin] PATH_INFO: `/v3/projects/c67b304368a745ae90f04ae2aae80ccc` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:20.023609 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c50765-4cc9-44fd-bf09-f3823ed6f451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c67b304368a745ae90f04ae2aae80ccc)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:20.026289 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c50765-4cc9-44fd-bf09-f3823ed6f451 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:20.104023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f891f-da5e-4efe-9940-ea99977aa7d3 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:20.152236 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:20.156767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-63c50765-4cc9-44fd-bf09-f3823ed6f451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c67b304368a745ae90f04ae2aae80ccc', 'request_id': 'req-63c50765-4cc9-44fd-bf09-f3823ed6f451'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:20.180437 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-63c50765-4cc9-44fd-bf09-f3823ed6f451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c67b304368a745ae90f04ae2aae80ccc', 'request_id': 'req-63c50765-4cc9-44fd-bf09-f3823ed6f451'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:20.202427 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-63c50765-4cc9-44fd-bf09-f3823ed6f451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c67b304368a745ae90f04ae2aae80ccc', 'request_id': 'req-63c50765-4cc9-44fd-bf09-f3823ed6f451'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:20.217776 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f891f-da5e-4efe-9940-ea99977aa7d3 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:20.227371 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-63c50765-4cc9-44fd-bf09-f3823ed6f451 admin admin] The token cache is being invalidate because project c67b304368a745ae90f04ae2aae80ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:20.227817 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-63c50765-4cc9-44fd-bf09-f3823ed6f451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:20.228761 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-63c50765-4cc9-44fd-bf09-f3823ed6f451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:20.233185 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1025/2016] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:19 2022] DELETE /identity/v3/projects/c67b304368a745ae90f04ae2aae80ccc => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:20.233316 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:20.234318 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c50765-4cc9-44fd-bf09-f3823ed6f451 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:20.235964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-63c50765-4cc9-44fd-bf09-f3823ed6f451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:20.350201 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a69ae-efe2-4b5b-8f0c-7f1bdc072790 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:20.350828 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a69ae-efe2-4b5b-8f0c-7f1bdc072790 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:20.351127 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a69ae-efe2-4b5b-8f0c-7f1bdc072790 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:20.351381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a69ae-efe2-4b5b-8f0c-7f1bdc072790 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:20.361816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c67a69ae-efe2-4b5b-8f0c-7f1bdc072790 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:20.373773 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c50765-4cc9-44fd-bf09-f3823ed6f451 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:20.392625 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0e5ef-ba0a-474f-a2bc-11c53d8e5642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:20.396676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0e5ef-ba0a-474f-a2bc-11c53d8e5642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:20.396810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0e5ef-ba0a-474f-a2bc-11c53d8e5642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:20.401153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0e5ef-ba0a-474f-a2bc-11c53d8e5642 admin admin] PATH_INFO: `/v3/users/93bb2c994fe3481a81e368d484213565` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:20.404268 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0e5ef-ba0a-474f-a2bc-11c53d8e5642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93bb2c994fe3481a81e368d484213565)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:20.420673 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0e5ef-ba0a-474f-a2bc-11c53d8e5642 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:20.516072 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a69ae-efe2-4b5b-8f0c-7f1bdc072790 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:20.520565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a69ae-efe2-4b5b-8f0c-7f1bdc072790 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:20.545030 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 992/2017] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:20.567804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-18b0e5ef-ba0a-474f-a2bc-11c53d8e5642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93bb2c994fe3481a81e368d484213565'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:20.591033 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-18b0e5ef-ba0a-474f-a2bc-11c53d8e5642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93bb2c994fe3481a81e368d484213565'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:20.591754 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-18b0e5ef-ba0a-474f-a2bc-11c53d8e5642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93bb2c994fe3481a81e368d484213565'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:20.592435 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-18b0e5ef-ba0a-474f-a2bc-11c53d8e5642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93bb2c994fe3481a81e368d484213565'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:20.609462 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-18b0e5ef-ba0a-474f-a2bc-11c53d8e5642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93bb2c994fe3481a81e368d484213565'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:20.662877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1026/2018] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:20 2022] DELETE /identity/v3/users/93bb2c994fe3481a81e368d484213565 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:21.465859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a69ae-efe2-4b5b-8f0c-7f1bdc072790 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:21.505143 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a69ae-efe2-4b5b-8f0c-7f1bdc072790 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:21.658893 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99a407-0843-4a5b-8671-e7cc2ad728e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:21.659829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99a407-0843-4a5b-8671-e7cc2ad728e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:21.660216 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99a407-0843-4a5b-8671-e7cc2ad728e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:21.660622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99a407-0843-4a5b-8671-e7cc2ad728e5 admin admin] PATH_INFO: `/v3/projects/08291ee1f4124b33bb64cbb8764d24ab` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:21.665300 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99a407-0843-4a5b-8671-e7cc2ad728e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08291ee1f4124b33bb64cbb8764d24ab)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:21.667496 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99a407-0843-4a5b-8671-e7cc2ad728e5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:21.767655 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3a99a407-0843-4a5b-8671-e7cc2ad728e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08291ee1f4124b33bb64cbb8764d24ab', 'request_id': 'req-3a99a407-0843-4a5b-8671-e7cc2ad728e5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:21.791095 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3a99a407-0843-4a5b-8671-e7cc2ad728e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08291ee1f4124b33bb64cbb8764d24ab', 'request_id': 'req-3a99a407-0843-4a5b-8671-e7cc2ad728e5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:21.805338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3a99a407-0843-4a5b-8671-e7cc2ad728e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08291ee1f4124b33bb64cbb8764d24ab', 'request_id': 'req-3a99a407-0843-4a5b-8671-e7cc2ad728e5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:21.817342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:21.833707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3a99a407-0843-4a5b-8671-e7cc2ad728e5 admin admin] The token cache is being invalidate because project 08291ee1f4124b33bb64cbb8764d24ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:21.836090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3a99a407-0843-4a5b-8671-e7cc2ad728e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:21.838892 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-3a99a407-0843-4a5b-8671-e7cc2ad728e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:21.844798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 993/2019] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:21 2022] DELETE /identity/v3/projects/08291ee1f4124b33bb64cbb8764d24ab => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:21.850563 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50932432-50d2-4d1e-8d62-57f409d7e79b None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:21.851043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50932432-50d2-4d1e-8d62-57f409d7e79b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:21.851390 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50932432-50d2-4d1e-8d62-57f409d7e79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:21.896304 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-50932432-50d2-4d1e-8d62-57f409d7e79b None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:21.899381 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-50932432-50d2-4d1e-8d62-57f409d7e79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:21.996531 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:22.043385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea871521-0217-46c8-8737-5632cbafe315 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:22.043693 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea871521-0217-46c8-8737-5632cbafe315 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:22.043972 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea871521-0217-46c8-8737-5632cbafe315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:22.044564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1027/2020] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:22.097459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ea871521-0217-46c8-8737-5632cbafe315 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:22.102457 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ea871521-0217-46c8-8737-5632cbafe315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:22.122696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 994/2021] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:45:22.125746 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50932432-50d2-4d1e-8d62-57f409d7e79b None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:22.139494 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50932432-50d2-4d1e-8d62-57f409d7e79b None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:22.151880 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b850f-07cf-4a37-a292-6ee69d011930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:22.152552 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b850f-07cf-4a37-a292-6ee69d011930 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:22.152898 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b850f-07cf-4a37-a292-6ee69d011930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:22.153255 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b850f-07cf-4a37-a292-6ee69d011930 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:22.153994 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b850f-07cf-4a37-a292-6ee69d011930 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:45:22.154397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b850f-07cf-4a37-a292-6ee69d011930 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:22.156567 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b850f-07cf-4a37-a292-6ee69d011930 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:22.191066 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1028/2022] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:45:22.195182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea871521-0217-46c8-8737-5632cbafe315 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:22.212975 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea871521-0217-46c8-8737-5632cbafe315 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:22.218947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030dac0d-00bd-4d76-8e52-1c5b0eb1ac72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:22.219561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dac0d-00bd-4d76-8e52-1c5b0eb1ac72 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:22.219846 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dac0d-00bd-4d76-8e52-1c5b0eb1ac72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:22.220123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dac0d-00bd-4d76-8e52-1c5b0eb1ac72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:22.220782 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030dac0d-00bd-4d76-8e52-1c5b0eb1ac72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:22.223031 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030dac0d-00bd-4d76-8e52-1c5b0eb1ac72 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:22.289128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 995/2023] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:22 2022] POST /identity/v3/projects => generated 407 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:22.293114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b850f-07cf-4a37-a292-6ee69d011930 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:22.315137 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b850f-07cf-4a37-a292-6ee69d011930 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:22.475132 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c90045-2dcd-4677-8ff5-1ff208a87370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:22.475765 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c90045-2dcd-4677-8ff5-1ff208a87370 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:22.476130 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c90045-2dcd-4677-8ff5-1ff208a87370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:22.476408 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c90045-2dcd-4677-8ff5-1ff208a87370 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:22.477722 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c90045-2dcd-4677-8ff5-1ff208a87370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:22.480038 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c90045-2dcd-4677-8ff5-1ff208a87370 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:22.549823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030dac0d-00bd-4d76-8e52-1c5b0eb1ac72 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:22.550626 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1029/2024] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:22 2022] POST /identity/v3/users => generated 304 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:22.583936 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030dac0d-00bd-4d76-8e52-1c5b0eb1ac72 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:22.614456 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888691a-cb1f-499b-a243-1dd7b00c64f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:22.615410 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888691a-cb1f-499b-a243-1dd7b00c64f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:22.615410 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888691a-cb1f-499b-a243-1dd7b00c64f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:22.615628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888691a-cb1f-499b-a243-1dd7b00c64f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:22.619201 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888691a-cb1f-499b-a243-1dd7b00c64f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:22.628131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888691a-cb1f-499b-a243-1dd7b00c64f2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:22.666316 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 996/2025] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 00:45:22.674307 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c90045-2dcd-4677-8ff5-1ff208a87370 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:22.698241 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c90045-2dcd-4677-8ff5-1ff208a87370 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:22.710601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f25b46d-ca64-4a00-b6a0-150d8389102c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:22.710601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25b46d-ca64-4a00-b6a0-150d8389102c admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:22.710601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25b46d-ca64-4a00-b6a0-150d8389102c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:22.710601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25b46d-ca64-4a00-b6a0-150d8389102c admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:22.716717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25b46d-ca64-4a00-b6a0-150d8389102c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:22.718497 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f25b46d-ca64-4a00-b6a0-150d8389102c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:22.755153 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1030/2026] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:22.758240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888691a-cb1f-499b-a243-1dd7b00c64f2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:22.815442 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888691a-cb1f-499b-a243-1dd7b00c64f2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:22.837448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e63035-a560-4f39-90a2-1801dfaa5466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:22.838145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e63035-a560-4f39-90a2-1801dfaa5466 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:22.838422 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e63035-a560-4f39-90a2-1801dfaa5466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:22.838700 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e63035-a560-4f39-90a2-1801dfaa5466 admin admin] PATH_INFO: `/v3/projects/86687f67e68e45c4a7b3d54fce4ca0f2/users/c5308581b7414b4080670fce2e46b3d4/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:22.895437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e63035-a560-4f39-90a2-1801dfaa5466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86687f67e68e45c4a7b3d54fce4ca0f2, user_id=c5308581b7414b4080670fce2e46b3d4, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:22.899088 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e63035-a560-4f39-90a2-1801dfaa5466 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:22.938505 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 997/2027] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:22 2022] PUT /identity/v3/projects/86687f67e68e45c4a7b3d54fce4ca0f2/users/c5308581b7414b4080670fce2e46b3d4/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:22.950886 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b56ca9-7256-4d1a-b01b-854a1f52a8c3 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:22.952721 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b56ca9-7256-4d1a-b01b-854a1f52a8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:22.955150 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b56ca9-7256-4d1a-b01b-854a1f52a8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:23.033813 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-24b56ca9-7256-4d1a-b01b-854a1f52a8c3 None None] MFA Rules not processed for user `c5308581b7414b4080670fce2e46b3d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:23.036070 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-24b56ca9-7256-4d1a-b01b-854a1f52a8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:23.229529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1031/2028] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:22 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:23.232223 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e63035-a560-4f39-90a2-1801dfaa5466 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:23.397502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e63035-a560-4f39-90a2-1801dfaa5466 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:23.429861 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fd427-f5b8-49d2-8545-d70439ed316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:23.430497 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fd427-f5b8-49d2-8545-d70439ed316a admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:23.430778 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fd427-f5b8-49d2-8545-d70439ed316a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:23.431055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fd427-f5b8-49d2-8545-d70439ed316a admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:23.431712 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fd427-f5b8-49d2-8545-d70439ed316a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:23.452360 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fd427-f5b8-49d2-8545-d70439ed316a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:23.578694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 998/2029] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:23 2022] POST /identity/v3/projects => generated 409 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:23.584352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b56ca9-7256-4d1a-b01b-854a1f52a8c3 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:23.608899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b56ca9-7256-4d1a-b01b-854a1f52a8c3 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:23.754032 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:23.787498 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaff8ae-52af-4ac3-bb05-a1907c3fe2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:23.788500 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaff8ae-52af-4ac3-bb05-a1907c3fe2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:23.788933 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaff8ae-52af-4ac3-bb05-a1907c3fe2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:23.789492 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaff8ae-52af-4ac3-bb05-a1907c3fe2e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:23.791094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaff8ae-52af-4ac3-bb05-a1907c3fe2e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:23.793761 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaff8ae-52af-4ac3-bb05-a1907c3fe2e2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:23.860527 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1032/2030] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:23 2022] POST /identity/v3/users => generated 311 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:45:23.864879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fd427-f5b8-49d2-8545-d70439ed316a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:23.887231 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fd427-f5b8-49d2-8545-d70439ed316a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:23.902966 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7e3c2-cd34-4f95-8e25-f5c4c59cc82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:23.906220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7e3c2-cd34-4f95-8e25-f5c4c59cc82b admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:23.906740 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7e3c2-cd34-4f95-8e25-f5c4c59cc82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:23.907654 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7e3c2-cd34-4f95-8e25-f5c4c59cc82b admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:23.909143 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7e3c2-cd34-4f95-8e25-f5c4c59cc82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:23.920379 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7e3c2-cd34-4f95-8e25-f5c4c59cc82b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:23.947548 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaff8ae-52af-4ac3-bb05-a1907c3fe2e2 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:23.949487 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-feaff8ae-52af-4ac3-bb05-a1907c3fe2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:23.957151 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 999/2031] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:23.961331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7e3c2-cd34-4f95-8e25-f5c4c59cc82b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:23.969811 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaff8ae-52af-4ac3-bb05-a1907c3fe2e2 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:23.982321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7e3c2-cd34-4f95-8e25-f5c4c59cc82b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:23.984185 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957f695-dbf9-4c7d-8838-3c64d10c82bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:23.985405 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957f695-dbf9-4c7d-8838-3c64d10c82bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:23.985699 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957f695-dbf9-4c7d-8838-3c64d10c82bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:23.986775 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957f695-dbf9-4c7d-8838-3c64d10c82bb admin admin] PATH_INFO: `/v3/users/3e0ddd5e5db5496eadeee868de20eec1` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:23.990502 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957f695-dbf9-4c7d-8838-3c64d10c82bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e0ddd5e5db5496eadeee868de20eec1)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:23.995774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957f695-dbf9-4c7d-8838-3c64d10c82bb admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:24.001971 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d9ec3-5d54-440d-9c19-b4ac46b730f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:24.004576 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d9ec3-5d54-440d-9c19-b4ac46b730f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:24.005105 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d9ec3-5d54-440d-9c19-b4ac46b730f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:24.005652 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d9ec3-5d54-440d-9c19-b4ac46b730f1 admin admin] PATH_INFO: `/v3/projects/9fa2a10f5df2401ab444ba203d36deee/users/eaabfc9d9ea945a787c021216545bd0e/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:24.047327 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d9ec3-5d54-440d-9c19-b4ac46b730f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fa2a10f5df2401ab444ba203d36deee, user_id=eaabfc9d9ea945a787c021216545bd0e, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:24.061937 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d9ec3-5d54-440d-9c19-b4ac46b730f1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:24.093223 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1000/2032] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:23 2022] PUT /identity/v3/projects/9fa2a10f5df2401ab444ba203d36deee/users/eaabfc9d9ea945a787c021216545bd0e/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:24.095537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d9ec3-5d54-440d-9c19-b4ac46b730f1 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:24.158321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1957f695-dbf9-4c7d-8838-3c64d10c82bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e0ddd5e5db5496eadeee868de20eec1'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:24.176934 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1957f695-dbf9-4c7d-8838-3c64d10c82bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e0ddd5e5db5496eadeee868de20eec1'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:24.177871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1957f695-dbf9-4c7d-8838-3c64d10c82bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e0ddd5e5db5496eadeee868de20eec1'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:24.180522 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1957f695-dbf9-4c7d-8838-3c64d10c82bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e0ddd5e5db5496eadeee868de20eec1'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:24.193154 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1957f695-dbf9-4c7d-8838-3c64d10c82bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e0ddd5e5db5496eadeee868de20eec1'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:24.228530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:24.234813 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1033/2033] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:23 2022] DELETE /identity/v3/users/3e0ddd5e5db5496eadeee868de20eec1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:24.239732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455d288-90d8-4cb1-8e83-d4aa838c261f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:24.240031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455d288-90d8-4cb1-8e83-d4aa838c261f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:24.240298 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455d288-90d8-4cb1-8e83-d4aa838c261f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:24.252704 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d9ec3-5d54-440d-9c19-b4ac46b730f1 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:24.283636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-4455d288-90d8-4cb1-8e83-d4aa838c261f None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:24.290090 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4455d288-90d8-4cb1-8e83-d4aa838c261f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:24.356441 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c26e3-9b37-45a4-a390-a0fd4832f3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:24.357351 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c26e3-9b37-45a4-a390-a0fd4832f3ea admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:24.358193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c26e3-9b37-45a4-a390-a0fd4832f3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:24.360343 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c26e3-9b37-45a4-a390-a0fd4832f3ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:24.361384 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c26e3-9b37-45a4-a390-a0fd4832f3ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:24.366571 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c26e3-9b37-45a4-a390-a0fd4832f3ea admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:24.390583 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1001/2034] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:24.395440 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c26e3-9b37-45a4-a390-a0fd4832f3ea admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:24.400144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4f7c26e3-9b37-45a4-a390-a0fd4832f3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:24.462617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c26e3-9b37-45a4-a390-a0fd4832f3ea admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:24.479209 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dadbeb-f658-4eea-b4eb-d5ce13bb72ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:24.479901 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dadbeb-f658-4eea-b4eb-d5ce13bb72ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:24.480198 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dadbeb-f658-4eea-b4eb-d5ce13bb72ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:24.480464 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dadbeb-f658-4eea-b4eb-d5ce13bb72ae admin admin] PATH_INFO: `/v3/projects/9fa2a10f5df2401ab444ba203d36deee/users/eaabfc9d9ea945a787c021216545bd0e/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:24.483665 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dadbeb-f658-4eea-b4eb-d5ce13bb72ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fa2a10f5df2401ab444ba203d36deee, user_id=eaabfc9d9ea945a787c021216545bd0e, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:24.489902 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dadbeb-f658-4eea-b4eb-d5ce13bb72ae admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:24.525937 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1002/2035] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:24 2022] PUT /identity/v3/projects/9fa2a10f5df2401ab444ba203d36deee/users/eaabfc9d9ea945a787c021216545bd0e/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:24.530900 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65551a0d-bd58-4b99-ad2b-819c706fecc1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:24.531199 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65551a0d-bd58-4b99-ad2b-819c706fecc1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:24.532628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65551a0d-bd58-4b99-ad2b-819c706fecc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:24.557581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1034/2036] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:45:24.567417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455d288-90d8-4cb1-8e83-d4aa838c261f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:24.569345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4455d288-90d8-4cb1-8e83-d4aa838c261f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:24.641371 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-65551a0d-bd58-4b99-ad2b-819c706fecc1 None None] MFA Rules not processed for user `eaabfc9d9ea945a787c021216545bd0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:24.643082 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-65551a0d-bd58-4b99-ad2b-819c706fecc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:24.720025 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455d288-90d8-4cb1-8e83-d4aa838c261f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:24.747226 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:24.822722 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1003/2037] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:24 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:24.827506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65551a0d-bd58-4b99-ad2b-819c706fecc1 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:24.829157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-65551a0d-bd58-4b99-ad2b-819c706fecc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:24.844838 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e6703-a91c-462a-a61a-9d36d0be857a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:24.845615 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e6703-a91c-462a-a61a-9d36d0be857a service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:24.846162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e6703-a91c-462a-a61a-9d36d0be857a service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:24.848788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e6703-a91c-462a-a61a-9d36d0be857a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:24.970595 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65551a0d-bd58-4b99-ad2b-819c706fecc1 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:24.986659 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc41907-ced3-4f20-8bf0-51247c31f89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:24.987417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc41907-ced3-4f20-8bf0-51247c31f89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:24.988112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc41907-ced3-4f20-8bf0-51247c31f89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:24.988408 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc41907-ced3-4f20-8bf0-51247c31f89b admin admin] PATH_INFO: `/v3/users/cbb6d699643744c7abe63beab87021da` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:24.992221 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc41907-ced3-4f20-8bf0-51247c31f89b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbb6d699643744c7abe63beab87021da)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:24.996031 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc41907-ced3-4f20-8bf0-51247c31f89b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:25.001178 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e6703-a91c-462a-a61a-9d36d0be857a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:25.003243 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:25.006898 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e6703-a91c-462a-a61a-9d36d0be857a service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:25.036612 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1035/2038] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:45:25.036612 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e6703-a91c-462a-a61a-9d36d0be857a service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:25.041906 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2f8e6703-a91c-462a-a61a-9d36d0be857a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:25.144552 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-dfc41907-ced3-4f20-8bf0-51247c31f89b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbb6d699643744c7abe63beab87021da'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:25.167157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-dfc41907-ced3-4f20-8bf0-51247c31f89b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbb6d699643744c7abe63beab87021da'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:25.167932 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-dfc41907-ced3-4f20-8bf0-51247c31f89b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbb6d699643744c7abe63beab87021da'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:25.168728 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-dfc41907-ced3-4f20-8bf0-51247c31f89b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbb6d699643744c7abe63beab87021da'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:25.207573 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-dfc41907-ced3-4f20-8bf0-51247c31f89b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbb6d699643744c7abe63beab87021da'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:25.245460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e6703-a91c-462a-a61a-9d36d0be857a service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:25.257342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1004/2039] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:24 2022] DELETE /identity/v3/users/cbb6d699643744c7abe63beab87021da => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:25.257342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fa1c2-4f34-4c92-a104-371b95f9ad4c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:25.257342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fa1c2-4f34-4c92-a104-371b95f9ad4c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:25.257342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fa1c2-4f34-4c92-a104-371b95f9ad4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:25.268129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d059d-7539-4fb4-a176-47e9022ba3ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:25.268874 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d059d-7539-4fb4-a176-47e9022ba3ec service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:25.269213 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d059d-7539-4fb4-a176-47e9022ba3ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:25.269569 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d059d-7539-4fb4-a176-47e9022ba3ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:25.274583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b43d059d-7539-4fb4-a176-47e9022ba3ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:25.310224 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d059d-7539-4fb4-a176-47e9022ba3ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:25.311685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d059d-7539-4fb4-a176-47e9022ba3ec service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:25.312929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-353fa1c2-4f34-4c92-a104-371b95f9ad4c None None] MFA Rules not processed for user `14047d34c71345f49bcd4d4bf7bca89a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:25.315388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-353fa1c2-4f34-4c92-a104-371b95f9ad4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:25.356659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1036/2040] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:25 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:25.358559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98726dd9-47a6-432a-86c5-48033a63a2b0 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:25.358854 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98726dd9-47a6-432a-86c5-48033a63a2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:25.359137 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98726dd9-47a6-432a-86c5-48033a63a2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:25.421028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-98726dd9-47a6-432a-86c5-48033a63a2b0 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:25.424360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-98726dd9-47a6-432a-86c5-48033a63a2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:25.439348 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1005/2041] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:25.440780 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fa1c2-4f34-4c92-a104-371b95f9ad4c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:25.442348 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-353fa1c2-4f34-4c92-a104-371b95f9ad4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:25.610349 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1037/2042] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:25.622506 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98726dd9-47a6-432a-86c5-48033a63a2b0 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:25.624238 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-98726dd9-47a6-432a-86c5-48033a63a2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:25.630745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:25.683874 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fa1c2-4f34-4c92-a104-371b95f9ad4c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:25.692311 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e61105-4d51-49e6-90f7-7fa7a6dde46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:25.693012 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e61105-4d51-49e6-90f7-7fa7a6dde46d admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:25.693394 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e61105-4d51-49e6-90f7-7fa7a6dde46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:25.694400 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e61105-4d51-49e6-90f7-7fa7a6dde46d admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:25.696618 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e61105-4d51-49e6-90f7-7fa7a6dde46d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:25.704968 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e61105-4d51-49e6-90f7-7fa7a6dde46d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:25.739394 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98726dd9-47a6-432a-86c5-48033a63a2b0 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:25.744654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757d0c0-04cb-4cb9-9589-285f080cc7bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:25.745621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757d0c0-04cb-4cb9-9589-285f080cc7bf service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:25.746606 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757d0c0-04cb-4cb9-9589-285f080cc7bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:25.747064 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757d0c0-04cb-4cb9-9589-285f080cc7bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:25.752826 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:25.760180 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757d0c0-04cb-4cb9-9589-285f080cc7bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:25.762644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757d0c0-04cb-4cb9-9589-285f080cc7bf service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:25.769485 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1006/2043] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:25 2022] POST /identity/v3/projects => generated 383 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:25.773242 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e61105-4d51-49e6-90f7-7fa7a6dde46d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:25.801886 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1038/2044] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:45:25.803461 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757d0c0-04cb-4cb9-9589-285f080cc7bf service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:25.814004 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e757d0c0-04cb-4cb9-9589-285f080cc7bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:25.889988 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e61105-4d51-49e6-90f7-7fa7a6dde46d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:25.900894 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1e215-fd8b-4dc5-ab7b-9035892cb495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:25.901549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1e215-fd8b-4dc5-ab7b-9035892cb495 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:25.901832 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1e215-fd8b-4dc5-ab7b-9035892cb495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:25.902390 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1e215-fd8b-4dc5-ab7b-9035892cb495 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:25.902766 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1e215-fd8b-4dc5-ab7b-9035892cb495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:25.905892 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1e215-fd8b-4dc5-ab7b-9035892cb495 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:25.918380 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757d0c0-04cb-4cb9-9589-285f080cc7bf service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:25.977609 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1007/2045] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:25 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:25.979674 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1e215-fd8b-4dc5-ab7b-9035892cb495 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:25.987931 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328f7b5-70ab-4c47-b2fd-8c2d2519e002 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:25.988511 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328f7b5-70ab-4c47-b2fd-8c2d2519e002 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:25.988829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328f7b5-70ab-4c47-b2fd-8c2d2519e002 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:25.989116 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328f7b5-70ab-4c47-b2fd-8c2d2519e002 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:25.990039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3eb1e215-fd8b-4dc5-ab7b-9035892cb495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:25.991605 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6328f7b5-70ab-4c47-b2fd-8c2d2519e002 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:26.021038 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1e215-fd8b-4dc5-ab7b-9035892cb495 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:26.027762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38006be1-7302-4ada-98f1-ad8e40b82e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:26.028520 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38006be1-7302-4ada-98f1-ad8e40b82e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:26.028807 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38006be1-7302-4ada-98f1-ad8e40b82e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:26.029101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38006be1-7302-4ada-98f1-ad8e40b82e42 admin admin] PATH_INFO: `/v3/projects/bf36da302e044f419f42c2c5e8aeac93` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:26.030387 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38006be1-7302-4ada-98f1-ad8e40b82e42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf36da302e044f419f42c2c5e8aeac93)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:26.032511 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38006be1-7302-4ada-98f1-ad8e40b82e42 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:26.131267 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6328f7b5-70ab-4c47-b2fd-8c2d2519e002 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:26.131267 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6328f7b5-70ab-4c47-b2fd-8c2d2519e002 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:26.144031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1039/2046] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:25 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:26.146035 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328f7b5-70ab-4c47-b2fd-8c2d2519e002 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:26.156554 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-38006be1-7302-4ada-98f1-ad8e40b82e42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf36da302e044f419f42c2c5e8aeac93', 'request_id': 'req-38006be1-7302-4ada-98f1-ad8e40b82e42'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:26.172332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-38006be1-7302-4ada-98f1-ad8e40b82e42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf36da302e044f419f42c2c5e8aeac93', 'request_id': 'req-38006be1-7302-4ada-98f1-ad8e40b82e42'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:26.174431 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328f7b5-70ab-4c47-b2fd-8c2d2519e002 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:26.187332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-38006be1-7302-4ada-98f1-ad8e40b82e42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf36da302e044f419f42c2c5e8aeac93', 'request_id': 'req-38006be1-7302-4ada-98f1-ad8e40b82e42'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:26.188821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:26.212744 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-38006be1-7302-4ada-98f1-ad8e40b82e42 admin admin] The token cache is being invalidate because project bf36da302e044f419f42c2c5e8aeac93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:26.213291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-38006be1-7302-4ada-98f1-ad8e40b82e42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:26.214167 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-38006be1-7302-4ada-98f1-ad8e40b82e42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:26.219643 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1008/2047] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:25 2022] DELETE /identity/v3/projects/bf36da302e044f419f42c2c5e8aeac93 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:26.220866 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38006be1-7302-4ada-98f1-ad8e40b82e42 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:26.222561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-38006be1-7302-4ada-98f1-ad8e40b82e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:26.258500 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fd5c0-376d-4c7f-bfc2-8a3efcd26464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:26.260114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fd5c0-376d-4c7f-bfc2-8a3efcd26464 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:26.260114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fd5c0-376d-4c7f-bfc2-8a3efcd26464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:26.260559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fd5c0-376d-4c7f-bfc2-8a3efcd26464 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:26.261952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fd5c0-376d-4c7f-bfc2-8a3efcd26464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:26.264045 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fd5c0-376d-4c7f-bfc2-8a3efcd26464 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:26.279008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1040/2048] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:26.280213 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fd5c0-376d-4c7f-bfc2-8a3efcd26464 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:26.284362 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b58fd5c0-376d-4c7f-bfc2-8a3efcd26464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:26.302212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fd5c0-376d-4c7f-bfc2-8a3efcd26464 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:26.308202 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd21f4-4877-48a5-8ba8-8fbbca6c2731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:26.310157 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd21f4-4877-48a5-8ba8-8fbbca6c2731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:26.310523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd21f4-4877-48a5-8ba8-8fbbca6c2731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:26.310872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd21f4-4877-48a5-8ba8-8fbbca6c2731 admin admin] PATH_INFO: `/v3/users/c111e917506f45d2b1f9bc4868c2e3b1` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:26.312330 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd21f4-4877-48a5-8ba8-8fbbca6c2731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c111e917506f45d2b1f9bc4868c2e3b1)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:26.315293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd21f4-4877-48a5-8ba8-8fbbca6c2731 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:26.349078 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38006be1-7302-4ada-98f1-ad8e40b82e42 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:26.359120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908af3a-3e83-4e62-a02f-e71d151fd9e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:26.359830 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908af3a-3e83-4e62-a02f-e71d151fd9e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:26.360120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908af3a-3e83-4e62-a02f-e71d151fd9e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:26.360406 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908af3a-3e83-4e62-a02f-e71d151fd9e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:26.364143 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1908af3a-3e83-4e62-a02f-e71d151fd9e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:26.402342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:26.406392 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-acdd21f4-4877-48a5-8ba8-8fbbca6c2731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c111e917506f45d2b1f9bc4868c2e3b1'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:26.420273 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-acdd21f4-4877-48a5-8ba8-8fbbca6c2731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c111e917506f45d2b1f9bc4868c2e3b1'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:26.421228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-acdd21f4-4877-48a5-8ba8-8fbbca6c2731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c111e917506f45d2b1f9bc4868c2e3b1'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:26.422034 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-acdd21f4-4877-48a5-8ba8-8fbbca6c2731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c111e917506f45d2b1f9bc4868c2e3b1'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:26.431917 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-acdd21f4-4877-48a5-8ba8-8fbbca6c2731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c111e917506f45d2b1f9bc4868c2e3b1'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:26.456803 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1041/2049] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:26 2022] DELETE /identity/v3/users/c111e917506f45d2b1f9bc4868c2e3b1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:26.457799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd21f4-4877-48a5-8ba8-8fbbca6c2731 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:26.459211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-acdd21f4-4877-48a5-8ba8-8fbbca6c2731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:26.478564 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908af3a-3e83-4e62-a02f-e71d151fd9e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:26.480493 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908af3a-3e83-4e62-a02f-e71d151fd9e2 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:26.496746 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1009/2050] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:26.497807 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908af3a-3e83-4e62-a02f-e71d151fd9e2 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:26.499232 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1908af3a-3e83-4e62-a02f-e71d151fd9e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:26.527952 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908af3a-3e83-4e62-a02f-e71d151fd9e2 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:26.681635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd21f4-4877-48a5-8ba8-8fbbca6c2731 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:26.693799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fd428-66a1-4fe4-b4b0-28355f4f9fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:26.696748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fd428-66a1-4fe4-b4b0-28355f4f9fab admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:26.697097 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fd428-66a1-4fe4-b4b0-28355f4f9fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:26.697465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fd428-66a1-4fe4-b4b0-28355f4f9fab admin admin] PATH_INFO: `/v3/projects/95538596db804a8aaae388ad10c11df6/users/febd0a0016fc46888437ac2f5002e879/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:26.720828 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fd428-66a1-4fe4-b4b0-28355f4f9fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=95538596db804a8aaae388ad10c11df6, user_id=febd0a0016fc46888437ac2f5002e879, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:26.723389 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de2497-2c4d-475f-86f5-ce2d1a8fc0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:26.724234 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de2497-2c4d-475f-86f5-ce2d1a8fc0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:26.724519 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de2497-2c4d-475f-86f5-ce2d1a8fc0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:26.724803 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de2497-2c4d-475f-86f5-ce2d1a8fc0b3 admin admin] PATH_INFO: `/v3/projects/f74cb7fbff3743f5be3cd581f9b26cd6` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:26.725618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fd428-66a1-4fe4-b4b0-28355f4f9fab admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:26.726588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de2497-2c4d-475f-86f5-ce2d1a8fc0b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f74cb7fbff3743f5be3cd581f9b26cd6)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:26.728541 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de2497-2c4d-475f-86f5-ce2d1a8fc0b3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:26.751858 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1042/2051] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:26 2022] PUT /identity/v3/projects/95538596db804a8aaae388ad10c11df6/users/febd0a0016fc46888437ac2f5002e879/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:26.753385 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fd428-66a1-4fe4-b4b0-28355f4f9fab admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:26.774557 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:26.873115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-45de2497-2c4d-475f-86f5-ce2d1a8fc0b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f74cb7fbff3743f5be3cd581f9b26cd6', 'request_id': 'req-45de2497-2c4d-475f-86f5-ce2d1a8fc0b3'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:26.897957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-45de2497-2c4d-475f-86f5-ce2d1a8fc0b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f74cb7fbff3743f5be3cd581f9b26cd6', 'request_id': 'req-45de2497-2c4d-475f-86f5-ce2d1a8fc0b3'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:26.913445 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-45de2497-2c4d-475f-86f5-ce2d1a8fc0b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f74cb7fbff3743f5be3cd581f9b26cd6', 'request_id': 'req-45de2497-2c4d-475f-86f5-ce2d1a8fc0b3'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:26.938667 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fd428-66a1-4fe4-b4b0-28355f4f9fab admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:26.948844 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-45de2497-2c4d-475f-86f5-ce2d1a8fc0b3 admin admin] The token cache is being invalidate because project f74cb7fbff3743f5be3cd581f9b26cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:26.949186 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-45de2497-2c4d-475f-86f5-ce2d1a8fc0b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:26.951605 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-45de2497-2c4d-475f-86f5-ce2d1a8fc0b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:26.971934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1010/2052] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:26 2022] DELETE /identity/v3/projects/f74cb7fbff3743f5be3cd581f9b26cd6 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:26.974949 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de2497-2c4d-475f-86f5-ce2d1a8fc0b3 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:26.978853 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-45de2497-2c4d-475f-86f5-ce2d1a8fc0b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:27.077732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af73c4-cac3-4c84-80ed-4990035b8d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:27.078607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af73c4-cac3-4c84-80ed-4990035b8d70 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:27.079096 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af73c4-cac3-4c84-80ed-4990035b8d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:27.079575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af73c4-cac3-4c84-80ed-4990035b8d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:27.080768 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af73c4-cac3-4c84-80ed-4990035b8d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:27.083626 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af73c4-cac3-4c84-80ed-4990035b8d70 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:27.097821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1043/2053] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:27.098737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af73c4-cac3-4c84-80ed-4990035b8d70 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:27.101046 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e9af73c4-cac3-4c84-80ed-4990035b8d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:27.123270 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:27.123554 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af73c4-cac3-4c84-80ed-4990035b8d70 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:27.129969 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28fc32-6377-4405-b612-a93322a828ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:27.130723 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28fc32-6377-4405-b612-a93322a828ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:27.131113 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28fc32-6377-4405-b612-a93322a828ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:27.131503 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28fc32-6377-4405-b612-a93322a828ca admin admin] PATH_INFO: `/v3/projects/a7c311c55f9d45fe961e2afe13aa0f51` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:27.135009 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28fc32-6377-4405-b612-a93322a828ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7c311c55f9d45fe961e2afe13aa0f51)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:27.139412 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28fc32-6377-4405-b612-a93322a828ca admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:27.187260 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de2497-2c4d-475f-86f5-ce2d1a8fc0b3 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:27.193221 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0bda5-acd8-40e3-8a96-f2d86b751a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:27.194351 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0bda5-acd8-40e3-8a96-f2d86b751a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:27.194751 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0bda5-acd8-40e3-8a96-f2d86b751a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:27.195926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0bda5-acd8-40e3-8a96-f2d86b751a5f admin admin] PATH_INFO: `/v3/users/697925e0cc184564b935e1d7bf0ef438` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:27.198794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0bda5-acd8-40e3-8a96-f2d86b751a5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=697925e0cc184564b935e1d7bf0ef438)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:27.205481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0bda5-acd8-40e3-8a96-f2d86b751a5f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:27.250185 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-cf28fc32-6377-4405-b612-a93322a828ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7c311c55f9d45fe961e2afe13aa0f51', 'request_id': 'req-cf28fc32-6377-4405-b612-a93322a828ca'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:27.258295 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-cf28fc32-6377-4405-b612-a93322a828ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7c311c55f9d45fe961e2afe13aa0f51', 'request_id': 'req-cf28fc32-6377-4405-b612-a93322a828ca'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:27.271099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-cf28fc32-6377-4405-b612-a93322a828ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7c311c55f9d45fe961e2afe13aa0f51', 'request_id': 'req-cf28fc32-6377-4405-b612-a93322a828ca'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:27.293583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-cf28fc32-6377-4405-b612-a93322a828ca admin admin] The token cache is being invalidate because project a7c311c55f9d45fe961e2afe13aa0f51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:27.294080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-cf28fc32-6377-4405-b612-a93322a828ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:27.294793 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-cf28fc32-6377-4405-b612-a93322a828ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:27.298738 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1044/2054] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:27 2022] DELETE /identity/v3/projects/a7c311c55f9d45fe961e2afe13aa0f51 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:27.306365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28fc32-6377-4405-b612-a93322a828ca admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:27.308425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ddd0bda5-acd8-40e3-8a96-f2d86b751a5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '697925e0cc184564b935e1d7bf0ef438'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:27.308629 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cf28fc32-6377-4405-b612-a93322a828ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:27.333118 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ddd0bda5-acd8-40e3-8a96-f2d86b751a5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '697925e0cc184564b935e1d7bf0ef438'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:27.333118 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ddd0bda5-acd8-40e3-8a96-f2d86b751a5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '697925e0cc184564b935e1d7bf0ef438'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:27.333118 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ddd0bda5-acd8-40e3-8a96-f2d86b751a5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '697925e0cc184564b935e1d7bf0ef438'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:27.354545 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:27.372866 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ddd0bda5-acd8-40e3-8a96-f2d86b751a5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '697925e0cc184564b935e1d7bf0ef438'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:27.405711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28fc32-6377-4405-b612-a93322a828ca admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:27.410417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1011/2055] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:26 2022] DELETE /identity/v3/users/697925e0cc184564b935e1d7bf0ef438 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:27.412189 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577a6de-9986-4c15-9e75-93445fecc254 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:27.412496 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577a6de-9986-4c15-9e75-93445fecc254 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:27.412908 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577a6de-9986-4c15-9e75-93445fecc254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:27.439541 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9577a6de-9986-4c15-9e75-93445fecc254 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:27.441927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9577a6de-9986-4c15-9e75-93445fecc254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:27.493235 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb04208-9a3c-4bbf-8e0f-b1b4e86f3abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:27.494564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb04208-9a3c-4bbf-8e0f-b1b4e86f3abd admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:27.495117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb04208-9a3c-4bbf-8e0f-b1b4e86f3abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:27.495639 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb04208-9a3c-4bbf-8e0f-b1b4e86f3abd admin admin] PATH_INFO: `/v3/projects/95538596db804a8aaae388ad10c11df6/users/febd0a0016fc46888437ac2f5002e879/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:27.499332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb04208-9a3c-4bbf-8e0f-b1b4e86f3abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=95538596db804a8aaae388ad10c11df6, user_id=febd0a0016fc46888437ac2f5002e879, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:27.502748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb04208-9a3c-4bbf-8e0f-b1b4e86f3abd admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:27.518156 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1045/2056] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:27 2022] PUT /identity/v3/projects/95538596db804a8aaae388ad10c11df6/users/febd0a0016fc46888437ac2f5002e879/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:27.606914 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1012/2057] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:27.616596 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69b8b0-c6a0-4eef-88d8-328726c180c0 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:27.618420 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69b8b0-c6a0-4eef-88d8-328726c180c0 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:27.618904 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69b8b0-c6a0-4eef-88d8-328726c180c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:27.653566 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-3c69b8b0-c6a0-4eef-88d8-328726c180c0 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:27.655963 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3c69b8b0-c6a0-4eef-88d8-328726c180c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:27.748275 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1046/2058] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:27.753020 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577a6de-9986-4c15-9e75-93445fecc254 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:27.770139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577a6de-9986-4c15-9e75-93445fecc254 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:27.779648 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef85465-f238-4fbd-a53a-f9209abf198d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:27.781205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef85465-f238-4fbd-a53a-f9209abf198d admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:27.781609 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef85465-f238-4fbd-a53a-f9209abf198d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:27.781944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef85465-f238-4fbd-a53a-f9209abf198d admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:27.783178 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef85465-f238-4fbd-a53a-f9209abf198d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:45:27.783413 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef85465-f238-4fbd-a53a-f9209abf198d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:27.800145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef85465-f238-4fbd-a53a-f9209abf198d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:27.838280 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1013/2059] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:45:27.839808 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69b8b0-c6a0-4eef-88d8-328726c180c0 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:27.853701 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69b8b0-c6a0-4eef-88d8-328726c180c0 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:27.876048 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1583e52-74c1-42df-a32f-43971494067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:27.876713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1583e52-74c1-42df-a32f-43971494067f admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:27.878122 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1583e52-74c1-42df-a32f-43971494067f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:27.878404 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1583e52-74c1-42df-a32f-43971494067f admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:27.879320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1583e52-74c1-42df-a32f-43971494067f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:27.885585 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1583e52-74c1-42df-a32f-43971494067f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:27.890267 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef85465-f238-4fbd-a53a-f9209abf198d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:27.898009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1ef85465-f238-4fbd-a53a-f9209abf198d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:27.931011 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef85465-f238-4fbd-a53a-f9209abf198d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:27.934774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1047/2060] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:27 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:27.936622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1583e52-74c1-42df-a32f-43971494067f admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:28.014412 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:28.053000 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1583e52-74c1-42df-a32f-43971494067f admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:28.055890 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:28.064055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304baf8-0f8b-40b0-bd7f-85d846bc0152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:28.064776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304baf8-0f8b-40b0-bd7f-85d846bc0152 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:28.065065 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304baf8-0f8b-40b0-bd7f-85d846bc0152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:28.065623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304baf8-0f8b-40b0-bd7f-85d846bc0152 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:28.066313 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304baf8-0f8b-40b0-bd7f-85d846bc0152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:28.068855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304baf8-0f8b-40b0-bd7f-85d846bc0152 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:28.079539 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a6cac-2c76-457f-91d8-52cc8b303064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:28.081260 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a6cac-2c76-457f-91d8-52cc8b303064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:28.081434 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a6cac-2c76-457f-91d8-52cc8b303064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:28.081705 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a6cac-2c76-457f-91d8-52cc8b303064 admin admin] PATH_INFO: `/v3/projects/93060aa6b40f4ad2a5d06423c1e32979` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:28.087033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a6cac-2c76-457f-91d8-52cc8b303064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93060aa6b40f4ad2a5d06423c1e32979)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:28.089502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a6cac-2c76-457f-91d8-52cc8b303064 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:28.117561 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1048/2061] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:27 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:28.118636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304baf8-0f8b-40b0-bd7f-85d846bc0152 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:28.132965 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304baf8-0f8b-40b0-bd7f-85d846bc0152 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:28.145746 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85ce87-9a0b-4761-8e35-9339edc32e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:28.146223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85ce87-9a0b-4761-8e35-9339edc32e84 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:28.146509 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85ce87-9a0b-4761-8e35-9339edc32e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:28.146872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85ce87-9a0b-4761-8e35-9339edc32e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:28.147678 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85ce87-9a0b-4761-8e35-9339edc32e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:28.150633 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85ce87-9a0b-4761-8e35-9339edc32e84 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:28.171826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1049/2062] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 00:45:28.172802 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85ce87-9a0b-4761-8e35-9339edc32e84 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:28.184484 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85ce87-9a0b-4761-8e35-9339edc32e84 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:28.185928 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0f2a6cac-2c76-457f-91d8-52cc8b303064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93060aa6b40f4ad2a5d06423c1e32979', 'request_id': 'req-0f2a6cac-2c76-457f-91d8-52cc8b303064'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:28.202086 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0f2a6cac-2c76-457f-91d8-52cc8b303064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93060aa6b40f4ad2a5d06423c1e32979', 'request_id': 'req-0f2a6cac-2c76-457f-91d8-52cc8b303064'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:28.229682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0f2a6cac-2c76-457f-91d8-52cc8b303064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93060aa6b40f4ad2a5d06423c1e32979', 'request_id': 'req-0f2a6cac-2c76-457f-91d8-52cc8b303064'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:28.258211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0f2a6cac-2c76-457f-91d8-52cc8b303064 admin admin] The token cache is being invalidate because project 93060aa6b40f4ad2a5d06423c1e32979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:28.260562 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0f2a6cac-2c76-457f-91d8-52cc8b303064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:28.261746 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0f2a6cac-2c76-457f-91d8-52cc8b303064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:28.267002 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1014/2063] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:27 2022] DELETE /identity/v3/projects/93060aa6b40f4ad2a5d06423c1e32979 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:28.272905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d72ba-5675-4521-9ffc-c3a6dcc67667 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:28.273935 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d72ba-5675-4521-9ffc-c3a6dcc67667 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:28.276741 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d72ba-5675-4521-9ffc-c3a6dcc67667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:28.290075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9f315-852c-4831-bafd-dee90148bcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:28.290697 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9f315-852c-4831-bafd-dee90148bcdb admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:28.291573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9f315-852c-4831-bafd-dee90148bcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:28.291942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9f315-852c-4831-bafd-dee90148bcdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:28.292712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9f315-852c-4831-bafd-dee90148bcdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:28.296202 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9f315-852c-4831-bafd-dee90148bcdb admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:28.314169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9e1d72ba-5675-4521-9ffc-c3a6dcc67667 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:28.317793 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1050/2064] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:28.322425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9e1d72ba-5675-4521-9ffc-c3a6dcc67667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:28.328286 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9f315-852c-4831-bafd-dee90148bcdb admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:28.330730 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7be9f315-852c-4831-bafd-dee90148bcdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:28.332534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1015/2065] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:28.340800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89469d-907e-4ec9-86c9-d918d94262ab None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:28.341446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89469d-907e-4ec9-86c9-d918d94262ab None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:28.342128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89469d-907e-4ec9-86c9-d918d94262ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:28.363522 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9f315-852c-4831-bafd-dee90148bcdb admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:28.381340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3c89469d-907e-4ec9-86c9-d918d94262ab None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:28.383123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3c89469d-907e-4ec9-86c9-d918d94262ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:28.387318 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e6155-94b1-4942-b627-acdc8c530e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:28.388842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e6155-94b1-4942-b627-acdc8c530e97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:28.390661 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e6155-94b1-4942-b627-acdc8c530e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:28.390784 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e6155-94b1-4942-b627-acdc8c530e97 admin admin] PATH_INFO: `/v3/projects/d44ea7d6af8946aab81efc3b50d663d1/users/d069087a7b7a43f2b62e7fa414fd471c/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:28.396724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1016/2066] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:28.410313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89469d-907e-4ec9-86c9-d918d94262ab None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:28.428022 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e6155-94b1-4942-b627-acdc8c530e97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d44ea7d6af8946aab81efc3b50d663d1, user_id=d069087a7b7a43f2b62e7fa414fd471c, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:28.435434 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89469d-907e-4ec9-86c9-d918d94262ab None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:28.436184 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e6155-94b1-4942-b627-acdc8c530e97 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:28.454281 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503a5a2-4ee6-44e1-ac07-50a16f03e156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:28.454743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503a5a2-4ee6-44e1-ac07-50a16f03e156 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:28.455129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503a5a2-4ee6-44e1-ac07-50a16f03e156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:28.455416 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503a5a2-4ee6-44e1-ac07-50a16f03e156 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:28.456080 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503a5a2-4ee6-44e1-ac07-50a16f03e156 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:45:28.456384 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503a5a2-4ee6-44e1-ac07-50a16f03e156 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:28.467121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503a5a2-4ee6-44e1-ac07-50a16f03e156 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:28.472537 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1051/2067] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:28 2022] PUT /identity/v3/projects/d44ea7d6af8946aab81efc3b50d663d1/users/d069087a7b7a43f2b62e7fa414fd471c/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:28.474608 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ce1b6-b8b9-4c97-97a7-e5702b42bdb4 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:28.475114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ce1b6-b8b9-4c97-97a7-e5702b42bdb4 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:28.475560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ce1b6-b8b9-4c97-97a7-e5702b42bdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:28.485135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1017/2068] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:45:28.498476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503a5a2-4ee6-44e1-ac07-50a16f03e156 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:28.512785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503a5a2-4ee6-44e1-ac07-50a16f03e156 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:28.548026 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-0d2ce1b6-b8b9-4c97-97a7-e5702b42bdb4 None None] MFA Rules not processed for user `d069087a7b7a43f2b62e7fa414fd471c`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:28.549447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0d2ce1b6-b8b9-4c97-97a7-e5702b42bdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:28.657707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ff105-74e8-41ad-8349-97ee0459f368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:28.657707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff105-74e8-41ad-8349-97ee0459f368 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:28.657707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff105-74e8-41ad-8349-97ee0459f368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:28.657707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff105-74e8-41ad-8349-97ee0459f368 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:28.658164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ff105-74e8-41ad-8349-97ee0459f368 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:28.665697 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ff105-74e8-41ad-8349-97ee0459f368 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:28.703739 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1052/2069] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:28.703739 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ce1b6-b8b9-4c97-97a7-e5702b42bdb4 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:28.727008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ce1b6-b8b9-4c97-97a7-e5702b42bdb4 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:28.734587 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1018/2070] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:28 2022] POST /identity/v3/projects => generated 377 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:28.738975 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ff105-74e8-41ad-8349-97ee0459f368 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:28.740599 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded827e-0900-4725-815c-3b8ed464bec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:28.741263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded827e-0900-4725-815c-3b8ed464bec6 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:28.741571 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded827e-0900-4725-815c-3b8ed464bec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:28.741891 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded827e-0900-4725-815c-3b8ed464bec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:28.742499 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded827e-0900-4725-815c-3b8ed464bec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:28.744433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded827e-0900-4725-815c-3b8ed464bec6 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:28.867688 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1053/2071] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:28 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:28.870009 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded827e-0900-4725-815c-3b8ed464bec6 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:28.915061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:28.923375 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:28.971798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ff105-74e8-41ad-8349-97ee0459f368 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:29.084445 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded827e-0900-4725-815c-3b8ed464bec6 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:29.091564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6ff86-22bf-46c3-affb-93f8b85d5ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:29.092561 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6ff86-22bf-46c3-affb-93f8b85d5ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:29.093128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6ff86-22bf-46c3-affb-93f8b85d5ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:29.093662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6ff86-22bf-46c3-affb-93f8b85d5ae4 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:29.095719 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6ff86-22bf-46c3-affb-93f8b85d5ae4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:29.099950 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6ff86-22bf-46c3-affb-93f8b85d5ae4 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:29.160699 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1054/2072] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:28 2022] POST /identity/v3/users => generated 294 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:29.166379 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6ff86-22bf-46c3-affb-93f8b85d5ae4 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:29.166858 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe5c11-2a52-4e5a-a13f-42ee7d45e4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:29.168022 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe5c11-2a52-4e5a-a13f-42ee7d45e4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:29.168383 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe5c11-2a52-4e5a-a13f-42ee7d45e4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:29.168722 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe5c11-2a52-4e5a-a13f-42ee7d45e4b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:29.169538 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe5c11-2a52-4e5a-a13f-42ee7d45e4b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:29.171645 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe5c11-2a52-4e5a-a13f-42ee7d45e4b5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:29.198580 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6ff86-22bf-46c3-affb-93f8b85d5ae4 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:29.208261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e7196-86e3-478f-8b92-f6fad2722912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:29.209264 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e7196-86e3-478f-8b92-f6fad2722912 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:29.209784 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e7196-86e3-478f-8b92-f6fad2722912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:29.210326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e7196-86e3-478f-8b92-f6fad2722912 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:29.212010 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e7196-86e3-478f-8b92-f6fad2722912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:29.215077 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e7196-86e3-478f-8b92-f6fad2722912 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:29.229230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1019/2073] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:28 2022] POST /identity/v3/users => generated 289 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:29.234648 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe5c11-2a52-4e5a-a13f-42ee7d45e4b5 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:29.248061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe5c11-2a52-4e5a-a13f-42ee7d45e4b5 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:29.255855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1055/2074] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:29.261931 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e7196-86e3-478f-8b92-f6fad2722912 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:29.263519 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99f143-c973-47c2-b740-40a031831994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:29.264230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99f143-c973-47c2-b740-40a031831994 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:29.264825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99f143-c973-47c2-b740-40a031831994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:29.265233 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99f143-c973-47c2-b740-40a031831994 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:29.266181 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99f143-c973-47c2-b740-40a031831994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:29.280635 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99f143-c973-47c2-b740-40a031831994 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:29.291611 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e7196-86e3-478f-8b92-f6fad2722912 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:29.306807 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306e368-a3ff-4af8-a6f9-68e513496e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:29.307319 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306e368-a3ff-4af8-a6f9-68e513496e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:29.307727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306e368-a3ff-4af8-a6f9-68e513496e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:29.307911 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306e368-a3ff-4af8-a6f9-68e513496e45 admin admin] PATH_INFO: `/v3/projects/b6c9ff44302a4c46b9cc24a9013e6b68/users/3ad1c1ab0b4d4ce789ed07c3748de30c/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:29.319647 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1020/2075] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:29.330092 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99f143-c973-47c2-b740-40a031831994 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:29.357072 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99f143-c973-47c2-b740-40a031831994 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:29.365130 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306e368-a3ff-4af8-a6f9-68e513496e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c9ff44302a4c46b9cc24a9013e6b68, user_id=3ad1c1ab0b4d4ce789ed07c3748de30c, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:29.369212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10eb359-69fe-427a-bdf8-8af119d3efbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:29.369841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10eb359-69fe-427a-bdf8-8af119d3efbd admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:29.370122 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10eb359-69fe-427a-bdf8-8af119d3efbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:29.370394 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10eb359-69fe-427a-bdf8-8af119d3efbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:29.371497 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10eb359-69fe-427a-bdf8-8af119d3efbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:29.372639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10eb359-69fe-427a-bdf8-8af119d3efbd admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:29.374716 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306e368-a3ff-4af8-a6f9-68e513496e45 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:29.397193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1021/2076] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:29.411911 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10eb359-69fe-427a-bdf8-8af119d3efbd admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:29.422542 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1056/2077] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:29 2022] PUT /identity/v3/projects/b6c9ff44302a4c46b9cc24a9013e6b68/users/3ad1c1ab0b4d4ce789ed07c3748de30c/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:29.426590 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306e368-a3ff-4af8-a6f9-68e513496e45 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:29.436628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10eb359-69fe-427a-bdf8-8af119d3efbd admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:29.588604 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306e368-a3ff-4af8-a6f9-68e513496e45 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:29.604828 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7101f-c572-45cf-bf21-4ae004ab927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:29.604828 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7101f-c572-45cf-bf21-4ae004ab927c admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:29.604828 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7101f-c572-45cf-bf21-4ae004ab927c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:29.604828 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7101f-c572-45cf-bf21-4ae004ab927c admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:29.605213 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7101f-c572-45cf-bf21-4ae004ab927c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:29.606501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7101f-c572-45cf-bf21-4ae004ab927c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:29.622610 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1057/2078] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:29.628520 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7101f-c572-45cf-bf21-4ae004ab927c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:29.629609 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d8ca5-d708-4a2f-b0d5-88a475d55dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:29.630266 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d8ca5-d708-4a2f-b0d5-88a475d55dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:29.630538 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d8ca5-d708-4a2f-b0d5-88a475d55dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:29.630812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d8ca5-d708-4a2f-b0d5-88a475d55dcb admin admin] PATH_INFO: `/v3/projects/014de82efca54baaa9ff95c56e22a4e9/users/3931011ae4c845d38e95bf2eebcca45b/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:29.652740 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7101f-c572-45cf-bf21-4ae004ab927c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:29.665417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df9361-557a-41ca-9c37-6d933cfbf9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:29.667994 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df9361-557a-41ca-9c37-6d933cfbf9fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:29.668292 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df9361-557a-41ca-9c37-6d933cfbf9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:29.668574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df9361-557a-41ca-9c37-6d933cfbf9fe admin admin] PATH_INFO: `/v3/projects/b6c9ff44302a4c46b9cc24a9013e6b68/users/3ad1c1ab0b4d4ce789ed07c3748de30c/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:29.670969 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d8ca5-d708-4a2f-b0d5-88a475d55dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=014de82efca54baaa9ff95c56e22a4e9, user_id=3931011ae4c845d38e95bf2eebcca45b, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:29.674280 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df9361-557a-41ca-9c37-6d933cfbf9fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c9ff44302a4c46b9cc24a9013e6b68, user_id=3ad1c1ab0b4d4ce789ed07c3748de30c, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:29.678277 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d8ca5-d708-4a2f-b0d5-88a475d55dcb admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:29.681151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df9361-557a-41ca-9c37-6d933cfbf9fe admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:29.708810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1022/2079] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:29 2022] PUT /identity/v3/projects/014de82efca54baaa9ff95c56e22a4e9/users/3931011ae4c845d38e95bf2eebcca45b/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:29.721994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d62b7-2521-425a-a26d-8a71f876b1a3 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:29.722572 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1058/2080] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:29 2022] PUT /identity/v3/projects/b6c9ff44302a4c46b9cc24a9013e6b68/users/3ad1c1ab0b4d4ce789ed07c3748de30c/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:29.725190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d62b7-2521-425a-a26d-8a71f876b1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:29.725589 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d62b7-2521-425a-a26d-8a71f876b1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:29.736631 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38328e3-1a80-4487-a860-9658d55aa8aa None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:29.737728 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38328e3-1a80-4487-a860-9658d55aa8aa None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:29.738935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38328e3-1a80-4487-a860-9658d55aa8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:29.832259 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-082d62b7-2521-425a-a26d-8a71f876b1a3 None None] MFA Rules not processed for user `3931011ae4c845d38e95bf2eebcca45b`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:29.833358 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-082d62b7-2521-425a-a26d-8a71f876b1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:29.848549 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-d38328e3-1a80-4487-a860-9658d55aa8aa None None] MFA Rules not processed for user `3ad1c1ab0b4d4ce789ed07c3748de30c`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:29.850076 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d38328e3-1a80-4487-a860-9658d55aa8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:29.920858 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:29.979711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:30.014702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1023/2081] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:45:30.021329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d62b7-2521-425a-a26d-8a71f876b1a3 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:30.056284 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1059/2082] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:30.163287 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38328e3-1a80-4487-a860-9658d55aa8aa None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:30.165503 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d38328e3-1a80-4487-a860-9658d55aa8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:30.187964 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d62b7-2521-425a-a26d-8a71f876b1a3 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:30.205207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56f0f4-ff27-4ad3-9d46-077164f81884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:30.209393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56f0f4-ff27-4ad3-9d46-077164f81884 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:30.209968 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56f0f4-ff27-4ad3-9d46-077164f81884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:30.210390 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56f0f4-ff27-4ad3-9d46-077164f81884 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:30.217454 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56f0f4-ff27-4ad3-9d46-077164f81884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:30.220289 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56f0f4-ff27-4ad3-9d46-077164f81884 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:30.299056 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1024/2083] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:30 2022] POST /identity/v3/projects => generated 379 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:30.303403 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56f0f4-ff27-4ad3-9d46-077164f81884 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:30.356668 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38328e3-1a80-4487-a860-9658d55aa8aa None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:30.501752 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c7d62-22e6-4f77-ba33-0cb61b4cf81a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:30.502398 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c7d62-22e6-4f77-ba33-0cb61b4cf81a service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:30.502692 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c7d62-22e6-4f77-ba33-0cb61b4cf81a service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:30.502951 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c7d62-22e6-4f77-ba33-0cb61b4cf81a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:30.508417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56f0f4-ff27-4ad3-9d46-077164f81884 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:30.528449 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847aa04a-7098-40ef-8da0-32a751940550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:30.529078 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847aa04a-7098-40ef-8da0-32a751940550 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:30.534462 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847aa04a-7098-40ef-8da0-32a751940550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:30.534810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847aa04a-7098-40ef-8da0-32a751940550 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:30.535545 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847aa04a-7098-40ef-8da0-32a751940550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:30.546801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847aa04a-7098-40ef-8da0-32a751940550 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:30.598467 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1025/2084] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:30 2022] POST /identity/v3/users => generated 290 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:30.610935 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847aa04a-7098-40ef-8da0-32a751940550 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:30.624429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847aa04a-7098-40ef-8da0-32a751940550 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:30.631614 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f87051-3e08-469b-98fc-f775a1fe0f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:30.632560 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f87051-3e08-469b-98fc-f775a1fe0f87 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:30.633226 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f87051-3e08-469b-98fc-f775a1fe0f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:30.633712 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f87051-3e08-469b-98fc-f775a1fe0f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:30.634546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f87051-3e08-469b-98fc-f775a1fe0f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:30.636778 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f87051-3e08-469b-98fc-f775a1fe0f87 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:30.653804 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1026/2085] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 00:45:30.654751 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f87051-3e08-469b-98fc-f775a1fe0f87 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:30.659960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c7d62-22e6-4f77-ba33-0cb61b4cf81a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:30.666418 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c7d62-22e6-4f77-ba33-0cb61b4cf81a service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:30.668886 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f87051-3e08-469b-98fc-f775a1fe0f87 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:30.674421 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cb33e-52b5-4356-b71c-e4b6ac3853de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:30.675186 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cb33e-52b5-4356-b71c-e4b6ac3853de admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:30.675475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cb33e-52b5-4356-b71c-e4b6ac3853de admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:30.675759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cb33e-52b5-4356-b71c-e4b6ac3853de admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:30.676413 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cb33e-52b5-4356-b71c-e4b6ac3853de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:30.678114 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cb33e-52b5-4356-b71c-e4b6ac3853de admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:30.690087 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1027/2086] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:30.696043 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cb33e-52b5-4356-b71c-e4b6ac3853de admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:30.700327 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1060/2087] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:45:30.714901 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cb33e-52b5-4356-b71c-e4b6ac3853de admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:30.721431 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef2ddd-230e-4fed-b40d-6cf349d8f337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:30.721431 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef2ddd-230e-4fed-b40d-6cf349d8f337 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:30.721431 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef2ddd-230e-4fed-b40d-6cf349d8f337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:30.721828 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef2ddd-230e-4fed-b40d-6cf349d8f337 admin admin] PATH_INFO: `/v3/projects/f51b6287b4cc434785d6902bf96f47d4/users/6496d78669364984aa84aff578daf9c4/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:30.746926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef2ddd-230e-4fed-b40d-6cf349d8f337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f51b6287b4cc434785d6902bf96f47d4, user_id=6496d78669364984aa84aff578daf9c4, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:30.749818 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef2ddd-230e-4fed-b40d-6cf349d8f337 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:30.765381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:30.782843 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1028/2088] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:30 2022] PUT /identity/v3/projects/f51b6287b4cc434785d6902bf96f47d4/users/6496d78669364984aa84aff578daf9c4/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:30.784209 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c4ed7-607c-4c42-b916-04d74a779df1 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:30.784958 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c4ed7-607c-4c42-b916-04d74a779df1 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:30.785462 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c4ed7-607c-4c42-b916-04d74a779df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:30.842775 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-df9c4ed7-607c-4c42-b916-04d74a779df1 None None] MFA Rules not processed for user `6496d78669364984aa84aff578daf9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:30.844239 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-df9c4ed7-607c-4c42-b916-04d74a779df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:30.920702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:30.995793 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1061/2089] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:31.000108 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef2ddd-230e-4fed-b40d-6cf349d8f337 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:31.135603 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef2ddd-230e-4fed-b40d-6cf349d8f337 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:31.143898 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad692b70-e5a0-4a41-bfe4-faf061d1526a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:31.144618 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad692b70-e5a0-4a41-bfe4-faf061d1526a admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:31.144957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad692b70-e5a0-4a41-bfe4-faf061d1526a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:31.145313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad692b70-e5a0-4a41-bfe4-faf061d1526a admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:31.146027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad692b70-e5a0-4a41-bfe4-faf061d1526a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:31.148203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad692b70-e5a0-4a41-bfe4-faf061d1526a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:31.198260 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c4ed7-607c-4c42-b916-04d74a779df1 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:31.201474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1029/2090] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:30 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:31.216688 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c4ed7-607c-4c42-b916-04d74a779df1 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:31.382287 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125129b-283b-420b-ad49-bbceb7afce5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:31.382812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125129b-283b-420b-ad49-bbceb7afce5b admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:31.383094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125129b-283b-420b-ad49-bbceb7afce5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:31.383363 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125129b-283b-420b-ad49-bbceb7afce5b admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:31.384009 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125129b-283b-420b-ad49-bbceb7afce5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:31.387272 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125129b-283b-420b-ad49-bbceb7afce5b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:31.449823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad692b70-e5a0-4a41-bfe4-faf061d1526a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:31.465127 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1062/2091] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:31 2022] POST /identity/v3/users => generated 295 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:31.468928 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad692b70-e5a0-4a41-bfe4-faf061d1526a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:31.480069 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81f2c9-c872-4314-b952-a667f76f5c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:31.481312 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81f2c9-c872-4314-b952-a667f76f5c48 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:31.491509 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81f2c9-c872-4314-b952-a667f76f5c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:31.491963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81f2c9-c872-4314-b952-a667f76f5c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:31.502487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81f2c9-c872-4314-b952-a667f76f5c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:31.505227 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81f2c9-c872-4314-b952-a667f76f5c48 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:31.526180 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125129b-283b-420b-ad49-bbceb7afce5b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:31.541276 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1030/2092] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:31.551240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125129b-283b-420b-ad49-bbceb7afce5b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:31.575064 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4d6ec-2210-438a-ba6c-692b0ec5310e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:31.575754 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4d6ec-2210-438a-ba6c-692b0ec5310e admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:31.576037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4d6ec-2210-438a-ba6c-692b0ec5310e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:31.576315 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4d6ec-2210-438a-ba6c-692b0ec5310e admin admin] PATH_INFO: `/v3/projects/9037e8db5904485b86118786da90d9da/users/bd8a68bf20ba4943bcdd05348ce30f7c/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:31.626566 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4d6ec-2210-438a-ba6c-692b0ec5310e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9037e8db5904485b86118786da90d9da, user_id=bd8a68bf20ba4943bcdd05348ce30f7c, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:31.634492 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4d6ec-2210-438a-ba6c-692b0ec5310e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:31.671929 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1063/2093] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:31 2022] PUT /identity/v3/projects/9037e8db5904485b86118786da90d9da/users/bd8a68bf20ba4943bcdd05348ce30f7c/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:31.676427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81f2c9-c872-4314-b952-a667f76f5c48 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:31.690764 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81f2c9-c872-4314-b952-a667f76f5c48 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:31.797979 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4d6ec-2210-438a-ba6c-692b0ec5310e admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:31.800449 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-25f4d6ec-2210-438a-ba6c-692b0ec5310e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:31.846636 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2339d0d-10cd-4ae0-ae7f-fce4ad6a9940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:31.847621 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2339d0d-10cd-4ae0-ae7f-fce4ad6a9940 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:31.848168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2339d0d-10cd-4ae0-ae7f-fce4ad6a9940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:31.849119 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2339d0d-10cd-4ae0-ae7f-fce4ad6a9940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:31.850524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2339d0d-10cd-4ae0-ae7f-fce4ad6a9940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:31.853845 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2339d0d-10cd-4ae0-ae7f-fce4ad6a9940 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:31.874152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1031/2094] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:31.878526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2339d0d-10cd-4ae0-ae7f-fce4ad6a9940 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:31.897555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2339d0d-10cd-4ae0-ae7f-fce4ad6a9940 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:31.907195 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ef15d-990b-42e4-8b63-a7b13567979f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:31.908115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ef15d-990b-42e4-8b63-a7b13567979f admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:31.908491 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ef15d-990b-42e4-8b63-a7b13567979f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:31.908945 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ef15d-990b-42e4-8b63-a7b13567979f admin admin] PATH_INFO: `/v3/projects/9037e8db5904485b86118786da90d9da/users/bd8a68bf20ba4943bcdd05348ce30f7c/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:31.912304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ef15d-990b-42e4-8b63-a7b13567979f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9037e8db5904485b86118786da90d9da, user_id=bd8a68bf20ba4943bcdd05348ce30f7c, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:31.917325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ef15d-990b-42e4-8b63-a7b13567979f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:31.921895 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4d6ec-2210-438a-ba6c-692b0ec5310e admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:31.930101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df2dfa-89bd-48b7-9793-f86825260a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:31.931162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df2dfa-89bd-48b7-9793-f86825260a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:31.931678 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df2dfa-89bd-48b7-9793-f86825260a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:31.932145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df2dfa-89bd-48b7-9793-f86825260a2f admin admin] PATH_INFO: `/v3/users/28292adf9143421a8735ff017f3a440e` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:31.933711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df2dfa-89bd-48b7-9793-f86825260a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=28292adf9143421a8735ff017f3a440e)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:31.935961 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df2dfa-89bd-48b7-9793-f86825260a2f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:31.957331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1032/2095] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:31 2022] PUT /identity/v3/projects/9037e8db5904485b86118786da90d9da/users/bd8a68bf20ba4943bcdd05348ce30f7c/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:31.959739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29ba91-5496-44d5-a1cc-8bd24756da77 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:31.960405 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29ba91-5496-44d5-a1cc-8bd24756da77 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:31.961526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29ba91-5496-44d5-a1cc-8bd24756da77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:32.026480 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-eb29ba91-5496-44d5-a1cc-8bd24756da77 None None] MFA Rules not processed for user `bd8a68bf20ba4943bcdd05348ce30f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:32.029885 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-eb29ba91-5496-44d5-a1cc-8bd24756da77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:32.030946 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:32.047236 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e0df2dfa-89bd-48b7-9793-f86825260a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28292adf9143421a8735ff017f3a440e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:32.060282 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e0df2dfa-89bd-48b7-9793-f86825260a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28292adf9143421a8735ff017f3a440e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:32.062253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e0df2dfa-89bd-48b7-9793-f86825260a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28292adf9143421a8735ff017f3a440e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:32.063851 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e0df2dfa-89bd-48b7-9793-f86825260a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28292adf9143421a8735ff017f3a440e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:32.082149 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e0df2dfa-89bd-48b7-9793-f86825260a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28292adf9143421a8735ff017f3a440e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:32.122949 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:32.124578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1064/2096] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:31 2022] DELETE /identity/v3/users/28292adf9143421a8735ff017f3a440e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:32.131468 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcb075-ccb0-4b16-8f1e-380678f2089a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:32.133668 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcb075-ccb0-4b16-8f1e-380678f2089a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:32.134773 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcb075-ccb0-4b16-8f1e-380678f2089a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:32.170573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-16bcb075-ccb0-4b16-8f1e-380678f2089a None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:32.174096 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-16bcb075-ccb0-4b16-8f1e-380678f2089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:32.180182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1033/2097] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:45:32.196647 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29ba91-5496-44d5-a1cc-8bd24756da77 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:32.198235 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-eb29ba91-5496-44d5-a1cc-8bd24756da77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:32.307662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29ba91-5496-44d5-a1cc-8bd24756da77 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:32.325118 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1065/2098] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:32.334800 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcb075-ccb0-4b16-8f1e-380678f2089a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:32.336645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-16bcb075-ccb0-4b16-8f1e-380678f2089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:32.394557 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ba17d-c0da-4268-bb8b-e45cb70c4c5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:32.396241 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ba17d-c0da-4268-bb8b-e45cb70c4c5e service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:32.396600 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ba17d-c0da-4268-bb8b-e45cb70c4c5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:32.396956 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ba17d-c0da-4268-bb8b-e45cb70c4c5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:32.420487 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcb075-ccb0-4b16-8f1e-380678f2089a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:32.425276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3f8f5-4260-4751-b4b1-aac8990ad51a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:32.426348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3f8f5-4260-4751-b4b1-aac8990ad51a service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:32.427007 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3f8f5-4260-4751-b4b1-aac8990ad51a service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:32.427514 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3f8f5-4260-4751-b4b1-aac8990ad51a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:32.447812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3f8f5-4260-4751-b4b1-aac8990ad51a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:32.449459 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3f8f5-4260-4751-b4b1-aac8990ad51a service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:32.503432 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1066/2099] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:45:32.507473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ba17d-c0da-4268-bb8b-e45cb70c4c5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:32.510829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ba17d-c0da-4268-bb8b-e45cb70c4c5e service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:32.536503 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1034/2100] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:32.599827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3f8f5-4260-4751-b4b1-aac8990ad51a service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:32.601811 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d0b3f8f5-4260-4751-b4b1-aac8990ad51a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:32.625706 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3f8f5-4260-4751-b4b1-aac8990ad51a service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:32.634062 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770aac5-52b3-4488-af98-0559001ed304 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:32.634675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770aac5-52b3-4488-af98-0559001ed304 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:32.634956 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770aac5-52b3-4488-af98-0559001ed304 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:32.635624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770aac5-52b3-4488-af98-0559001ed304 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:32.646508 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5770aac5-52b3-4488-af98-0559001ed304 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:32.713434 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ba17d-c0da-4268-bb8b-e45cb70c4c5e service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:32.717546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ee3ba17d-c0da-4268-bb8b-e45cb70c4c5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:32.752017 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ba17d-c0da-4268-bb8b-e45cb70c4c5e service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:32.769791 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbd3a5-1452-4049-b174-1b31cc3bbd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:32.770543 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbd3a5-1452-4049-b174-1b31cc3bbd13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:32.770917 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbd3a5-1452-4049-b174-1b31cc3bbd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:32.771289 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbd3a5-1452-4049-b174-1b31cc3bbd13 admin admin] PATH_INFO: `/v3/users/7388e62d6dd34b428c33c29639c0a997` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:32.776161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbd3a5-1452-4049-b174-1b31cc3bbd13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7388e62d6dd34b428c33c29639c0a997)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:32.782829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770aac5-52b3-4488-af98-0559001ed304 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:32.790876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770aac5-52b3-4488-af98-0559001ed304 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:32.796833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbd3a5-1452-4049-b174-1b31cc3bbd13 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:32.802256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:32.816168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1067/2101] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:32.941001 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:32.949660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d7bbd3a5-1452-4049-b174-1b31cc3bbd13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7388e62d6dd34b428c33c29639c0a997'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:32.980984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d7bbd3a5-1452-4049-b174-1b31cc3bbd13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7388e62d6dd34b428c33c29639c0a997'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:32.983678 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d7bbd3a5-1452-4049-b174-1b31cc3bbd13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7388e62d6dd34b428c33c29639c0a997'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:32.984458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d7bbd3a5-1452-4049-b174-1b31cc3bbd13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7388e62d6dd34b428c33c29639c0a997'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:33.021303 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d7bbd3a5-1452-4049-b174-1b31cc3bbd13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7388e62d6dd34b428c33c29639c0a997'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:33.075950 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1035/2102] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:32 2022] DELETE /identity/v3/users/7388e62d6dd34b428c33c29639c0a997 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:33.080573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b495f0-12d1-4375-9011-6af6e13a25e9 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:33.081051 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b495f0-12d1-4375-9011-6af6e13a25e9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:33.081498 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b495f0-12d1-4375-9011-6af6e13a25e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:33.120312 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-54b495f0-12d1-4375-9011-6af6e13a25e9 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:33.130412 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-54b495f0-12d1-4375-9011-6af6e13a25e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:33.242144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbd3a5-1452-4049-b174-1b31cc3bbd13 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:33.244336 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d7bbd3a5-1452-4049-b174-1b31cc3bbd13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:33.280263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1068/2103] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:33.306567 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b495f0-12d1-4375-9011-6af6e13a25e9 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:33.308576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-54b495f0-12d1-4375-9011-6af6e13a25e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:33.412585 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbd3a5-1452-4049-b174-1b31cc3bbd13 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:33.432418 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b495f0-12d1-4375-9011-6af6e13a25e9 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:33.432991 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffb8ad-4006-4047-996d-451a5ef60702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:33.435341 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffb8ad-4006-4047-996d-451a5ef60702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:33.436525 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffb8ad-4006-4047-996d-451a5ef60702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:33.436651 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffb8ad-4006-4047-996d-451a5ef60702 admin admin] PATH_INFO: `/v3/users/c5308581b7414b4080670fce2e46b3d4` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:33.444617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffb8ad-4006-4047-996d-451a5ef60702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5308581b7414b4080670fce2e46b3d4)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:33.444617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffb8ad-4006-4047-996d-451a5ef60702 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:33.456294 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef086c-8f80-491f-ab6c-de3a005c23a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:33.456952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef086c-8f80-491f-ab6c-de3a005c23a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:33.457335 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef086c-8f80-491f-ab6c-de3a005c23a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:33.457618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef086c-8f80-491f-ab6c-de3a005c23a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:33.472176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef086c-8f80-491f-ab6c-de3a005c23a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:33.474860 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef086c-8f80-491f-ab6c-de3a005c23a6 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:33.486563 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1069/2104] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:45:33.565556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-98ffb8ad-4006-4047-996d-451a5ef60702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5308581b7414b4080670fce2e46b3d4'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:33.580382 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-98ffb8ad-4006-4047-996d-451a5ef60702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5308581b7414b4080670fce2e46b3d4'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:33.581276 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-98ffb8ad-4006-4047-996d-451a5ef60702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5308581b7414b4080670fce2e46b3d4'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:33.582334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-98ffb8ad-4006-4047-996d-451a5ef60702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5308581b7414b4080670fce2e46b3d4'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:33.593796 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-98ffb8ad-4006-4047-996d-451a5ef60702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5308581b7414b4080670fce2e46b3d4'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:33.624493 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1036/2105] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:33 2022] DELETE /identity/v3/users/c5308581b7414b4080670fce2e46b3d4 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:33.625943 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc262b-ff5a-445b-8f4e-5155c223c0d2 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:33.626566 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc262b-ff5a-445b-8f4e-5155c223c0d2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:33.626748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc262b-ff5a-445b-8f4e-5155c223c0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:33.679026 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-29cc262b-ff5a-445b-8f4e-5155c223c0d2 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:33.680908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-29cc262b-ff5a-445b-8f4e-5155c223c0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:33.839994 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1070/2106] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:45:33.882684 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffb8ad-4006-4047-996d-451a5ef60702 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:33.884386 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-98ffb8ad-4006-4047-996d-451a5ef60702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:33.936795 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc262b-ff5a-445b-8f4e-5155c223c0d2 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:33.938901 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-29cc262b-ff5a-445b-8f4e-5155c223c0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:33.958202 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc262b-ff5a-445b-8f4e-5155c223c0d2 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:33.975165 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3053472-1d72-454c-8bd3-96725893aa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:33.975911 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3053472-1d72-454c-8bd3-96725893aa12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:33.981007 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3053472-1d72-454c-8bd3-96725893aa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:33.981234 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3053472-1d72-454c-8bd3-96725893aa12 admin admin] PATH_INFO: `/v3/users/d069087a7b7a43f2b62e7fa414fd471c` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:33.984618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3053472-1d72-454c-8bd3-96725893aa12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d069087a7b7a43f2b62e7fa414fd471c)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:33.988490 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:33.989354 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3053472-1d72-454c-8bd3-96725893aa12 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:34.023913 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffb8ad-4006-4047-996d-451a5ef60702 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:34.034140 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc4eb6-a382-4596-a417-059afb04da2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:34.034771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc4eb6-a382-4596-a417-059afb04da2c service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:34.035053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc4eb6-a382-4596-a417-059afb04da2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:34.035330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc4eb6-a382-4596-a417-059afb04da2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:34.054822 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc4eb6-a382-4596-a417-059afb04da2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:34.056404 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc4eb6-a382-4596-a417-059afb04da2c service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:34.072057 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:34.076446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1037/2107] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:34.091039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a3053472-1d72-454c-8bd3-96725893aa12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd069087a7b7a43f2b62e7fa414fd471c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:34.109186 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a3053472-1d72-454c-8bd3-96725893aa12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd069087a7b7a43f2b62e7fa414fd471c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:34.109890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a3053472-1d72-454c-8bd3-96725893aa12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd069087a7b7a43f2b62e7fa414fd471c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:34.111398 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a3053472-1d72-454c-8bd3-96725893aa12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd069087a7b7a43f2b62e7fa414fd471c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:34.123426 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a3053472-1d72-454c-8bd3-96725893aa12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd069087a7b7a43f2b62e7fa414fd471c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:34.153468 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1071/2108] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:33 2022] DELETE /identity/v3/users/d069087a7b7a43f2b62e7fa414fd471c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:34.155278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b8353-d26a-465d-b7ba-89a2c539c7ec None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:34.155565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b8353-d26a-465d-b7ba-89a2c539c7ec None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:34.155843 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b8353-d26a-465d-b7ba-89a2c539c7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:34.212849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b34b8353-d26a-465d-b7ba-89a2c539c7ec None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:34.217568 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b34b8353-d26a-465d-b7ba-89a2c539c7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:34.412749 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1038/2109] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:34.449319 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3053472-1d72-454c-8bd3-96725893aa12 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:34.451857 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a3053472-1d72-454c-8bd3-96725893aa12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:34.577072 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3053472-1d72-454c-8bd3-96725893aa12 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:34.580893 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9d06f-b451-4540-8242-c269ce1d6746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:34.581567 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9d06f-b451-4540-8242-c269ce1d6746 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:34.581852 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9d06f-b451-4540-8242-c269ce1d6746 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:34.582128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9d06f-b451-4540-8242-c269ce1d6746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:34.598035 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9d06f-b451-4540-8242-c269ce1d6746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:34.599104 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b8353-d26a-465d-b7ba-89a2c539c7ec None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:34.600555 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b34b8353-d26a-465d-b7ba-89a2c539c7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:34.611362 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9d06f-b451-4540-8242-c269ce1d6746 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:34.618366 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b8353-d26a-465d-b7ba-89a2c539c7ec None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:34.638747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830c41f-5141-47dd-8412-d603cd33fc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:34.639410 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830c41f-5141-47dd-8412-d603cd33fc8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:34.639698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830c41f-5141-47dd-8412-d603cd33fc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:34.639958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830c41f-5141-47dd-8412-d603cd33fc8a admin admin] PATH_INFO: `/v3/projects/a0c3d3f2733e446383a50a5984c52888` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:34.647037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830c41f-5141-47dd-8412-d603cd33fc8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0c3d3f2733e446383a50a5984c52888)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:34.651304 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1072/2110] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:34.653503 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830c41f-5141-47dd-8412-d603cd33fc8a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:34.779859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e830c41f-5141-47dd-8412-d603cd33fc8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0c3d3f2733e446383a50a5984c52888', 'request_id': 'req-e830c41f-5141-47dd-8412-d603cd33fc8a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:34.804487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e830c41f-5141-47dd-8412-d603cd33fc8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0c3d3f2733e446383a50a5984c52888', 'request_id': 'req-e830c41f-5141-47dd-8412-d603cd33fc8a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:34.821796 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e830c41f-5141-47dd-8412-d603cd33fc8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0c3d3f2733e446383a50a5984c52888', 'request_id': 'req-e830c41f-5141-47dd-8412-d603cd33fc8a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:34.861946 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e830c41f-5141-47dd-8412-d603cd33fc8a admin admin] The token cache is being invalidate because project a0c3d3f2733e446383a50a5984c52888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:34.862440 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e830c41f-5141-47dd-8412-d603cd33fc8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:34.863637 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e830c41f-5141-47dd-8412-d603cd33fc8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:34.865824 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1039/2111] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:34 2022] DELETE /identity/v3/projects/a0c3d3f2733e446383a50a5984c52888 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:45:34.870817 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9d06f-b451-4540-8242-c269ce1d6746 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:34.896836 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9d06f-b451-4540-8242-c269ce1d6746 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:34.917074 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830c41f-5141-47dd-8412-d603cd33fc8a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:34.918874 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e830c41f-5141-47dd-8412-d603cd33fc8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:35.063190 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a3c8c-c1a7-4d79-a7ff-4a57461f55ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:35.063835 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a3c8c-c1a7-4d79-a7ff-4a57461f55ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:35.064118 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a3c8c-c1a7-4d79-a7ff-4a57461f55ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:35.064389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a3c8c-c1a7-4d79-a7ff-4a57461f55ab admin admin] PATH_INFO: `/v3/users/aae369f2c8de4ef391347ea3eeacf606` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:35.070887 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a3c8c-c1a7-4d79-a7ff-4a57461f55ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=aae369f2c8de4ef391347ea3eeacf606)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:35.070887 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a3c8c-c1a7-4d79-a7ff-4a57461f55ab admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:35.071827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830c41f-5141-47dd-8412-d603cd33fc8a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:35.078158 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02463864-4980-442c-81bf-658ad113a21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:35.078979 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02463864-4980-442c-81bf-658ad113a21e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:35.079229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02463864-4980-442c-81bf-658ad113a21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:35.079603 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02463864-4980-442c-81bf-658ad113a21e admin admin] PATH_INFO: `/v3/projects/13e2f06e301d4741968472015aae6bd4` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:35.080812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02463864-4980-442c-81bf-658ad113a21e admin admin] RBAC: Authorizing `identity:delete_project(project_id=13e2f06e301d4741968472015aae6bd4)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:35.083529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02463864-4980-442c-81bf-658ad113a21e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:35.097950 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:35.173565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-663a3c8c-c1a7-4d79-a7ff-4a57461f55ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aae369f2c8de4ef391347ea3eeacf606'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:35.179768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-02463864-4980-442c-81bf-658ad113a21e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e2f06e301d4741968472015aae6bd4', 'request_id': 'req-02463864-4980-442c-81bf-658ad113a21e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:35.187349 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-663a3c8c-c1a7-4d79-a7ff-4a57461f55ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aae369f2c8de4ef391347ea3eeacf606'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:35.188272 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-663a3c8c-c1a7-4d79-a7ff-4a57461f55ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aae369f2c8de4ef391347ea3eeacf606'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:35.189194 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-663a3c8c-c1a7-4d79-a7ff-4a57461f55ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aae369f2c8de4ef391347ea3eeacf606'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:35.191060 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-02463864-4980-442c-81bf-658ad113a21e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e2f06e301d4741968472015aae6bd4', 'request_id': 'req-02463864-4980-442c-81bf-658ad113a21e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:35.200747 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:35.202060 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-02463864-4980-442c-81bf-658ad113a21e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e2f06e301d4741968472015aae6bd4', 'request_id': 'req-02463864-4980-442c-81bf-658ad113a21e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:35.203106 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-663a3c8c-c1a7-4d79-a7ff-4a57461f55ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aae369f2c8de4ef391347ea3eeacf606'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:35.221882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-02463864-4980-442c-81bf-658ad113a21e admin admin] The token cache is being invalidate because project 13e2f06e301d4741968472015aae6bd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:35.222217 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-02463864-4980-442c-81bf-658ad113a21e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:35.222999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-02463864-4980-442c-81bf-658ad113a21e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:35.228158 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1040/2112] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:34 2022] DELETE /identity/v3/projects/13e2f06e301d4741968472015aae6bd4 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:35.229150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02463864-4980-442c-81bf-658ad113a21e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:35.230977 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-02463864-4980-442c-81bf-658ad113a21e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:35.279087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1073/2113] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:34 2022] DELETE /identity/v3/users/aae369f2c8de4ef391347ea3eeacf606 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:45:35.282711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a3c8c-c1a7-4d79-a7ff-4a57461f55ab admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:35.286303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-663a3c8c-c1a7-4d79-a7ff-4a57461f55ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:35.332273 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02463864-4980-442c-81bf-658ad113a21e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:35.482576 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb921b1-fce5-46f1-9874-73d191c283a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:35.483221 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb921b1-fce5-46f1-9874-73d191c283a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:35.484242 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb921b1-fce5-46f1-9874-73d191c283a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:35.484522 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb921b1-fce5-46f1-9874-73d191c283a1 admin admin] PATH_INFO: `/v3/projects/86687f67e68e45c4a7b3d54fce4ca0f2` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:35.485803 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb921b1-fce5-46f1-9874-73d191c283a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86687f67e68e45c4a7b3d54fce4ca0f2)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:35.488566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb921b1-fce5-46f1-9874-73d191c283a1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:35.569804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a3c8c-c1a7-4d79-a7ff-4a57461f55ab admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:35.584563 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:35.593293 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ecb921b1-fce5-46f1-9874-73d191c283a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86687f67e68e45c4a7b3d54fce4ca0f2', 'request_id': 'req-ecb921b1-fce5-46f1-9874-73d191c283a1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:35.610333 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ecb921b1-fce5-46f1-9874-73d191c283a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86687f67e68e45c4a7b3d54fce4ca0f2', 'request_id': 'req-ecb921b1-fce5-46f1-9874-73d191c283a1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:35.619978 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ecb921b1-fce5-46f1-9874-73d191c283a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86687f67e68e45c4a7b3d54fce4ca0f2', 'request_id': 'req-ecb921b1-fce5-46f1-9874-73d191c283a1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:35.642411 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ecb921b1-fce5-46f1-9874-73d191c283a1 admin admin] The token cache is being invalidate because project 86687f67e68e45c4a7b3d54fce4ca0f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:35.643529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ecb921b1-fce5-46f1-9874-73d191c283a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:35.644411 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-ecb921b1-fce5-46f1-9874-73d191c283a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:35.650263 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1041/2114] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:35 2022] DELETE /identity/v3/projects/86687f67e68e45c4a7b3d54fce4ca0f2 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:35.654992 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb921b1-fce5-46f1-9874-73d191c283a1 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:35.659375 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ecb921b1-fce5-46f1-9874-73d191c283a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:35.742170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427db2d5-b5a1-4291-8a8f-c64e702543c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:35.743068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427db2d5-b5a1-4291-8a8f-c64e702543c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:35.743347 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427db2d5-b5a1-4291-8a8f-c64e702543c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:35.743649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427db2d5-b5a1-4291-8a8f-c64e702543c0 admin admin] PATH_INFO: `/v3/users/8bd287c2844540db8e181ff7e3420a7a` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:35.744892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427db2d5-b5a1-4291-8a8f-c64e702543c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bd287c2844540db8e181ff7e3420a7a)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:35.750544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427db2d5-b5a1-4291-8a8f-c64e702543c0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:35.859589 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb921b1-fce5-46f1-9874-73d191c283a1 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:35.884241 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc104bc5-f48b-4a3d-adee-35aee142a951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:35.890687 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-427db2d5-b5a1-4291-8a8f-c64e702543c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bd287c2844540db8e181ff7e3420a7a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:35.897328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc104bc5-f48b-4a3d-adee-35aee142a951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:35.907515 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc104bc5-f48b-4a3d-adee-35aee142a951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:35.908054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc104bc5-f48b-4a3d-adee-35aee142a951 admin admin] PATH_INFO: `/v3/users/eaabfc9d9ea945a787c021216545bd0e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:35.909771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc104bc5-f48b-4a3d-adee-35aee142a951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaabfc9d9ea945a787c021216545bd0e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:35.911878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc104bc5-f48b-4a3d-adee-35aee142a951 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:35.918635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-427db2d5-b5a1-4291-8a8f-c64e702543c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bd287c2844540db8e181ff7e3420a7a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:35.919801 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-427db2d5-b5a1-4291-8a8f-c64e702543c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bd287c2844540db8e181ff7e3420a7a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:35.920663 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-427db2d5-b5a1-4291-8a8f-c64e702543c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bd287c2844540db8e181ff7e3420a7a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:35.928800 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-427db2d5-b5a1-4291-8a8f-c64e702543c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bd287c2844540db8e181ff7e3420a7a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:36.000198 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1074/2115] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:35 2022] DELETE /identity/v3/users/8bd287c2844540db8e181ff7e3420a7a => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:36.081881 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-dc104bc5-f48b-4a3d-adee-35aee142a951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaabfc9d9ea945a787c021216545bd0e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:36.103744 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-dc104bc5-f48b-4a3d-adee-35aee142a951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaabfc9d9ea945a787c021216545bd0e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:36.104631 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-dc104bc5-f48b-4a3d-adee-35aee142a951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaabfc9d9ea945a787c021216545bd0e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:36.105587 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-dc104bc5-f48b-4a3d-adee-35aee142a951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaabfc9d9ea945a787c021216545bd0e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:36.125720 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-dc104bc5-f48b-4a3d-adee-35aee142a951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaabfc9d9ea945a787c021216545bd0e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:36.163613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1042/2116] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:35 2022] DELETE /identity/v3/users/eaabfc9d9ea945a787c021216545bd0e => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:36.692237 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427db2d5-b5a1-4291-8a8f-c64e702543c0 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:36.693788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-427db2d5-b5a1-4291-8a8f-c64e702543c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:36.701644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:36.831903 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427db2d5-b5a1-4291-8a8f-c64e702543c0 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:36.845849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c578f-6f65-4290-8c70-bb902ff8ff27 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:36.846888 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c578f-6f65-4290-8c70-bb902ff8ff27 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:36.847368 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c578f-6f65-4290-8c70-bb902ff8ff27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:36.940169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f12c578f-6f65-4290-8c70-bb902ff8ff27 None None] MFA Rules not processed for user `febd0a0016fc46888437ac2f5002e879`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:36.941463 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f12c578f-6f65-4290-8c70-bb902ff8ff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:37.001696 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180453ac-3066-4841-a9de-49e097671318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:37.002369 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180453ac-3066-4841-a9de-49e097671318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:37.002651 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180453ac-3066-4841-a9de-49e097671318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:37.003146 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180453ac-3066-4841-a9de-49e097671318 admin admin] PATH_INFO: `/v3/projects/d44ea7d6af8946aab81efc3b50d663d1` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:37.004712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180453ac-3066-4841-a9de-49e097671318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d44ea7d6af8946aab81efc3b50d663d1)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:37.006601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180453ac-3066-4841-a9de-49e097671318 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:37.046919 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:37.155238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1043/2117] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:37.158283 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-180453ac-3066-4841-a9de-49e097671318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd44ea7d6af8946aab81efc3b50d663d1', 'request_id': 'req-180453ac-3066-4841-a9de-49e097671318'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.159293 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c578f-6f65-4290-8c70-bb902ff8ff27 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:37.164950 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f12c578f-6f65-4290-8c70-bb902ff8ff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:37.198075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-180453ac-3066-4841-a9de-49e097671318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd44ea7d6af8946aab81efc3b50d663d1', 'request_id': 'req-180453ac-3066-4841-a9de-49e097671318'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.217734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-180453ac-3066-4841-a9de-49e097671318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd44ea7d6af8946aab81efc3b50d663d1', 'request_id': 'req-180453ac-3066-4841-a9de-49e097671318'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.225155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c578f-6f65-4290-8c70-bb902ff8ff27 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:37.253465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-180453ac-3066-4841-a9de-49e097671318 admin admin] The token cache is being invalidate because project d44ea7d6af8946aab81efc3b50d663d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:37.253825 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-180453ac-3066-4841-a9de-49e097671318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.257545 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-180453ac-3066-4841-a9de-49e097671318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.262745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1075/2118] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:36 2022] DELETE /identity/v3/projects/d44ea7d6af8946aab81efc3b50d663d1 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:37.267061 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180453ac-3066-4841-a9de-49e097671318 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:37.268480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-180453ac-3066-4841-a9de-49e097671318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:37.360136 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:37.394860 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63527531-5d00-4320-a40a-b663df7d5941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:37.395601 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63527531-5d00-4320-a40a-b663df7d5941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:37.395976 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63527531-5d00-4320-a40a-b663df7d5941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:37.396339 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63527531-5d00-4320-a40a-b663df7d5941 admin admin] PATH_INFO: `/v3/users/3931011ae4c845d38e95bf2eebcca45b` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:37.398733 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63527531-5d00-4320-a40a-b663df7d5941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3931011ae4c845d38e95bf2eebcca45b)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:37.405540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180453ac-3066-4841-a9de-49e097671318 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:37.405954 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63527531-5d00-4320-a40a-b663df7d5941 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:37.410983 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9512f-136f-4188-8369-844414bdf503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:37.411938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9512f-136f-4188-8369-844414bdf503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:37.412373 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9512f-136f-4188-8369-844414bdf503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:37.414079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9512f-136f-4188-8369-844414bdf503 admin admin] PATH_INFO: `/v3/projects/5284271477794d858c691a677b25fcd7` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:37.415403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9512f-136f-4188-8369-844414bdf503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5284271477794d858c691a677b25fcd7)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:37.417616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9512f-136f-4188-8369-844414bdf503 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:37.464899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-63527531-5d00-4320-a40a-b663df7d5941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3931011ae4c845d38e95bf2eebcca45b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.475396 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-63527531-5d00-4320-a40a-b663df7d5941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3931011ae4c845d38e95bf2eebcca45b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.479596 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-63527531-5d00-4320-a40a-b663df7d5941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3931011ae4c845d38e95bf2eebcca45b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.479596 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-63527531-5d00-4320-a40a-b663df7d5941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3931011ae4c845d38e95bf2eebcca45b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.490667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-63527531-5d00-4320-a40a-b663df7d5941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3931011ae4c845d38e95bf2eebcca45b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.494770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5cb9512f-136f-4188-8369-844414bdf503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5284271477794d858c691a677b25fcd7', 'request_id': 'req-5cb9512f-136f-4188-8369-844414bdf503'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.503592 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5cb9512f-136f-4188-8369-844414bdf503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5284271477794d858c691a677b25fcd7', 'request_id': 'req-5cb9512f-136f-4188-8369-844414bdf503'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.513261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5cb9512f-136f-4188-8369-844414bdf503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5284271477794d858c691a677b25fcd7', 'request_id': 'req-5cb9512f-136f-4188-8369-844414bdf503'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.517165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1044/2119] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:37 2022] DELETE /identity/v3/users/3931011ae4c845d38e95bf2eebcca45b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:37.518562 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63527531-5d00-4320-a40a-b663df7d5941 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:37.520073 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-63527531-5d00-4320-a40a-b663df7d5941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:37.535124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5cb9512f-136f-4188-8369-844414bdf503 admin admin] The token cache is being invalidate because project 5284271477794d858c691a677b25fcd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:37.535886 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5cb9512f-136f-4188-8369-844414bdf503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.536835 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5cb9512f-136f-4188-8369-844414bdf503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.541972 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1076/2120] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:37 2022] DELETE /identity/v3/projects/5284271477794d858c691a677b25fcd7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:37.545593 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9512f-136f-4188-8369-844414bdf503 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:37.550128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5cb9512f-136f-4188-8369-844414bdf503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:37.608991 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:37.632001 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9512f-136f-4188-8369-844414bdf503 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:37.634378 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63527531-5d00-4320-a40a-b663df7d5941 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:37.639983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f607fa-3ee0-4b4a-8d87-003dea8abf7b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12ce70a7c4f4396ab3fbb635dfc548b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:37.640600 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f607fa-3ee0-4b4a-8d87-003dea8abf7b service glance] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:37.640877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f607fa-3ee0-4b4a-8d87-003dea8abf7b service glance] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:37.641173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f607fa-3ee0-4b4a-8d87-003dea8abf7b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:37.643739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-24f607fa-3ee0-4b4a-8d87-003dea8abf7b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:37.719476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6832635-5afe-4b49-bd13-615835d1b10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:37.720132 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6832635-5afe-4b49-bd13-615835d1b10e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:37.720420 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6832635-5afe-4b49-bd13-615835d1b10e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:37.720703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6832635-5afe-4b49-bd13-615835d1b10e admin admin] PATH_INFO: `/v3/projects/b785f30f650440fb8072e1fb9e5d1c25` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:37.722490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6832635-5afe-4b49-bd13-615835d1b10e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b785f30f650440fb8072e1fb9e5d1c25)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:37.725548 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6832635-5afe-4b49-bd13-615835d1b10e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:37.729531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f607fa-3ee0-4b4a-8d87-003dea8abf7b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:37.731240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f607fa-3ee0-4b4a-8d87-003dea8abf7b service glance] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:37.742219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1045/2121] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:37.743057 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f607fa-3ee0-4b4a-8d87-003dea8abf7b service glance] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:37.744346 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-24f607fa-3ee0-4b4a-8d87-003dea8abf7b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:37.766074 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f607fa-3ee0-4b4a-8d87-003dea8abf7b service glance] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:37.777343 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d11e7-bf01-4958-911e-e8d0750e9e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:37.777984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d11e7-bf01-4958-911e-e8d0750e9e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:37.778668 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d11e7-bf01-4958-911e-e8d0750e9e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:37.778668 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d11e7-bf01-4958-911e-e8d0750e9e8c admin admin] PATH_INFO: `/v3/users/3ad1c1ab0b4d4ce789ed07c3748de30c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:37.780244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d11e7-bf01-4958-911e-e8d0750e9e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ad1c1ab0b4d4ce789ed07c3748de30c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:37.782213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d11e7-bf01-4958-911e-e8d0750e9e8c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:37.783291 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:37.820827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c6832635-5afe-4b49-bd13-615835d1b10e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b785f30f650440fb8072e1fb9e5d1c25', 'request_id': 'req-c6832635-5afe-4b49-bd13-615835d1b10e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.832735 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c6832635-5afe-4b49-bd13-615835d1b10e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b785f30f650440fb8072e1fb9e5d1c25', 'request_id': 'req-c6832635-5afe-4b49-bd13-615835d1b10e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.864345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c6832635-5afe-4b49-bd13-615835d1b10e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b785f30f650440fb8072e1fb9e5d1c25', 'request_id': 'req-c6832635-5afe-4b49-bd13-615835d1b10e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.879266 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c6832635-5afe-4b49-bd13-615835d1b10e admin admin] The token cache is being invalidate because project b785f30f650440fb8072e1fb9e5d1c25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:37.879673 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c6832635-5afe-4b49-bd13-615835d1b10e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.880653 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c6832635-5afe-4b49-bd13-615835d1b10e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.882273 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1077/2122] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:37 2022] DELETE /identity/v3/projects/b785f30f650440fb8072e1fb9e5d1c25 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:37.887632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6832635-5afe-4b49-bd13-615835d1b10e admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:37.889189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c6832635-5afe-4b49-bd13-615835d1b10e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:37.896297 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-370d11e7-bf01-4958-911e-e8d0750e9e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ad1c1ab0b4d4ce789ed07c3748de30c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.909647 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-370d11e7-bf01-4958-911e-e8d0750e9e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ad1c1ab0b4d4ce789ed07c3748de30c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.911081 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-370d11e7-bf01-4958-911e-e8d0750e9e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ad1c1ab0b4d4ce789ed07c3748de30c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.911864 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-370d11e7-bf01-4958-911e-e8d0750e9e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ad1c1ab0b4d4ce789ed07c3748de30c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.923064 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-370d11e7-bf01-4958-911e-e8d0750e9e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ad1c1ab0b4d4ce789ed07c3748de30c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:37.948794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1046/2123] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:37 2022] DELETE /identity/v3/users/3ad1c1ab0b4d4ce789ed07c3748de30c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:37.950370 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aafb8-ca15-4c5c-9a87-3c8acf4e56ed None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:37.950652 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aafb8-ca15-4c5c-9a87-3c8acf4e56ed None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:37.950946 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4aafb8-ca15-4c5c-9a87-3c8acf4e56ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:37.974323 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6832635-5afe-4b49-bd13-615835d1b10e admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:37.978879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5c4aafb8-ca15-4c5c-9a87-3c8acf4e56ed None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:37.980246 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5c4aafb8-ca15-4c5c-9a87-3c8acf4e56ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:38.048005 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455bc9d-9b6a-40cc-903c-de993277b27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:38.048654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455bc9d-9b6a-40cc-903c-de993277b27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:38.048973 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455bc9d-9b6a-40cc-903c-de993277b27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:38.049244 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455bc9d-9b6a-40cc-903c-de993277b27f admin admin] PATH_INFO: `/v3/projects/9fa2a10f5df2401ab444ba203d36deee` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:38.050376 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455bc9d-9b6a-40cc-903c-de993277b27f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fa2a10f5df2401ab444ba203d36deee)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:38.052621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455bc9d-9b6a-40cc-903c-de993277b27f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:38.056961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1047/2124] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:38.058352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce2e72-067f-4d52-867f-12f11cc62921 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:38.058639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce2e72-067f-4d52-867f-12f11cc62921 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:38.058910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce2e72-067f-4d52-867f-12f11cc62921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:38.080281 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:38.095157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-12ce2e72-067f-4d52-867f-12f11cc62921 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:38.096726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-12ce2e72-067f-4d52-867f-12f11cc62921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:38.113510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7455bc9d-9b6a-40cc-903c-de993277b27f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fa2a10f5df2401ab444ba203d36deee', 'request_id': 'req-7455bc9d-9b6a-40cc-903c-de993277b27f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:38.120183 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7455bc9d-9b6a-40cc-903c-de993277b27f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fa2a10f5df2401ab444ba203d36deee', 'request_id': 'req-7455bc9d-9b6a-40cc-903c-de993277b27f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:38.121885 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:38.132152 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7455bc9d-9b6a-40cc-903c-de993277b27f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fa2a10f5df2401ab444ba203d36deee', 'request_id': 'req-7455bc9d-9b6a-40cc-903c-de993277b27f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:38.153043 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7455bc9d-9b6a-40cc-903c-de993277b27f admin admin] The token cache is being invalidate because project 9fa2a10f5df2401ab444ba203d36deee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:38.153382 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7455bc9d-9b6a-40cc-903c-de993277b27f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:38.154068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7455bc9d-9b6a-40cc-903c-de993277b27f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:38.160790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1078/2125] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:37 2022] DELETE /identity/v3/projects/9fa2a10f5df2401ab444ba203d36deee => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:38.162270 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19197bfe-b348-4956-99da-953d14d71f18 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:38.162558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19197bfe-b348-4956-99da-953d14d71f18 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:38.162832 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19197bfe-b348-4956-99da-953d14d71f18 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:38.164930 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1079/2126] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 15 00:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:45:38.165545 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19197bfe-b348-4956-99da-953d14d71f18 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:38.167398 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-19197bfe-b348-4956-99da-953d14d71f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:38.200495 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1048/2127] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:38.202667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3327c25-69fc-477f-99d0-8518a39817c2 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:38.202957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3327c25-69fc-477f-99d0-8518a39817c2 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:38.203227 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3327c25-69fc-477f-99d0-8518a39817c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:38.237737 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b3327c25-69fc-477f-99d0-8518a39817c2 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:38.239302 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b3327c25-69fc-477f-99d0-8518a39817c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:38.254770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1049/2128] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:38.256119 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909710e-b3e9-4515-9586-065664e77012 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:38.256436 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909710e-b3e9-4515-9586-065664e77012 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:38.256777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909710e-b3e9-4515-9586-065664e77012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:38.263561 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19197bfe-b348-4956-99da-953d14d71f18 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:38.268839 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c28eaa-1e50-4873-83c5-11c7608d7527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:38.269663 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c28eaa-1e50-4873-83c5-11c7608d7527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:38.270014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c28eaa-1e50-4873-83c5-11c7608d7527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:38.270350 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c28eaa-1e50-4873-83c5-11c7608d7527 admin admin] PATH_INFO: `/v3/users/6c8719f0b3cc4cfeb8b2bfb8b2d34173` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:38.271652 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c28eaa-1e50-4873-83c5-11c7608d7527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8719f0b3cc4cfeb8b2bfb8b2d34173)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:38.274549 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c28eaa-1e50-4873-83c5-11c7608d7527 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:38.290207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3909710e-b3e9-4515-9586-065664e77012 None None] MFA Rules not processed for user `ed49a596f15542a29ce331bae4640274`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:38.292074 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3909710e-b3e9-4515-9586-065664e77012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:38.375116 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-63c28eaa-1e50-4873-83c5-11c7608d7527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8719f0b3cc4cfeb8b2bfb8b2d34173'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:38.385929 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-63c28eaa-1e50-4873-83c5-11c7608d7527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8719f0b3cc4cfeb8b2bfb8b2d34173'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:38.386573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-63c28eaa-1e50-4873-83c5-11c7608d7527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8719f0b3cc4cfeb8b2bfb8b2d34173'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:38.401000 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-63c28eaa-1e50-4873-83c5-11c7608d7527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8719f0b3cc4cfeb8b2bfb8b2d34173'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:38.401290 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1050/2129] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 15 00:45:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:38.402107 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909710e-b3e9-4515-9586-065664e77012 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:38.405201 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3909710e-b3e9-4515-9586-065664e77012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:38.420290 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-63c28eaa-1e50-4873-83c5-11c7608d7527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8719f0b3cc4cfeb8b2bfb8b2d34173'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:38.452956 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1080/2130] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:38 2022] DELETE /identity/v3/users/6c8719f0b3cc4cfeb8b2bfb8b2d34173 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:38.454879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b2d48-b951-490c-9c17-de8d1f1454b6 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:38.455272 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b2d48-b951-490c-9c17-de8d1f1454b6 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:38.455559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b2d48-b951-490c-9c17-de8d1f1454b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:38.480762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ee3b2d48-b951-490c-9c17-de8d1f1454b6 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:38.481658 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ee3b2d48-b951-490c-9c17-de8d1f1454b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:38.546783 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909710e-b3e9-4515-9586-065664e77012 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:38.566570 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1081/2131] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:38.568127 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d07082-e634-4ae9-9f94-2c852da8f815 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:38.568519 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d07082-e634-4ae9-9f94-2c852da8f815 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:38.568941 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d07082-e634-4ae9-9f94-2c852da8f815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:38.587102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:38.595498 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-03d07082-e634-4ae9-9f94-2c852da8f815 None None] MFA Rules not processed for user `6ed987b44d934ac7b2dc64c0aab28099`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:38.597400 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-03d07082-e634-4ae9-9f94-2c852da8f815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:38.638166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33925bf-d410-49d5-a3e6-7bcea20b1ef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:38.639122 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33925bf-d410-49d5-a3e6-7bcea20b1ef5 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:38.639625 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33925bf-d410-49d5-a3e6-7bcea20b1ef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:38.640103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33925bf-d410-49d5-a3e6-7bcea20b1ef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:38.642183 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e33925bf-d410-49d5-a3e6-7bcea20b1ef5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:38.656890 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33925bf-d410-49d5-a3e6-7bcea20b1ef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:38.658956 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33925bf-d410-49d5-a3e6-7bcea20b1ef5 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:38.672065 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1051/2132] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:38.674107 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d469cf0-4528-4e5e-ad84-687e9344522f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:38.674693 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d469cf0-4528-4e5e-ad84-687e9344522f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:38.675060 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d469cf0-4528-4e5e-ad84-687e9344522f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:38.685954 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:38.727795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3d469cf0-4528-4e5e-ad84-687e9344522f None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:38.732986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3d469cf0-4528-4e5e-ad84-687e9344522f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:38.754012 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1052/2133] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:38.755822 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1082/2134] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 15 00:45:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:38.756849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef22fc-8b84-498b-b45c-b0094f6a2ec6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:38.758176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d07082-e634-4ae9-9f94-2c852da8f815 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:38.758530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef22fc-8b84-498b-b45c-b0094f6a2ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:38.759049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef22fc-8b84-498b-b45c-b0094f6a2ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:38.761617 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-03d07082-e634-4ae9-9f94-2c852da8f815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:38.784415 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-15ef22fc-8b84-498b-b45c-b0094f6a2ec6 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:38.786001 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-15ef22fc-8b84-498b-b45c-b0094f6a2ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:38.800738 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1053/2135] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:38.802469 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef22fc-8b84-498b-b45c-b0094f6a2ec6 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:38.806026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-15ef22fc-8b84-498b-b45c-b0094f6a2ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:38.806923 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d07082-e634-4ae9-9f94-2c852da8f815 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:38.812290 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f626b-16f4-442e-84ac-d850ce8bf650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:38.812939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f626b-16f4-442e-84ac-d850ce8bf650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:38.813253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f626b-16f4-442e-84ac-d850ce8bf650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:38.813527 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f626b-16f4-442e-84ac-d850ce8bf650 admin admin] PATH_INFO: `/v3/projects/b6c9ff44302a4c46b9cc24a9013e6b68` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:38.815333 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f626b-16f4-442e-84ac-d850ce8bf650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c9ff44302a4c46b9cc24a9013e6b68)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:38.818671 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f626b-16f4-442e-84ac-d850ce8bf650 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:38.900031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3b1f626b-16f4-442e-84ac-d850ce8bf650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c9ff44302a4c46b9cc24a9013e6b68', 'request_id': 'req-3b1f626b-16f4-442e-84ac-d850ce8bf650'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:38.914595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3b1f626b-16f4-442e-84ac-d850ce8bf650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c9ff44302a4c46b9cc24a9013e6b68', 'request_id': 'req-3b1f626b-16f4-442e-84ac-d850ce8bf650'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:38.916026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef22fc-8b84-498b-b45c-b0094f6a2ec6 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:38.927968 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3b1f626b-16f4-442e-84ac-d850ce8bf650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c9ff44302a4c46b9cc24a9013e6b68', 'request_id': 'req-3b1f626b-16f4-442e-84ac-d850ce8bf650'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:38.945919 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3b1f626b-16f4-442e-84ac-d850ce8bf650 admin admin] The token cache is being invalidate because project b6c9ff44302a4c46b9cc24a9013e6b68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:38.946389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3b1f626b-16f4-442e-84ac-d850ce8bf650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:38.947253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3b1f626b-16f4-442e-84ac-d850ce8bf650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:38.949348 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1083/2136] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:38 2022] DELETE /identity/v3/projects/b6c9ff44302a4c46b9cc24a9013e6b68 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:38.951490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcd7eb-3726-40d1-ab1d-583c346ffd3b None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:38.951899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcd7eb-3726-40d1-ab1d-583c346ffd3b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:38.952179 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcd7eb-3726-40d1-ab1d-583c346ffd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:38.985994 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-93dcd7eb-3726-40d1-ab1d-583c346ffd3b None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:38.987286 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-93dcd7eb-3726-40d1-ab1d-583c346ffd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:39.031093 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465c8da-c01e-43f8-b3e0-ba09b13b233d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb248b85aba45b39132d0f92ede0b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:39.031930 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465c8da-c01e-43f8-b3e0-ba09b13b233d service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:39.032216 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465c8da-c01e-43f8-b3e0-ba09b13b233d service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:39.032484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465c8da-c01e-43f8-b3e0-ba09b13b233d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:39.034685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4465c8da-c01e-43f8-b3e0-ba09b13b233d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:39.080256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1084/2137] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:39.081726 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcd7eb-3726-40d1-ab1d-583c346ffd3b None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:39.084520 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-93dcd7eb-3726-40d1-ab1d-583c346ffd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:39.102251 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcd7eb-3726-40d1-ab1d-583c346ffd3b None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:39.108649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3dc87-81a6-4cd7-8962-1f020934a537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:39.109447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3dc87-81a6-4cd7-8962-1f020934a537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:39.109830 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3dc87-81a6-4cd7-8962-1f020934a537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:39.110204 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3dc87-81a6-4cd7-8962-1f020934a537 admin admin] PATH_INFO: `/v3/projects/87e5d4ff07144668b67506c0639887a2` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:39.111451 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3dc87-81a6-4cd7-8962-1f020934a537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87e5d4ff07144668b67506c0639887a2)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:39.113700 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3dc87-81a6-4cd7-8962-1f020934a537 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:39.117478 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465c8da-c01e-43f8-b3e0-ba09b13b233d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:39.119740 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465c8da-c01e-43f8-b3e0-ba09b13b233d service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:39.136222 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1054/2138] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 15 00:45:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 00:45:39.140239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465c8da-c01e-43f8-b3e0-ba09b13b233d service swift] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:39.142241 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4465c8da-c01e-43f8-b3e0-ba09b13b233d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:39.150811 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:39.158714 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465c8da-c01e-43f8-b3e0-ba09b13b233d service swift] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:39.165243 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1670cd-3ad4-43a8-a758-ec8be561cd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:39.166268 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1670cd-3ad4-43a8-a758-ec8be561cd78 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:39.166759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1670cd-3ad4-43a8-a758-ec8be561cd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:39.167334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1670cd-3ad4-43a8-a758-ec8be561cd78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:39.168312 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1670cd-3ad4-43a8-a758-ec8be561cd78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:45:39.168834 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1670cd-3ad4-43a8-a758-ec8be561cd78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:39.170787 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1670cd-3ad4-43a8-a758-ec8be561cd78 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:39.189293 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1055/2139] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:45:39.190525 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1670cd-3ad4-43a8-a758-ec8be561cd78 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:39.192504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6d1670cd-3ad4-43a8-a758-ec8be561cd78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:39.210667 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-38e3dc87-81a6-4cd7-8962-1f020934a537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87e5d4ff07144668b67506c0639887a2', 'request_id': 'req-38e3dc87-81a6-4cd7-8962-1f020934a537'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:39.221149 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-38e3dc87-81a6-4cd7-8962-1f020934a537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87e5d4ff07144668b67506c0639887a2', 'request_id': 'req-38e3dc87-81a6-4cd7-8962-1f020934a537'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:39.228624 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:39.242263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-38e3dc87-81a6-4cd7-8962-1f020934a537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87e5d4ff07144668b67506c0639887a2', 'request_id': 'req-38e3dc87-81a6-4cd7-8962-1f020934a537'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:39.263470 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-38e3dc87-81a6-4cd7-8962-1f020934a537 admin admin] The token cache is being invalidate because project 87e5d4ff07144668b67506c0639887a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:39.263801 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-38e3dc87-81a6-4cd7-8962-1f020934a537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:39.264789 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-38e3dc87-81a6-4cd7-8962-1f020934a537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:39.266748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1085/2140] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:39 2022] DELETE /identity/v3/projects/87e5d4ff07144668b67506c0639887a2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:39.267330 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3dc87-81a6-4cd7-8962-1f020934a537 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:39.268861 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-38e3dc87-81a6-4cd7-8962-1f020934a537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:39.352103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1670cd-3ad4-43a8-a758-ec8be561cd78 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:39.436591 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3dc87-81a6-4cd7-8962-1f020934a537 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:39.459229 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e823b0a-b57f-448c-8220-b73b2d932188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:39.459969 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e823b0a-b57f-448c-8220-b73b2d932188 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:39.461398 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e823b0a-b57f-448c-8220-b73b2d932188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:39.461816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e823b0a-b57f-448c-8220-b73b2d932188 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:39.462488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e823b0a-b57f-448c-8220-b73b2d932188 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:45:39.462884 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e823b0a-b57f-448c-8220-b73b2d932188 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:39.464617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72b106-fb27-4fb8-8f5d-6acb360d2455 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed987b44d934ac7b2dc64c0aab28099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:39.464768 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e823b0a-b57f-448c-8220-b73b2d932188 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:39.465350 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72b106-fb27-4fb8-8f5d-6acb360d2455 service placement] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:39.465719 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72b106-fb27-4fb8-8f5d-6acb360d2455 service placement] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:39.466066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72b106-fb27-4fb8-8f5d-6acb360d2455 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:39.468332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ff72b106-fb27-4fb8-8f5d-6acb360d2455 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:39.482249 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72b106-fb27-4fb8-8f5d-6acb360d2455 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:39.484264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72b106-fb27-4fb8-8f5d-6acb360d2455 service placement] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:39.490632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1086/2141] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:45:39.492492 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c05c32-4604-48b8-b864-f25c30d19e24 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:39.492783 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c05c32-4604-48b8-b864-f25c30d19e24 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:39.493054 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c05c32-4604-48b8-b864-f25c30d19e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:39.527947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1056/2142] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:39.544284 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72b106-fb27-4fb8-8f5d-6acb360d2455 service placement] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:39.552020 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ff72b106-fb27-4fb8-8f5d-6acb360d2455 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:39.572145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72b106-fb27-4fb8-8f5d-6acb360d2455 service placement] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:39.578310 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588e54e-1851-4819-a387-d1febfb3c080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:39.578934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588e54e-1851-4819-a387-d1febfb3c080 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:39.579778 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588e54e-1851-4819-a387-d1febfb3c080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:39.580056 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588e54e-1851-4819-a387-d1febfb3c080 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:39.581514 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588e54e-1851-4819-a387-d1febfb3c080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:45:39.581834 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588e54e-1851-4819-a387-d1febfb3c080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:39.585985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588e54e-1851-4819-a387-d1febfb3c080 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:39.605401 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-98c05c32-4604-48b8-b864-f25c30d19e24 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:39.607681 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-98c05c32-4604-48b8-b864-f25c30d19e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:39.614152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1057/2143] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:45:39.614152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588e54e-1851-4819-a387-d1febfb3c080 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:39.617524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3588e54e-1851-4819-a387-d1febfb3c080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:39.633109 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1087/2144] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:39.633109 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707daec-6ff9-414d-86f9-f7020af547d2 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:39.633109 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707daec-6ff9-414d-86f9-f7020af547d2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:39.633109 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707daec-6ff9-414d-86f9-f7020af547d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:39.651134 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588e54e-1851-4819-a387-d1febfb3c080 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:39.659233 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97232682-6271-420a-aa23-a268038a12a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:39.660148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97232682-6271-420a-aa23-a268038a12a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:39.661451 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97232682-6271-420a-aa23-a268038a12a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:39.661972 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97232682-6271-420a-aa23-a268038a12a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:39.662848 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97232682-6271-420a-aa23-a268038a12a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:39.665723 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97232682-6271-420a-aa23-a268038a12a8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:39.666591 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-1707daec-6ff9-414d-86f9-f7020af547d2 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:39.667808 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1707daec-6ff9-414d-86f9-f7020af547d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:39.676717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1088/2145] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:39.677695 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707daec-6ff9-414d-86f9-f7020af547d2 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:39.679615 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1707daec-6ff9-414d-86f9-f7020af547d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:39.704609 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707daec-6ff9-414d-86f9-f7020af547d2 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:39.718883 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee7488-77d3-4171-8679-3daba1e1b199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:39.719234 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee7488-77d3-4171-8679-3daba1e1b199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:39.720241 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee7488-77d3-4171-8679-3daba1e1b199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:39.720241 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee7488-77d3-4171-8679-3daba1e1b199 admin admin] PATH_INFO: `/v3/projects/014de82efca54baaa9ff95c56e22a4e9` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:39.722207 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee7488-77d3-4171-8679-3daba1e1b199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=014de82efca54baaa9ff95c56e22a4e9)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:39.723619 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee7488-77d3-4171-8679-3daba1e1b199 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:39.730025 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1058/2146] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:39 2022] POST /identity/v3/projects => generated 399 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:39.731428 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97232682-6271-420a-aa23-a268038a12a8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:39.866604 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d9ee7488-77d3-4171-8679-3daba1e1b199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '014de82efca54baaa9ff95c56e22a4e9', 'request_id': 'req-d9ee7488-77d3-4171-8679-3daba1e1b199'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:39.870235 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97232682-6271-420a-aa23-a268038a12a8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:39.885383 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d9ee7488-77d3-4171-8679-3daba1e1b199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '014de82efca54baaa9ff95c56e22a4e9', 'request_id': 'req-d9ee7488-77d3-4171-8679-3daba1e1b199'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:39.919134 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d9ee7488-77d3-4171-8679-3daba1e1b199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '014de82efca54baaa9ff95c56e22a4e9', 'request_id': 'req-d9ee7488-77d3-4171-8679-3daba1e1b199'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:39.940255 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:39.970666 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d9ee7488-77d3-4171-8679-3daba1e1b199 admin admin] The token cache is being invalidate because project 014de82efca54baaa9ff95c56e22a4e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:39.971633 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d9ee7488-77d3-4171-8679-3daba1e1b199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:39.972580 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d9ee7488-77d3-4171-8679-3daba1e1b199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:39.979968 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1089/2147] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:39 2022] DELETE /identity/v3/projects/014de82efca54baaa9ff95c56e22a4e9 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:39.981061 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee7488-77d3-4171-8679-3daba1e1b199 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:39.984232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d9ee7488-77d3-4171-8679-3daba1e1b199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:40.002374 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:40.042151 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fc570-7128-4c85-a25d-9ec5732ffd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:40.043046 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fc570-7128-4c85-a25d-9ec5732ffd8c admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:40.043395 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fc570-7128-4c85-a25d-9ec5732ffd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:40.043781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fc570-7128-4c85-a25d-9ec5732ffd8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:40.047519 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fc570-7128-4c85-a25d-9ec5732ffd8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:40.051503 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fc570-7128-4c85-a25d-9ec5732ffd8c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:40.081257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee7488-77d3-4171-8679-3daba1e1b199 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:40.090328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b4010-8893-4360-a61a-e12720e74957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:40.091692 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b4010-8893-4360-a61a-e12720e74957 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:40.092257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b4010-8893-4360-a61a-e12720e74957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:40.092872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b4010-8893-4360-a61a-e12720e74957 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:40.094323 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b4010-8893-4360-a61a-e12720e74957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:40.097418 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b4010-8893-4360-a61a-e12720e74957 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:40.118464 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1059/2148] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:39 2022] POST /identity/v3/projects => generated 377 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:40.123869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c085d-ba9c-41b1-9349-b375682cfbe6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:40.124531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c085d-ba9c-41b1-9349-b375682cfbe6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:40.124815 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c085d-ba9c-41b1-9349-b375682cfbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:40.148566 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1090/2149] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:39 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:40.150228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26d1a4-ef13-4579-b46e-a7716bdd4929 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:40.150901 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26d1a4-ef13-4579-b46e-a7716bdd4929 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:40.151404 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26d1a4-ef13-4579-b46e-a7716bdd4929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:40.169006 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-533c085d-ba9c-41b1-9349-b375682cfbe6 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:40.169941 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-533c085d-ba9c-41b1-9349-b375682cfbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:40.222294 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-6a26d1a4-ef13-4579-b46e-a7716bdd4929 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:40.223549 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6a26d1a4-ef13-4579-b46e-a7716bdd4929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:40.339910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1060/2150] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:40.340561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c085d-ba9c-41b1-9349-b375682cfbe6 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:40.344294 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-533c085d-ba9c-41b1-9349-b375682cfbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:40.374474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c085d-ba9c-41b1-9349-b375682cfbe6 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:40.387078 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805ea88-5358-4389-8290-acc50df2bd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:40.387884 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805ea88-5358-4389-8290-acc50df2bd2c admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:40.388288 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805ea88-5358-4389-8290-acc50df2bd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:40.388666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805ea88-5358-4389-8290-acc50df2bd2c admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:40.389916 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805ea88-5358-4389-8290-acc50df2bd2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:40.394844 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805ea88-5358-4389-8290-acc50df2bd2c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:40.396296 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1091/2151] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:40.397367 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26d1a4-ef13-4579-b46e-a7716bdd4929 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:40.398864 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6a26d1a4-ef13-4579-b46e-a7716bdd4929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:40.417401 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26d1a4-ef13-4579-b46e-a7716bdd4929 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:40.425509 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771fadc-4260-458c-910f-19bd91ccd2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:40.426319 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771fadc-4260-458c-910f-19bd91ccd2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:40.426600 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771fadc-4260-458c-910f-19bd91ccd2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:40.426892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771fadc-4260-458c-910f-19bd91ccd2cf admin admin] PATH_INFO: `/v3/users/6496d78669364984aa84aff578daf9c4` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:40.431427 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771fadc-4260-458c-910f-19bd91ccd2cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6496d78669364984aa84aff578daf9c4)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:40.433760 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771fadc-4260-458c-910f-19bd91ccd2cf admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:40.437955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1061/2152] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:40 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:40.440182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805ea88-5358-4389-8290-acc50df2bd2c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:40.443038 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f805ea88-5358-4389-8290-acc50df2bd2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:40.458614 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805ea88-5358-4389-8290-acc50df2bd2c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:40.469327 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d01c8c-c9cf-472f-953d-d892eca16569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:40.472243 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d01c8c-c9cf-472f-953d-d892eca16569 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:40.477563 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d01c8c-c9cf-472f-953d-d892eca16569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:40.477879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d01c8c-c9cf-472f-953d-d892eca16569 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:40.478556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d01c8c-c9cf-472f-953d-d892eca16569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:40.481283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d01c8c-c9cf-472f-953d-d892eca16569 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:40.550412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1062/2153] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:40 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:40.551486 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d01c8c-c9cf-472f-953d-d892eca16569 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:40.564345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4771fadc-4260-458c-910f-19bd91ccd2cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6496d78669364984aa84aff578daf9c4'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:40.571977 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d01c8c-c9cf-472f-953d-d892eca16569 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:40.578080 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6b680-9cf5-4ae9-9c0c-afb489bfecfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:40.578951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6b680-9cf5-4ae9-9c0c-afb489bfecfe admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:40.579495 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6b680-9cf5-4ae9-9c0c-afb489bfecfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:40.579931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6b680-9cf5-4ae9-9c0c-afb489bfecfe admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:40.581665 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6b680-9cf5-4ae9-9c0c-afb489bfecfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:40.582080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4771fadc-4260-458c-910f-19bd91ccd2cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6496d78669364984aa84aff578daf9c4'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:40.582751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4771fadc-4260-458c-910f-19bd91ccd2cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6496d78669364984aa84aff578daf9c4'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:40.583507 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4771fadc-4260-458c-910f-19bd91ccd2cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6496d78669364984aa84aff578daf9c4'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:40.584896 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6b680-9cf5-4ae9-9c0c-afb489bfecfe admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:40.595034 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4771fadc-4260-458c-910f-19bd91ccd2cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6496d78669364984aa84aff578daf9c4'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:40.639355 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1092/2154] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:40 2022] DELETE /identity/v3/users/6496d78669364984aa84aff578daf9c4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:40.643518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771fadc-4260-458c-910f-19bd91ccd2cf admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:40.648989 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4771fadc-4260-458c-910f-19bd91ccd2cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:40.671844 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1063/2155] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:40 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:40.675226 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6b680-9cf5-4ae9-9c0c-afb489bfecfe admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:40.676611 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:40.685099 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-41c6b680-9cf5-4ae9-9c0c-afb489bfecfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:40.702189 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6b680-9cf5-4ae9-9c0c-afb489bfecfe admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:40.802930 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771fadc-4260-458c-910f-19bd91ccd2cf admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:40.808862 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53332d11-375e-4a55-9d8a-d5effbd0ea5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:40.809667 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53332d11-375e-4a55-9d8a-d5effbd0ea5a admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:40.809948 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53332d11-375e-4a55-9d8a-d5effbd0ea5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:40.810281 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53332d11-375e-4a55-9d8a-d5effbd0ea5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:40.810934 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53332d11-375e-4a55-9d8a-d5effbd0ea5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:45:40.811297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53332d11-375e-4a55-9d8a-d5effbd0ea5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:40.813137 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53332d11-375e-4a55-9d8a-d5effbd0ea5a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:40.821315 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:40.841380 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44eec4-92fa-482c-ac25-5673125bebb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:40.842822 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44eec4-92fa-482c-ac25-5673125bebb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:40.848937 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44eec4-92fa-482c-ac25-5673125bebb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:40.850196 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44eec4-92fa-482c-ac25-5673125bebb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:40.856286 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44eec4-92fa-482c-ac25-5673125bebb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:45:40.857668 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44eec4-92fa-482c-ac25-5673125bebb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:40.861813 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1093/2156] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:45:40.864145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44eec4-92fa-482c-ac25-5673125bebb3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:40.864936 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53332d11-375e-4a55-9d8a-d5effbd0ea5a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:40.868719 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-53332d11-375e-4a55-9d8a-d5effbd0ea5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:40.901974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1064/2157] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:45:40.903874 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44eec4-92fa-482c-ac25-5673125bebb3 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:40.906431 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ee44eec4-92fa-482c-ac25-5673125bebb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:40.918344 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53332d11-375e-4a55-9d8a-d5effbd0ea5a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:40.938127 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8879b9-f884-4807-9ce6-10893bce345b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:40.939105 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8879b9-f884-4807-9ce6-10893bce345b admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:40.939552 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8879b9-f884-4807-9ce6-10893bce345b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:40.939972 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8879b9-f884-4807-9ce6-10893bce345b admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:40.940763 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8879b9-f884-4807-9ce6-10893bce345b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:40.942588 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8879b9-f884-4807-9ce6-10893bce345b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:40.958376 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44eec4-92fa-482c-ac25-5673125bebb3 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:40.965647 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacf114-2dd8-4c17-bf9c-a69f31e7b9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:40.966397 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacf114-2dd8-4c17-bf9c-a69f31e7b9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:40.966780 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacf114-2dd8-4c17-bf9c-a69f31e7b9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:40.967212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacf114-2dd8-4c17-bf9c-a69f31e7b9c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:40.968115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacf114-2dd8-4c17-bf9c-a69f31e7b9c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:40.969880 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacf114-2dd8-4c17-bf9c-a69f31e7b9c4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:40.980526 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1094/2158] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:40.984415 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8879b9-f884-4807-9ce6-10893bce345b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:40.987535 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1065/2159] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:40.989228 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacf114-2dd8-4c17-bf9c-a69f31e7b9c4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:40.993544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1b8879b9-f884-4807-9ce6-10893bce345b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:41.002709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacf114-2dd8-4c17-bf9c-a69f31e7b9c4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:41.009200 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1bed4-9ce7-4041-8f8b-d41ad8f3a54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:41.010158 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1bed4-9ce7-4041-8f8b-d41ad8f3a54a admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:41.010659 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1bed4-9ce7-4041-8f8b-d41ad8f3a54a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:41.013077 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1bed4-9ce7-4041-8f8b-d41ad8f3a54a admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:41.013077 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1bed4-9ce7-4041-8f8b-d41ad8f3a54a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:41.014099 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1bed4-9ce7-4041-8f8b-d41ad8f3a54a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:41.026928 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8879b9-f884-4807-9ce6-10893bce345b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:41.033027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca7420-8f1c-4932-ab00-95dfa9ce3a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:41.033679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca7420-8f1c-4932-ab00-95dfa9ce3a44 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:41.033979 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca7420-8f1c-4932-ab00-95dfa9ce3a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:41.034236 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca7420-8f1c-4932-ab00-95dfa9ce3a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:41.034996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca7420-8f1c-4932-ab00-95dfa9ce3a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:41.036640 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca7420-8f1c-4932-ab00-95dfa9ce3a44 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:41.052068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1095/2160] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:41.052068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca7420-8f1c-4932-ab00-95dfa9ce3a44 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:41.070306 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca7420-8f1c-4932-ab00-95dfa9ce3a44 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:41.074827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1066/2161] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:40 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:41.074827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1bed4-9ce7-4041-8f8b-d41ad8f3a54a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:41.150914 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade020c0-b74d-4670-9fa4-06adf777c666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:41.152284 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade020c0-b74d-4670-9fa4-06adf777c666 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:41.152734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade020c0-b74d-4670-9fa4-06adf777c666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:41.153212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade020c0-b74d-4670-9fa4-06adf777c666 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:41.154019 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade020c0-b74d-4670-9fa4-06adf777c666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:41.156832 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade020c0-b74d-4670-9fa4-06adf777c666 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:41.179995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1bed4-9ce7-4041-8f8b-d41ad8f3a54a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:41.189127 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88680ba2-3eb3-4d72-9343-fedb85ad1dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:41.190095 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88680ba2-3eb3-4d72-9343-fedb85ad1dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:41.190609 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88680ba2-3eb3-4d72-9343-fedb85ad1dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:41.191071 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88680ba2-3eb3-4d72-9343-fedb85ad1dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:41.192131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88680ba2-3eb3-4d72-9343-fedb85ad1dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:41.198982 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1096/2162] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:41 2022] POST /identity/v3/projects => generated 391 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:41.199623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88680ba2-3eb3-4d72-9343-fedb85ad1dd0 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:41.203367 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade020c0-b74d-4670-9fa4-06adf777c666 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:41.216765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1067/2163] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:41.216765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88680ba2-3eb3-4d72-9343-fedb85ad1dd0 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:41.228723 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88680ba2-3eb3-4d72-9343-fedb85ad1dd0 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:41.327685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595bb6d-94e3-43a6-bdd1-3365fc79f7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:41.328329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595bb6d-94e3-43a6-bdd1-3365fc79f7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:41.328623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595bb6d-94e3-43a6-bdd1-3365fc79f7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:41.330973 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595bb6d-94e3-43a6-bdd1-3365fc79f7f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:41.331659 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595bb6d-94e3-43a6-bdd1-3365fc79f7f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:41.343646 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595bb6d-94e3-43a6-bdd1-3365fc79f7f3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:41.349728 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1068/2164] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:41.350808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595bb6d-94e3-43a6-bdd1-3365fc79f7f3 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:41.364848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade020c0-b74d-4670-9fa4-06adf777c666 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:41.378320 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595bb6d-94e3-43a6-bdd1-3365fc79f7f3 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:41.382899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5161f-0d92-4b88-b2b0-b600f2cedfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:41.383697 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6491bd0-2933-48b2-8f91-dfb7abce3491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:41.383888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5161f-0d92-4b88-b2b0-b600f2cedfdc admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:41.384307 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6491bd0-2933-48b2-8f91-dfb7abce3491 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:41.384448 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5161f-0d92-4b88-b2b0-b600f2cedfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:41.384585 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6491bd0-2933-48b2-8f91-dfb7abce3491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:41.384982 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5161f-0d92-4b88-b2b0-b600f2cedfdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:41.385129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6491bd0-2933-48b2-8f91-dfb7abce3491 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:41.385690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6491bd0-2933-48b2-8f91-dfb7abce3491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:41.386391 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5161f-0d92-4b88-b2b0-b600f2cedfdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:41.387638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6491bd0-2933-48b2-8f91-dfb7abce3491 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:41.391845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5161f-0d92-4b88-b2b0-b600f2cedfdc admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:41.419183 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1097/2165] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:41.420690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5161f-0d92-4b88-b2b0-b600f2cedfdc admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:41.435880 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:41.440776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5161f-0d92-4b88-b2b0-b600f2cedfdc admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:41.454476 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511dffa-f159-4176-9e9e-519d96cf56f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:41.455354 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511dffa-f159-4176-9e9e-519d96cf56f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:41.455652 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511dffa-f159-4176-9e9e-519d96cf56f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:41.455934 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511dffa-f159-4176-9e9e-519d96cf56f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:41.456581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511dffa-f159-4176-9e9e-519d96cf56f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:41.458543 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511dffa-f159-4176-9e9e-519d96cf56f7 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:41.459570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1069/2166] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:41 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:41.463941 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6491bd0-2933-48b2-8f91-dfb7abce3491 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:41.477033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6491bd0-2933-48b2-8f91-dfb7abce3491 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:41.483518 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17acaee-4a09-448e-8e70-f97b8cc317e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:41.484660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17acaee-4a09-448e-8e70-f97b8cc317e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:41.485008 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17acaee-4a09-448e-8e70-f97b8cc317e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:41.485429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17acaee-4a09-448e-8e70-f97b8cc317e2 admin admin] PATH_INFO: `/v3/projects/17b1e6127d9d4a8da8cfb54863aca424/users/01fb0f46a96e4605aa6cb05613008d88/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:41.497678 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1098/2167] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:41 2022] POST /identity/v3/users => generated 296 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:41.499019 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511dffa-f159-4176-9e9e-519d96cf56f7 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:41.501735 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3511dffa-f159-4176-9e9e-519d96cf56f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:41.509231 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17acaee-4a09-448e-8e70-f97b8cc317e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b1e6127d9d4a8da8cfb54863aca424, user_id=01fb0f46a96e4605aa6cb05613008d88, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:41.512154 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17acaee-4a09-448e-8e70-f97b8cc317e2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:41.519908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511dffa-f159-4176-9e9e-519d96cf56f7 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:41.541959 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1070/2168] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:41 2022] PUT /identity/v3/projects/17b1e6127d9d4a8da8cfb54863aca424/users/01fb0f46a96e4605aa6cb05613008d88/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:41.543723 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17acaee-4a09-448e-8e70-f97b8cc317e2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:41.550142 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c1237-5bbe-48d1-9ac6-35e3a1837d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:41.550995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c1237-5bbe-48d1-9ac6-35e3a1837d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:41.551289 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c1237-5bbe-48d1-9ac6-35e3a1837d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:41.551676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c1237-5bbe-48d1-9ac6-35e3a1837d64 admin admin] PATH_INFO: `/v3/projects/f51b6287b4cc434785d6902bf96f47d4` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:41.554890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c1237-5bbe-48d1-9ac6-35e3a1837d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f51b6287b4cc434785d6902bf96f47d4)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:41.558976 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:41.562869 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c1237-5bbe-48d1-9ac6-35e3a1837d64 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:41.654435 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dc1c1237-5bbe-48d1-9ac6-35e3a1837d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f51b6287b4cc434785d6902bf96f47d4', 'request_id': 'req-dc1c1237-5bbe-48d1-9ac6-35e3a1837d64'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:41.663028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dc1c1237-5bbe-48d1-9ac6-35e3a1837d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f51b6287b4cc434785d6902bf96f47d4', 'request_id': 'req-dc1c1237-5bbe-48d1-9ac6-35e3a1837d64'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:41.691214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dc1c1237-5bbe-48d1-9ac6-35e3a1837d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f51b6287b4cc434785d6902bf96f47d4', 'request_id': 'req-dc1c1237-5bbe-48d1-9ac6-35e3a1837d64'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:41.701612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17acaee-4a09-448e-8e70-f97b8cc317e2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:41.718142 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dc1c1237-5bbe-48d1-9ac6-35e3a1837d64 admin admin] The token cache is being invalidate because project f51b6287b4cc434785d6902bf96f47d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:41.718433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dc1c1237-5bbe-48d1-9ac6-35e3a1837d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:41.719157 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-dc1c1237-5bbe-48d1-9ac6-35e3a1837d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:41.721486 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1099/2169] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:41 2022] DELETE /identity/v3/projects/f51b6287b4cc434785d6902bf96f47d4 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:41.723016 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c1237-5bbe-48d1-9ac6-35e3a1837d64 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:41.725952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-dc1c1237-5bbe-48d1-9ac6-35e3a1837d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:41.818252 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809b76b-efa5-4d60-ad0d-c92567c73428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:41.818777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809b76b-efa5-4d60-ad0d-c92567c73428 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:41.819137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809b76b-efa5-4d60-ad0d-c92567c73428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:41.820148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809b76b-efa5-4d60-ad0d-c92567c73428 admin admin] PATH_INFO: `/v3/projects/429f2dcaa789469cbe3c54f735c44768/users/ca9fad426ed74e369a930ba9ecfc0935/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:41.848425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809b76b-efa5-4d60-ad0d-c92567c73428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=429f2dcaa789469cbe3c54f735c44768, user_id=ca9fad426ed74e369a930ba9ecfc0935, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:41.851238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809b76b-efa5-4d60-ad0d-c92567c73428 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:41.859411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c1237-5bbe-48d1-9ac6-35e3a1837d64 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:41.867405 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f86329-42eb-4809-a812-2b2ea65a5dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:41.868101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f86329-42eb-4809-a812-2b2ea65a5dc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:41.868382 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f86329-42eb-4809-a812-2b2ea65a5dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:41.868652 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f86329-42eb-4809-a812-2b2ea65a5dc1 admin admin] PATH_INFO: `/v3/projects/2eb00e526dc14e91a2d8fbc5154f2f5b/users/ee821e6c64fe439085921660623a0752/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:41.876016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1071/2170] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:41 2022] PUT /identity/v3/projects/429f2dcaa789469cbe3c54f735c44768/users/ca9fad426ed74e369a930ba9ecfc0935/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:41.876801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809b76b-efa5-4d60-ad0d-c92567c73428 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:41.887101 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a809b76b-efa5-4d60-ad0d-c92567c73428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:41.894842 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f86329-42eb-4809-a812-2b2ea65a5dc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eb00e526dc14e91a2d8fbc5154f2f5b, user_id=ee821e6c64fe439085921660623a0752, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:41.897612 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f86329-42eb-4809-a812-2b2ea65a5dc1 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:41.939682 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1100/2171] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:41 2022] PUT /identity/v3/projects/2eb00e526dc14e91a2d8fbc5154f2f5b/users/ee821e6c64fe439085921660623a0752/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:41.940683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f86329-42eb-4809-a812-2b2ea65a5dc1 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:41.947391 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-93f86329-42eb-4809-a812-2b2ea65a5dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:42.006781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809b76b-efa5-4d60-ad0d-c92567c73428 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:42.019273 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:42.041868 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f86329-42eb-4809-a812-2b2ea65a5dc1 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:42.050519 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd6039-1344-4443-8e3a-9396c99a41ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:42.051848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd6039-1344-4443-8e3a-9396c99a41ba admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:42.052286 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd6039-1344-4443-8e3a-9396c99a41ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:42.053549 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd6039-1344-4443-8e3a-9396c99a41ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:42.055595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd6039-1344-4443-8e3a-9396c99a41ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:42.057657 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd6039-1344-4443-8e3a-9396c99a41ba admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:42.071654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1101/2172] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:42.073294 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c31db4-146d-4652-bf81-8c5fb8390752 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:42.073894 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c31db4-146d-4652-bf81-8c5fb8390752 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:42.074319 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c31db4-146d-4652-bf81-8c5fb8390752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:42.079175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:42.118926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-a6c31db4-146d-4652-bf81-8c5fb8390752 None None] MFA Rules not processed for user `01fb0f46a96e4605aa6cb05613008d88`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:42.119208 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90eaa3-8291-4e09-a948-a282c91799d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:42.119895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90eaa3-8291-4e09-a948-a282c91799d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:42.120387 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90eaa3-8291-4e09-a948-a282c91799d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:42.120724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90eaa3-8291-4e09-a948-a282c91799d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:42.121127 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a6c31db4-146d-4652-bf81-8c5fb8390752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:42.121583 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90eaa3-8291-4e09-a948-a282c91799d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:42.123951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90eaa3-8291-4e09-a948-a282c91799d9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:42.147748 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1072/2173] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:42.147748 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90eaa3-8291-4e09-a948-a282c91799d9 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:42.148071 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9d90eaa3-8291-4e09-a948-a282c91799d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:42.172562 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90eaa3-8291-4e09-a948-a282c91799d9 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:42.181765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31667e3d-2bb7-4bf1-9b99-75861828274f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:42.182746 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31667e3d-2bb7-4bf1-9b99-75861828274f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:42.183858 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31667e3d-2bb7-4bf1-9b99-75861828274f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:42.184206 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31667e3d-2bb7-4bf1-9b99-75861828274f admin admin] PATH_INFO: `/v3/users/bd8a68bf20ba4943bcdd05348ce30f7c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:42.189781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31667e3d-2bb7-4bf1-9b99-75861828274f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd8a68bf20ba4943bcdd05348ce30f7c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:42.193760 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31667e3d-2bb7-4bf1-9b99-75861828274f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:42.250294 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1102/2174] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:42 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:42.252232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e1624-ec6f-4d69-9363-fb12252463ec None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:42.252785 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e1624-ec6f-4d69-9363-fb12252463ec None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:42.253078 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e1624-ec6f-4d69-9363-fb12252463ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:42.291739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-31667e3d-2bb7-4bf1-9b99-75861828274f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd8a68bf20ba4943bcdd05348ce30f7c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:42.295097 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2e2e1624-ec6f-4d69-9363-fb12252463ec None None] MFA Rules not processed for user `ca9fad426ed74e369a930ba9ecfc0935`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:42.297010 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2e2e1624-ec6f-4d69-9363-fb12252463ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:42.309292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-31667e3d-2bb7-4bf1-9b99-75861828274f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd8a68bf20ba4943bcdd05348ce30f7c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:42.310134 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-31667e3d-2bb7-4bf1-9b99-75861828274f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd8a68bf20ba4943bcdd05348ce30f7c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:42.311097 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-31667e3d-2bb7-4bf1-9b99-75861828274f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd8a68bf20ba4943bcdd05348ce30f7c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:42.334877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-31667e3d-2bb7-4bf1-9b99-75861828274f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd8a68bf20ba4943bcdd05348ce30f7c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:42.368694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1073/2175] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:42 2022] DELETE /identity/v3/users/bd8a68bf20ba4943bcdd05348ce30f7c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:42.370093 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b1128-e112-4c19-9450-c0f19e6693de None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:42.370378 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b1128-e112-4c19-9450-c0f19e6693de None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:42.370652 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b1128-e112-4c19-9450-c0f19e6693de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:42.408192 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1103/2176] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:42.412464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e1624-ec6f-4d69-9363-fb12252463ec None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:42.414602 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2e2e1624-ec6f-4d69-9363-fb12252463ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:42.418089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-898b1128-e112-4c19-9450-c0f19e6693de None None] MFA Rules not processed for user `ee821e6c64fe439085921660623a0752`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:42.419359 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-898b1128-e112-4c19-9450-c0f19e6693de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:42.437563 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e1624-ec6f-4d69-9363-fb12252463ec None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:42.541647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c4548-e135-40ab-9671-57cbd858c91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:42.542647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c4548-e135-40ab-9671-57cbd858c91c admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:42.543097 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c4548-e135-40ab-9671-57cbd858c91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:42.543585 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c4548-e135-40ab-9671-57cbd858c91c admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:42.544256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c4548-e135-40ab-9671-57cbd858c91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:42.546557 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c4548-e135-40ab-9671-57cbd858c91c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:42.564327 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1104/2177] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:42.565307 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c4548-e135-40ab-9671-57cbd858c91c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:42.567222 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-144c4548-e135-40ab-9671-57cbd858c91c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:42.576598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:42.580797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c4548-e135-40ab-9671-57cbd858c91c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:42.607392 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1074/2178] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:42.608372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b1128-e112-4c19-9450-c0f19e6693de None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:42.620001 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-898b1128-e112-4c19-9450-c0f19e6693de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:42.624825 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0539d-a130-464e-aff5-6a6f470ffb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:42.627167 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0539d-a130-464e-aff5-6a6f470ffb57 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:42.629872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0539d-a130-464e-aff5-6a6f470ffb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:42.631469 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0539d-a130-464e-aff5-6a6f470ffb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:42.633498 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0539d-a130-464e-aff5-6a6f470ffb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:42.634044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b1128-e112-4c19-9450-c0f19e6693de None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:42.635261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0539d-a130-464e-aff5-6a6f470ffb57 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:42.642254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f576e-2af0-4ab8-be1d-9cf2b177fbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:42.642952 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f576e-2af0-4ab8-be1d-9cf2b177fbcd admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:42.643302 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f576e-2af0-4ab8-be1d-9cf2b177fbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:42.643645 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f576e-2af0-4ab8-be1d-9cf2b177fbcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:42.644445 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f576e-2af0-4ab8-be1d-9cf2b177fbcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:42.646512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f576e-2af0-4ab8-be1d-9cf2b177fbcd admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:42.662489 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1105/2179] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:42.662489 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0539d-a130-464e-aff5-6a6f470ffb57 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:42.668761 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-96a0539d-a130-464e-aff5-6a6f470ffb57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:42.696636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0539d-a130-464e-aff5-6a6f470ffb57 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:42.696822 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1075/2180] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:42 2022] POST /identity/v3/projects => generated 399 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:42.700325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f576e-2af0-4ab8-be1d-9cf2b177fbcd admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:42.737616 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:42.798106 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f576e-2af0-4ab8-be1d-9cf2b177fbcd admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:42.803244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dfbba-6400-492c-af3d-75ff107959f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:42.804037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dfbba-6400-492c-af3d-75ff107959f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:42.804367 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dfbba-6400-492c-af3d-75ff107959f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:42.804619 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dfbba-6400-492c-af3d-75ff107959f4 admin admin] PATH_INFO: `/v3/projects/139dc22c82ee4c0988c41a98232e69eb/users/8361506717694758bd7759273ff892d4/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:42.806001 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bcae0-b681-4af2-a698-4ac83ba16593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:42.806629 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bcae0-b681-4af2-a698-4ac83ba16593 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:42.806915 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bcae0-b681-4af2-a698-4ac83ba16593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:42.807740 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bcae0-b681-4af2-a698-4ac83ba16593 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:42.808405 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bcae0-b681-4af2-a698-4ac83ba16593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:42.811877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bcae0-b681-4af2-a698-4ac83ba16593 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:42.830007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169dfbba-6400-492c-af3d-75ff107959f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=139dc22c82ee4c0988c41a98232e69eb, user_id=8361506717694758bd7759273ff892d4, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:42.833249 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169dfbba-6400-492c-af3d-75ff107959f4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:42.856821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1076/2181] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:42 2022] PUT /identity/v3/projects/139dc22c82ee4c0988c41a98232e69eb/users/8361506717694758bd7759273ff892d4/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:42.857229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dfbba-6400-492c-af3d-75ff107959f4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:42.859771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-169dfbba-6400-492c-af3d-75ff107959f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:42.867464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1106/2182] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:42 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:42.868428 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bcae0-b681-4af2-a698-4ac83ba16593 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:42.933603 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dfbba-6400-492c-af3d-75ff107959f4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:42.959639 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bcae0-b681-4af2-a698-4ac83ba16593 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:42.967656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba4687-4188-4ec7-b581-cf9e112a712a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:42.968341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba4687-4188-4ec7-b581-cf9e112a712a admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:42.968631 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba4687-4188-4ec7-b581-cf9e112a712a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:42.968904 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba4687-4188-4ec7-b581-cf9e112a712a admin admin] PATH_INFO: `/v3/projects/c26bc563ea194af48275e5bfee897323/users/5d2180a6224a4932ae5aab741856b02b/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:42.986845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba4687-4188-4ec7-b581-cf9e112a712a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26bc563ea194af48275e5bfee897323, user_id=5d2180a6224a4932ae5aab741856b02b, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:42.989650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba4687-4188-4ec7-b581-cf9e112a712a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:42.997540 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec19df3-a09e-4468-84f3-75edcb494d04 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12ce70a7c4f4396ab3fbb635dfc548b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:42.998277 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec19df3-a09e-4468-84f3-75edcb494d04 service glance] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:42.998678 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec19df3-a09e-4468-84f3-75edcb494d04 service glance] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:42.998995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec19df3-a09e-4468-84f3-75edcb494d04 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:43.013129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1107/2183] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:42 2022] PUT /identity/v3/projects/c26bc563ea194af48275e5bfee897323/users/5d2180a6224a4932ae5aab741856b02b/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:43.013129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba4687-4188-4ec7-b581-cf9e112a712a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:43.086577 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec19df3-a09e-4468-84f3-75edcb494d04 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:43.088533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec19df3-a09e-4468-84f3-75edcb494d04 service glance] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:43.099284 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1077/2184] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:43.100921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca42d1-61b6-4417-9cd0-09a5e49d3199 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:43.101311 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca42d1-61b6-4417-9cd0-09a5e49d3199 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:43.101659 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca42d1-61b6-4417-9cd0-09a5e49d3199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:43.106429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba4687-4188-4ec7-b581-cf9e112a712a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:43.111208 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b59d3-174e-4216-a9c3-fbfab4fa6452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:43.111952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b59d3-174e-4216-a9c3-fbfab4fa6452 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:43.112237 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b59d3-174e-4216-a9c3-fbfab4fa6452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:43.112529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b59d3-174e-4216-a9c3-fbfab4fa6452 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:43.113181 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b59d3-174e-4216-a9c3-fbfab4fa6452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:43.115106 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b59d3-174e-4216-a9c3-fbfab4fa6452 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:43.129752 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:43.144489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e3ca42d1-61b6-4417-9cd0-09a5e49d3199 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:43.145848 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e3ca42d1-61b6-4417-9cd0-09a5e49d3199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:43.156097 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1108/2185] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:43 2022] POST /identity/v3/users => generated 306 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:43.157131 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b59d3-174e-4216-a9c3-fbfab4fa6452 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:43.168542 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f64b59d3-174e-4216-a9c3-fbfab4fa6452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:43.168720 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1078/2186] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:43.168720 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca42d1-61b6-4417-9cd0-09a5e49d3199 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:43.197694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca42d1-61b6-4417-9cd0-09a5e49d3199 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:43.199629 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b59d3-174e-4216-a9c3-fbfab4fa6452 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:43.207120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e46960-f3f9-4153-8e4b-ae056180483d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:43.207736 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e46960-f3f9-4153-8e4b-ae056180483d admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:43.208018 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e46960-f3f9-4153-8e4b-ae056180483d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:43.208292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e46960-f3f9-4153-8e4b-ae056180483d admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:43.209365 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e46960-f3f9-4153-8e4b-ae056180483d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:43.212017 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e46960-f3f9-4153-8e4b-ae056180483d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:43.213585 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dd3c5-1d9b-400c-967e-2dcab28c0236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:43.214242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dd3c5-1d9b-400c-967e-2dcab28c0236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:43.214524 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dd3c5-1d9b-400c-967e-2dcab28c0236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:43.214802 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dd3c5-1d9b-400c-967e-2dcab28c0236 admin admin] PATH_INFO: `/v3/projects/9037e8db5904485b86118786da90d9da` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:43.217420 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dd3c5-1d9b-400c-967e-2dcab28c0236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9037e8db5904485b86118786da90d9da)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:43.220108 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dd3c5-1d9b-400c-967e-2dcab28c0236 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:43.236267 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:43.260828 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1079/2187] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:43 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:43.261940 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9b27b-33b1-4718-a4ad-1cc8810451ca None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:43.262228 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9b27b-33b1-4718-a4ad-1cc8810451ca None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:43.262503 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9b27b-33b1-4718-a4ad-1cc8810451ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:43.324708 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4b3dd3c5-1d9b-400c-967e-2dcab28c0236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9037e8db5904485b86118786da90d9da', 'request_id': 'req-4b3dd3c5-1d9b-400c-967e-2dcab28c0236'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:43.328578 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-7eb9b27b-33b1-4718-a4ad-1cc8810451ca None None] MFA Rules not processed for user `5d2180a6224a4932ae5aab741856b02b`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:43.329933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7eb9b27b-33b1-4718-a4ad-1cc8810451ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:43.338138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4b3dd3c5-1d9b-400c-967e-2dcab28c0236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9037e8db5904485b86118786da90d9da', 'request_id': 'req-4b3dd3c5-1d9b-400c-967e-2dcab28c0236'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:43.357694 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4b3dd3c5-1d9b-400c-967e-2dcab28c0236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9037e8db5904485b86118786da90d9da', 'request_id': 'req-4b3dd3c5-1d9b-400c-967e-2dcab28c0236'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:43.377717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4b3dd3c5-1d9b-400c-967e-2dcab28c0236 admin admin] The token cache is being invalidate because project 9037e8db5904485b86118786da90d9da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:43.378980 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4b3dd3c5-1d9b-400c-967e-2dcab28c0236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:43.379682 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4b3dd3c5-1d9b-400c-967e-2dcab28c0236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:43.397590 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1109/2188] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:43 2022] DELETE /identity/v3/projects/9037e8db5904485b86118786da90d9da => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:43.398620 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dd3c5-1d9b-400c-967e-2dcab28c0236 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:43.407065 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4b3dd3c5-1d9b-400c-967e-2dcab28c0236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:43.440941 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1080/2189] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:43.445427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9b27b-33b1-4718-a4ad-1cc8810451ca None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:43.451827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7eb9b27b-33b1-4718-a4ad-1cc8810451ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:43.535047 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9b27b-33b1-4718-a4ad-1cc8810451ca None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:43.540506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf45897-4ba2-4fbe-b284-b60eb1bf136e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:43.541352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf45897-4ba2-4fbe-b284-b60eb1bf136e service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:43.542098 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf45897-4ba2-4fbe-b284-b60eb1bf136e service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:43.542098 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf45897-4ba2-4fbe-b284-b60eb1bf136e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:43.543838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-fdf45897-4ba2-4fbe-b284-b60eb1bf136e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:43.557600 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dd3c5-1d9b-400c-967e-2dcab28c0236 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:43.562560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec71fc-844c-4b9b-9f5e-61427f16fc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:43.563253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec71fc-844c-4b9b-9f5e-61427f16fc8f admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:43.563603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec71fc-844c-4b9b-9f5e-61427f16fc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:43.563957 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec71fc-844c-4b9b-9f5e-61427f16fc8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:43.564707 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec71fc-844c-4b9b-9f5e-61427f16fc8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:43.566453 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec71fc-844c-4b9b-9f5e-61427f16fc8f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:43.569773 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf45897-4ba2-4fbe-b284-b60eb1bf136e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:43.576470 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf45897-4ba2-4fbe-b284-b60eb1bf136e service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:43.577815 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1110/2190] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:43.578677 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec71fc-844c-4b9b-9f5e-61427f16fc8f admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:43.580492 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-31ec71fc-844c-4b9b-9f5e-61427f16fc8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:43.596906 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec71fc-844c-4b9b-9f5e-61427f16fc8f admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:43.605543 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a886c2-296e-4b23-892d-3306585ea006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:43.606266 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a886c2-296e-4b23-892d-3306585ea006 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:43.606613 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a886c2-296e-4b23-892d-3306585ea006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:43.607121 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a886c2-296e-4b23-892d-3306585ea006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:43.607831 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a886c2-296e-4b23-892d-3306585ea006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:43.609543 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1081/2191] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:43.609820 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a886c2-296e-4b23-892d-3306585ea006 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:43.613557 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c1c5d-fdbe-4e2a-90f1-49df898320a7 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:43.614450 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c1c5d-fdbe-4e2a-90f1-49df898320a7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:43.618378 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c1c5d-fdbe-4e2a-90f1-49df898320a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:43.622519 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1111/2192] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:43.623540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a886c2-296e-4b23-892d-3306585ea006 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:43.625701 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-72a886c2-296e-4b23-892d-3306585ea006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:43.676176 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0e5c1c5d-fdbe-4e2a-90f1-49df898320a7 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:43.681672 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0e5c1c5d-fdbe-4e2a-90f1-49df898320a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:43.705499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1082/2193] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:43.705499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c1c5d-fdbe-4e2a-90f1-49df898320a7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:43.722592 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a886c2-296e-4b23-892d-3306585ea006 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:43.737731 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009f02c-b8f8-47f9-9353-568d55376a28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:43.739211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009f02c-b8f8-47f9-9353-568d55376a28 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:43.739680 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009f02c-b8f8-47f9-9353-568d55376a28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:43.740282 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009f02c-b8f8-47f9-9353-568d55376a28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:43.758524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c1c5d-fdbe-4e2a-90f1-49df898320a7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:43.768582 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009f02c-b8f8-47f9-9353-568d55376a28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:43.770132 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fcbaf-4773-4425-a453-415a39db7584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:43.770832 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fcbaf-4773-4425-a453-415a39db7584 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:43.771259 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fcbaf-4773-4425-a453-415a39db7584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:43.771786 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fcbaf-4773-4425-a453-415a39db7584 admin admin] PATH_INFO: `/v3/projects/c2d81eea048e457e90f731df4e2f9530/users/8a59e90a9f3244049c2e96f76bc8d020/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:43.772880 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009f02c-b8f8-47f9-9353-568d55376a28 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:43.790334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1112/2194] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:43.791618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009f02c-b8f8-47f9-9353-568d55376a28 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:43.797996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:43.804748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009f02c-b8f8-47f9-9353-568d55376a28 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:43.818796 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824fcbaf-4773-4425-a453-415a39db7584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d81eea048e457e90f731df4e2f9530, user_id=8a59e90a9f3244049c2e96f76bc8d020, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:43.821314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805552a-b4a4-4c36-82d3-cdf783a148ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:43.822190 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805552a-b4a4-4c36-82d3-cdf783a148ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:43.822533 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805552a-b4a4-4c36-82d3-cdf783a148ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:43.822989 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805552a-b4a4-4c36-82d3-cdf783a148ed admin admin] PATH_INFO: `/v3/projects/8532832947a441dda34282d3f019a77a/users/c8d1cd6ddfbb4d41ac6fb932c652ce9f/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:43.823193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824fcbaf-4773-4425-a453-415a39db7584 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:43.842158 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805552a-b4a4-4c36-82d3-cdf783a148ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=8532832947a441dda34282d3f019a77a, user_id=c8d1cd6ddfbb4d41ac6fb932c652ce9f, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:43.844011 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1083/2195] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:43 2022] PUT /identity/v3/projects/c2d81eea048e457e90f731df4e2f9530/users/8a59e90a9f3244049c2e96f76bc8d020/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:43.845062 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108ce5d-f5b2-4023-85b5-ec3de3d43ea0 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:43.845196 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805552a-b4a4-4c36-82d3-cdf783a148ed admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:43.845385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108ce5d-f5b2-4023-85b5-ec3de3d43ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:43.845634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108ce5d-f5b2-4023-85b5-ec3de3d43ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:43.870312 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1113/2196] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:43 2022] PUT /identity/v3/projects/8532832947a441dda34282d3f019a77a/users/c8d1cd6ddfbb4d41ac6fb932c652ce9f/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:43.871315 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805552a-b4a4-4c36-82d3-cdf783a148ed admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:43.880370 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e108ce5d-f5b2-4023-85b5-ec3de3d43ea0 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:43.881775 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e108ce5d-f5b2-4023-85b5-ec3de3d43ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:44.007810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:44.050638 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805552a-b4a4-4c36-82d3-cdf783a148ed admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:44.062068 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1084/2197] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:44.063898 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108ce5d-f5b2-4023-85b5-ec3de3d43ea0 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:44.088752 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974bc56-df5b-4258-98d8-367cfecafbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:44.089515 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974bc56-df5b-4258-98d8-367cfecafbbf admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:44.089851 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974bc56-df5b-4258-98d8-367cfecafbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:44.094962 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974bc56-df5b-4258-98d8-367cfecafbbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:44.097201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974bc56-df5b-4258-98d8-367cfecafbbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:44.099467 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974bc56-df5b-4258-98d8-367cfecafbbf admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:44.115812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1114/2198] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:44.116899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974bc56-df5b-4258-98d8-367cfecafbbf admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:44.142839 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108ce5d-f5b2-4023-85b5-ec3de3d43ea0 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:44.147222 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974bc56-df5b-4258-98d8-367cfecafbbf admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:44.164355 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034d5b2-beaf-4b20-8edd-1306ff401aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:44.164355 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034d5b2-beaf-4b20-8edd-1306ff401aad admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:44.164355 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034d5b2-beaf-4b20-8edd-1306ff401aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:44.164355 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034d5b2-beaf-4b20-8edd-1306ff401aad admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:44.164912 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034d5b2-beaf-4b20-8edd-1306ff401aad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:45:44.164912 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034d5b2-beaf-4b20-8edd-1306ff401aad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:44.164912 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034d5b2-beaf-4b20-8edd-1306ff401aad admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:44.168706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f064d9-027f-468a-a969-fbf3383f11c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:44.168706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f064d9-027f-468a-a969-fbf3383f11c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:44.168706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f064d9-027f-468a-a969-fbf3383f11c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:44.168706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f064d9-027f-468a-a969-fbf3383f11c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:44.169955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f064d9-027f-468a-a969-fbf3383f11c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:44.172968 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f064d9-027f-468a-a969-fbf3383f11c5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:44.178985 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1115/2199] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:45:44.179346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034d5b2-beaf-4b20-8edd-1306ff401aad admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:44.203529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034d5b2-beaf-4b20-8edd-1306ff401aad admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:44.213669 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161340a1-56b9-49a9-9ff8-0fe3074d2d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:44.223182 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161340a1-56b9-49a9-9ff8-0fe3074d2d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:44.223182 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161340a1-56b9-49a9-9ff8-0fe3074d2d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:44.223182 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161340a1-56b9-49a9-9ff8-0fe3074d2d62 admin admin] PATH_INFO: `/v3/projects/c2d81eea048e457e90f731df4e2f9530/users/8a59e90a9f3244049c2e96f76bc8d020/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:44.223182 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161340a1-56b9-49a9-9ff8-0fe3074d2d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d81eea048e457e90f731df4e2f9530, user_id=8a59e90a9f3244049c2e96f76bc8d020, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:44.238150 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161340a1-56b9-49a9-9ff8-0fe3074d2d62 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:44.239341 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1085/2200] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:44.240267 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f064d9-027f-468a-a969-fbf3383f11c5 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:44.252125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f064d9-027f-468a-a969-fbf3383f11c5 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:44.264298 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1a85f-28db-4eb2-bfb0-b1ef81b6e8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:44.266418 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1a85f-28db-4eb2-bfb0-b1ef81b6e8b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:44.266706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1a85f-28db-4eb2-bfb0-b1ef81b6e8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:44.266981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1a85f-28db-4eb2-bfb0-b1ef81b6e8b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:44.268791 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1a85f-28db-4eb2-bfb0-b1ef81b6e8b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:44.270791 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1a85f-28db-4eb2-bfb0-b1ef81b6e8b1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:44.288457 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1116/2201] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:44 2022] PUT /identity/v3/projects/c2d81eea048e457e90f731df4e2f9530/users/8a59e90a9f3244049c2e96f76bc8d020/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:44.290971 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161340a1-56b9-49a9-9ff8-0fe3074d2d62 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:44.332269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1086/2202] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:44 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:44.350273 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61c4aa-69c2-4a33-80d6-9e465a55d08f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:44.350810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61c4aa-69c2-4a33-80d6-9e465a55d08f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:44.352347 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61c4aa-69c2-4a33-80d6-9e465a55d08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:44.402675 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ba61c4aa-69c2-4a33-80d6-9e465a55d08f None None] MFA Rules not processed for user `8a59e90a9f3244049c2e96f76bc8d020`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:44.404628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ba61c4aa-69c2-4a33-80d6-9e465a55d08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:44.419741 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161340a1-56b9-49a9-9ff8-0fe3074d2d62 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:44.601323 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:44.617138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa403426-5995-4cb6-a43b-c9d64c23c567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:44.618693 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa403426-5995-4cb6-a43b-c9d64c23c567 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:44.618979 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa403426-5995-4cb6-a43b-c9d64c23c567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:44.619253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa403426-5995-4cb6-a43b-c9d64c23c567 admin admin] PATH_INFO: `/v3/projects/8532832947a441dda34282d3f019a77a/users/c8d1cd6ddfbb4d41ac6fb932c652ce9f/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:44.625822 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa403426-5995-4cb6-a43b-c9d64c23c567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8532832947a441dda34282d3f019a77a, user_id=c8d1cd6ddfbb4d41ac6fb932c652ce9f, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:44.630399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa403426-5995-4cb6-a43b-c9d64c23c567 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:44.639433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1087/2203] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:44 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:44.652317 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61c4aa-69c2-4a33-80d6-9e465a55d08f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:44.665364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1117/2204] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:44 2022] PUT /identity/v3/projects/8532832947a441dda34282d3f019a77a/users/c8d1cd6ddfbb4d41ac6fb932c652ce9f/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:44.666461 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa403426-5995-4cb6-a43b-c9d64c23c567 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:44.669337 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61c4aa-69c2-4a33-80d6-9e465a55d08f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:44.749589 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa403426-5995-4cb6-a43b-c9d64c23c567 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:44.774510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe8d58-09b0-47b8-b1b8-027d491265d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:44.777222 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe8d58-09b0-47b8-b1b8-027d491265d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:44.777743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe8d58-09b0-47b8-b1b8-027d491265d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:44.778816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe8d58-09b0-47b8-b1b8-027d491265d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:44.784632 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db0629-2ddf-4194-917a-45312524e000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:44.785340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db0629-2ddf-4194-917a-45312524e000 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:44.785672 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db0629-2ddf-4194-917a-45312524e000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:44.785943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db0629-2ddf-4194-917a-45312524e000 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:44.786683 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db0629-2ddf-4194-917a-45312524e000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:44.789503 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db0629-2ddf-4194-917a-45312524e000 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:44.847673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1088/2205] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:44 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:44.849040 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf739f48-f7e9-4c68-a170-53b3b7c421c4 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:44.849451 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf739f48-f7e9-4c68-a170-53b3b7c421c4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:44.849818 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf739f48-f7e9-4c68-a170-53b3b7c421c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:44.901941 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-cf739f48-f7e9-4c68-a170-53b3b7c421c4 None None] MFA Rules not processed for user `c8d1cd6ddfbb4d41ac6fb932c652ce9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:44.903937 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cf739f48-f7e9-4c68-a170-53b3b7c421c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:44.932820 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe8d58-09b0-47b8-b1b8-027d491265d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:44.934996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe8d58-09b0-47b8-b1b8-027d491265d4 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:44.935115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:44.954197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1118/2206] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:44 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:44.954777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe8d58-09b0-47b8-b1b8-027d491265d4 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:44.980566 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe8d58-09b0-47b8-b1b8-027d491265d4 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:44.996277 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdd7b2-7be9-4d9a-a9a6-9f97feec3546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:44.996910 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdd7b2-7be9-4d9a-a9a6-9f97feec3546 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:44.997232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdd7b2-7be9-4d9a-a9a6-9f97feec3546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:44.997510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdd7b2-7be9-4d9a-a9a6-9f97feec3546 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:44.998168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cdd7b2-7be9-4d9a-a9a6-9f97feec3546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:45.005868 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cdd7b2-7be9-4d9a-a9a6-9f97feec3546 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:45.026881 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1119/2207] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:45.032274 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdd7b2-7be9-4d9a-a9a6-9f97feec3546 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:45.050247 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1089/2208] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:45.065280 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdd7b2-7be9-4d9a-a9a6-9f97feec3546 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:45.082366 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf739f48-f7e9-4c68-a170-53b3b7c421c4 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:45.084346 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-cf739f48-f7e9-4c68-a170-53b3b7c421c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:45.086825 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2a477-d2ac-415b-b806-0d9a86317eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:45.088057 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2a477-d2ac-415b-b806-0d9a86317eef admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:45.088345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2a477-d2ac-415b-b806-0d9a86317eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:45.088634 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2a477-d2ac-415b-b806-0d9a86317eef admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:45.090028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2a477-d2ac-415b-b806-0d9a86317eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:45.091646 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2a477-d2ac-415b-b806-0d9a86317eef admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:45.103245 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf739f48-f7e9-4c68-a170-53b3b7c421c4 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:45.109949 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45cc36-f17c-4783-816c-c1646c01868d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:45.111069 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45cc36-f17c-4783-816c-c1646c01868d service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:45.111655 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45cc36-f17c-4783-816c-c1646c01868d service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:45.112176 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45cc36-f17c-4783-816c-c1646c01868d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:45.132294 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1120/2209] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:45.135547 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2a477-d2ac-415b-b806-0d9a86317eef admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:45.138454 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45cc36-f17c-4783-816c-c1646c01868d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:45.140399 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45cc36-f17c-4783-816c-c1646c01868d service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:45.156052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2a477-d2ac-415b-b806-0d9a86317eef admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:45.171047 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1ae7a-bf04-4531-8320-a367c73c0685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:45.172351 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1ae7a-bf04-4531-8320-a367c73c0685 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:45.172856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1ae7a-bf04-4531-8320-a367c73c0685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:45.173378 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1ae7a-bf04-4531-8320-a367c73c0685 admin admin] PATH_INFO: `/v3/projects/b9863436544346db927f9124ed697008/users/d146cf212b0a4cad9f361a6716ee82e4/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:45.190577 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1090/2210] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:45:45.192093 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45cc36-f17c-4783-816c-c1646c01868d service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:45.214788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45cc36-f17c-4783-816c-c1646c01868d service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:45.220324 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1ae7a-bf04-4531-8320-a367c73c0685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9863436544346db927f9124ed697008, user_id=d146cf212b0a4cad9f361a6716ee82e4, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:45.226225 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210961bd-2726-43e2-a8f8-feda32f03b63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:45.226856 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210961bd-2726-43e2-a8f8-feda32f03b63 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:45.227187 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210961bd-2726-43e2-a8f8-feda32f03b63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:45.227629 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210961bd-2726-43e2-a8f8-feda32f03b63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:45.238355 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-210961bd-2726-43e2-a8f8-feda32f03b63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:45.239921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1ae7a-bf04-4531-8320-a367c73c0685 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:45.295853 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1121/2211] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:45 2022] PUT /identity/v3/projects/b9863436544346db927f9124ed697008/users/d146cf212b0a4cad9f361a6716ee82e4/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:45.311503 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e8a95-809b-4de7-a60f-856b91b10f23 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:45.312473 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e8a95-809b-4de7-a60f-856b91b10f23 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:45.312955 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e8a95-809b-4de7-a60f-856b91b10f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:45.369633 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210961bd-2726-43e2-a8f8-feda32f03b63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:45.371093 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210961bd-2726-43e2-a8f8-feda32f03b63 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:45.384433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1091/2212] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:45 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:45.421298 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-bb8e8a95-809b-4de7-a60f-856b91b10f23 None None] MFA Rules not processed for user `d146cf212b0a4cad9f361a6716ee82e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:45.425250 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-bb8e8a95-809b-4de7-a60f-856b91b10f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:45.552245 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:45.613508 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1122/2213] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:45:45.617433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210961bd-2726-43e2-a8f8-feda32f03b63 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:45.636365 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210961bd-2726-43e2-a8f8-feda32f03b63 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:45.793013 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1c6fd-1565-4661-8063-01db8189564c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:45.795122 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1c6fd-1565-4661-8063-01db8189564c admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:45.795646 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1c6fd-1565-4661-8063-01db8189564c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:45.796185 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1c6fd-1565-4661-8063-01db8189564c admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:45.797193 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1c6fd-1565-4661-8063-01db8189564c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:45.799590 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1c6fd-1565-4661-8063-01db8189564c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:45.870285 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e8a95-809b-4de7-a60f-856b91b10f23 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:45.870991 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1092/2214] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:45 2022] POST /identity/v3/projects => generated 365 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:45.886840 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e8a95-809b-4de7-a60f-856b91b10f23 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:46.051754 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80943d8-8b87-4be6-b5a6-be1ac81c8283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:46.052657 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80943d8-8b87-4be6-b5a6-be1ac81c8283 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:46.055152 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80943d8-8b87-4be6-b5a6-be1ac81c8283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:46.055626 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80943d8-8b87-4be6-b5a6-be1ac81c8283 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:46.056457 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80943d8-8b87-4be6-b5a6-be1ac81c8283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:46.061652 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80943d8-8b87-4be6-b5a6-be1ac81c8283 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:46.122894 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1123/2215] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:45 2022] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:45:46.127285 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1c6fd-1565-4661-8063-01db8189564c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:46.155975 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1c6fd-1565-4661-8063-01db8189564c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:46.182792 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8889296-8f42-4aaf-b6bc-e197281f373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:46.183536 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8889296-8f42-4aaf-b6bc-e197281f373e admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:46.184026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8889296-8f42-4aaf-b6bc-e197281f373e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:46.184258 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8889296-8f42-4aaf-b6bc-e197281f373e admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:46.186071 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8889296-8f42-4aaf-b6bc-e197281f373e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:46.192293 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8889296-8f42-4aaf-b6bc-e197281f373e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:46.232460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80943d8-8b87-4be6-b5a6-be1ac81c8283 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:46.232903 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1093/2216] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:46.266280 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80943d8-8b87-4be6-b5a6-be1ac81c8283 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:46.282214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bc07a-e311-49b4-8a48-a6905f59e0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:46.282782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bc07a-e311-49b4-8a48-a6905f59e0f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:46.283067 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bc07a-e311-49b4-8a48-a6905f59e0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:46.283340 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bc07a-e311-49b4-8a48-a6905f59e0f8 admin admin] PATH_INFO: `/v3/projects/f3ca2845f4964987a67cd224924624f9/users/5f5ef20656b248eca51afc4befdfee7e/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:46.319917 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8bc07a-e311-49b4-8a48-a6905f59e0f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ca2845f4964987a67cd224924624f9, user_id=5f5ef20656b248eca51afc4befdfee7e, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:46.322678 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8bc07a-e311-49b4-8a48-a6905f59e0f8 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:46.360179 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8889296-8f42-4aaf-b6bc-e197281f373e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:46.360610 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1124/2217] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:46 2022] PUT /identity/v3/projects/f3ca2845f4964987a67cd224924624f9/users/5f5ef20656b248eca51afc4befdfee7e/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:46.374595 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8889296-8f42-4aaf-b6bc-e197281f373e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:46.429613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:46.527314 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dedd98-a2ad-42ce-9088-b2fc96e051c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:46.528195 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dedd98-a2ad-42ce-9088-b2fc96e051c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:46.528627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dedd98-a2ad-42ce-9088-b2fc96e051c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:46.529128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dedd98-a2ad-42ce-9088-b2fc96e051c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:46.530102 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dedd98-a2ad-42ce-9088-b2fc96e051c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:46.532457 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dedd98-a2ad-42ce-9088-b2fc96e051c9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:46.566260 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1094/2218] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:46.568625 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bc07a-e311-49b4-8a48-a6905f59e0f8 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:46.580489 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bc07a-e311-49b4-8a48-a6905f59e0f8 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:46.590311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee918b1e-6fbd-411c-b79d-df3740acfb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:46.590990 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee918b1e-6fbd-411c-b79d-df3740acfb84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:46.591268 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee918b1e-6fbd-411c-b79d-df3740acfb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:46.591584 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee918b1e-6fbd-411c-b79d-df3740acfb84 admin admin] PATH_INFO: `/v3/projects/f3ca2845f4964987a67cd224924624f9/users/5f5ef20656b248eca51afc4befdfee7e/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:46.597878 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee918b1e-6fbd-411c-b79d-df3740acfb84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ca2845f4964987a67cd224924624f9, user_id=5f5ef20656b248eca51afc4befdfee7e, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:46.600835 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee918b1e-6fbd-411c-b79d-df3740acfb84 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:46.644261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1125/2219] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:46 2022] PUT /identity/v3/projects/f3ca2845f4964987a67cd224924624f9/users/5f5ef20656b248eca51afc4befdfee7e/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:46.660514 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3115a-805d-460b-8c4f-2faf0b12f391 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:46.660656 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3115a-805d-460b-8c4f-2faf0b12f391 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:46.660932 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3115a-805d-460b-8c4f-2faf0b12f391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:46.738566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d8a3115a-805d-460b-8c4f-2faf0b12f391 None None] MFA Rules not processed for user `5f5ef20656b248eca51afc4befdfee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:46.744033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d8a3115a-805d-460b-8c4f-2faf0b12f391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:46.898566 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee918b1e-6fbd-411c-b79d-df3740acfb84 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:47.063054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1095/2220] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:47.072645 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3115a-805d-460b-8c4f-2faf0b12f391 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:47.113182 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee918b1e-6fbd-411c-b79d-df3740acfb84 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:47.122421 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6784ce-22ed-4c37-8dc7-da1800738f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:47.123228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6784ce-22ed-4c37-8dc7-da1800738f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:47.123812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6784ce-22ed-4c37-8dc7-da1800738f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:47.123913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6784ce-22ed-4c37-8dc7-da1800738f6e admin admin] PATH_INFO: `/v3/users/ca9fad426ed74e369a930ba9ecfc0935` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:47.129219 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6784ce-22ed-4c37-8dc7-da1800738f6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca9fad426ed74e369a930ba9ecfc0935)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:47.132070 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6784ce-22ed-4c37-8dc7-da1800738f6e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:47.233740 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3115a-805d-460b-8c4f-2faf0b12f391 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:47.237763 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:47.242697 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0a9c7-adf7-4d2c-804e-dfe430f7a779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:47.244707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0a9c7-adf7-4d2c-804e-dfe430f7a779 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:47.245202 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0a9c7-adf7-4d2c-804e-dfe430f7a779 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:47.246003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0a9c7-adf7-4d2c-804e-dfe430f7a779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:47.251054 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3f6784ce-22ed-4c37-8dc7-da1800738f6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca9fad426ed74e369a930ba9ecfc0935'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:47.268416 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0a9c7-adf7-4d2c-804e-dfe430f7a779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:47.270699 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0a9c7-adf7-4d2c-804e-dfe430f7a779 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:47.277685 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3f6784ce-22ed-4c37-8dc7-da1800738f6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca9fad426ed74e369a930ba9ecfc0935'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:47.282344 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3f6784ce-22ed-4c37-8dc7-da1800738f6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca9fad426ed74e369a930ba9ecfc0935'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:47.283052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3f6784ce-22ed-4c37-8dc7-da1800738f6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca9fad426ed74e369a930ba9ecfc0935'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:47.290261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1096/2221] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:45:47.313496 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3f6784ce-22ed-4c37-8dc7-da1800738f6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca9fad426ed74e369a930ba9ecfc0935'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:47.368434 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1126/2222] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:46 2022] DELETE /identity/v3/users/ca9fad426ed74e369a930ba9ecfc0935 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:47.372186 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215794a-92b5-44ef-ac47-584274809dc6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:47.372544 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215794a-92b5-44ef-ac47-584274809dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:47.372850 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215794a-92b5-44ef-ac47-584274809dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:47.432316 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8215794a-92b5-44ef-ac47-584274809dc6 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:47.436873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8215794a-92b5-44ef-ac47-584274809dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:47.581538 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6784ce-22ed-4c37-8dc7-da1800738f6e admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:47.582941 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3f6784ce-22ed-4c37-8dc7-da1800738f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:47.610542 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:47.683264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1097/2223] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:47.698588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215794a-92b5-44ef-ac47-584274809dc6 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:47.703738 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8215794a-92b5-44ef-ac47-584274809dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:47.774923 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6784ce-22ed-4c37-8dc7-da1800738f6e admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:47.788082 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b8366-ad48-4872-9c88-6ddb773d57d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:47.789529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b8366-ad48-4872-9c88-6ddb773d57d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:47.789666 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b8366-ad48-4872-9c88-6ddb773d57d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:47.789871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b8366-ad48-4872-9c88-6ddb773d57d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:47.794806 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-eb0b8366-ad48-4872-9c88-6ddb773d57d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:47.878022 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215794a-92b5-44ef-ac47-584274809dc6 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:47.887269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bae85-5358-415b-9356-bc788f6d6947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:47.888569 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bae85-5358-415b-9356-bc788f6d6947 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:47.888822 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bae85-5358-415b-9356-bc788f6d6947 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:47.889112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bae85-5358-415b-9356-bc788f6d6947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:47.918992 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bae85-5358-415b-9356-bc788f6d6947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:47.921650 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bae85-5358-415b-9356-bc788f6d6947 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:47.937431 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b8366-ad48-4872-9c88-6ddb773d57d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:47.941654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b8366-ad48-4872-9c88-6ddb773d57d0 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:47.963039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1098/2224] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:47.981119 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1127/2225] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:45:48.968700 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bae85-5358-415b-9356-bc788f6d6947 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:48.971140 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-494bae85-5358-415b-9356-bc788f6d6947 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:48.986576 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bae85-5358-415b-9356-bc788f6d6947 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:49.002010 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e31c0-d51c-4604-b833-108fb34041d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:49.003453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e31c0-d51c-4604-b833-108fb34041d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:49.004020 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e31c0-d51c-4604-b833-108fb34041d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:49.004501 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e31c0-d51c-4604-b833-108fb34041d3 admin admin] PATH_INFO: `/v3/projects/429f2dcaa789469cbe3c54f735c44768` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:49.005963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e31c0-d51c-4604-b833-108fb34041d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=429f2dcaa789469cbe3c54f735c44768)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:49.008721 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e31c0-d51c-4604-b833-108fb34041d3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:49.082298 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-eb8e31c0-d51c-4604-b833-108fb34041d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '429f2dcaa789469cbe3c54f735c44768', 'request_id': 'req-eb8e31c0-d51c-4604-b833-108fb34041d3'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:49.092548 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-eb8e31c0-d51c-4604-b833-108fb34041d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '429f2dcaa789469cbe3c54f735c44768', 'request_id': 'req-eb8e31c0-d51c-4604-b833-108fb34041d3'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:49.099992 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-eb8e31c0-d51c-4604-b833-108fb34041d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '429f2dcaa789469cbe3c54f735c44768', 'request_id': 'req-eb8e31c0-d51c-4604-b833-108fb34041d3'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:49.117773 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-eb8e31c0-d51c-4604-b833-108fb34041d3 admin admin] The token cache is being invalidate because project 429f2dcaa789469cbe3c54f735c44768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:49.118113 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-eb8e31c0-d51c-4604-b833-108fb34041d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:49.118754 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-eb8e31c0-d51c-4604-b833-108fb34041d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:49.123690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1099/2226] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:48 2022] DELETE /identity/v3/projects/429f2dcaa789469cbe3c54f735c44768 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:45:49.125196 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b8366-ad48-4872-9c88-6ddb773d57d0 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:49.150529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b8366-ad48-4872-9c88-6ddb773d57d0 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:49.236474 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441c166-1623-4c07-a884-5e273794f34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:49.236943 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441c166-1623-4c07-a884-5e273794f34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:49.237260 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441c166-1623-4c07-a884-5e273794f34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:49.237532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441c166-1623-4c07-a884-5e273794f34e admin admin] PATH_INFO: `/v3/users/c8d1cd6ddfbb4d41ac6fb932c652ce9f` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:49.238780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441c166-1623-4c07-a884-5e273794f34e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d1cd6ddfbb4d41ac6fb932c652ce9f)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:49.243393 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441c166-1623-4c07-a884-5e273794f34e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:49.256494 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:49.355649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d441c166-1623-4c07-a884-5e273794f34e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d1cd6ddfbb4d41ac6fb932c652ce9f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:49.369057 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d441c166-1623-4c07-a884-5e273794f34e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d1cd6ddfbb4d41ac6fb932c652ce9f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:49.370774 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d441c166-1623-4c07-a884-5e273794f34e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d1cd6ddfbb4d41ac6fb932c652ce9f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:49.371554 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d441c166-1623-4c07-a884-5e273794f34e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d1cd6ddfbb4d41ac6fb932c652ce9f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:49.385944 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d441c166-1623-4c07-a884-5e273794f34e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d1cd6ddfbb4d41ac6fb932c652ce9f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:49.422786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1128/2227] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:49 2022] DELETE /identity/v3/users/c8d1cd6ddfbb4d41ac6fb932c652ce9f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:50.073159 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e31c0-d51c-4604-b833-108fb34041d3 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:50.075316 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-eb8e31c0-d51c-4604-b833-108fb34041d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:50.115103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e31c0-d51c-4604-b833-108fb34041d3 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:50.260783 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1a104-ec1e-4679-a4da-8df8310f95c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:50.261806 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1a104-ec1e-4679-a4da-8df8310f95c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:50.262111 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1a104-ec1e-4679-a4da-8df8310f95c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:50.262387 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1a104-ec1e-4679-a4da-8df8310f95c1 admin admin] PATH_INFO: `/v3/projects/8532832947a441dda34282d3f019a77a` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:50.264338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1a104-ec1e-4679-a4da-8df8310f95c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8532832947a441dda34282d3f019a77a)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:50.266482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1a104-ec1e-4679-a4da-8df8310f95c1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:50.287457 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:50.392070 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-13d1a104-ec1e-4679-a4da-8df8310f95c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8532832947a441dda34282d3f019a77a', 'request_id': 'req-13d1a104-ec1e-4679-a4da-8df8310f95c1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:50.403207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-13d1a104-ec1e-4679-a4da-8df8310f95c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8532832947a441dda34282d3f019a77a', 'request_id': 'req-13d1a104-ec1e-4679-a4da-8df8310f95c1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:50.412057 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-13d1a104-ec1e-4679-a4da-8df8310f95c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8532832947a441dda34282d3f019a77a', 'request_id': 'req-13d1a104-ec1e-4679-a4da-8df8310f95c1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:50.427228 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-13d1a104-ec1e-4679-a4da-8df8310f95c1 admin admin] The token cache is being invalidate because project 8532832947a441dda34282d3f019a77a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:50.427528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-13d1a104-ec1e-4679-a4da-8df8310f95c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:50.428186 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-13d1a104-ec1e-4679-a4da-8df8310f95c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:50.430630 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1100/2228] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:50 2022] DELETE /identity/v3/projects/8532832947a441dda34282d3f019a77a => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:50.435305 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b6abc-6389-41a3-bf9b-135570f7d497 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:50.435880 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b6abc-6389-41a3-bf9b-135570f7d497 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:50.435980 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b6abc-6389-41a3-bf9b-135570f7d497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:50.499460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ee1b6abc-6389-41a3-bf9b-135570f7d497 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:50.500744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ee1b6abc-6389-41a3-bf9b-135570f7d497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:50.672360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1129/2229] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:50.682598 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cadae-a7b4-4c21-9418-5e2105244eb6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:50.683071 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cadae-a7b4-4c21-9418-5e2105244eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:50.683446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cadae-a7b4-4c21-9418-5e2105244eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:50.728235 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ac8cadae-a7b4-4c21-9418-5e2105244eb6 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:50.730520 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ac8cadae-a7b4-4c21-9418-5e2105244eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:50.760036 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b6abc-6389-41a3-bf9b-135570f7d497 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:50.761560 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1101/2230] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:50.773934 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b6abc-6389-41a3-bf9b-135570f7d497 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:50.782223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b017e8-39a8-4d95-b7ee-e93bb9138a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:50.792039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b017e8-39a8-4d95-b7ee-e93bb9138a57 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:50.793042 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b017e8-39a8-4d95-b7ee-e93bb9138a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:50.794427 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b017e8-39a8-4d95-b7ee-e93bb9138a57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:50.795987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b017e8-39a8-4d95-b7ee-e93bb9138a57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:45:50.796504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b017e8-39a8-4d95-b7ee-e93bb9138a57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:50.798385 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b017e8-39a8-4d95-b7ee-e93bb9138a57 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:50.829465 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cadae-a7b4-4c21-9418-5e2105244eb6 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:50.857813 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1130/2231] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:45:50.858070 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cadae-a7b4-4c21-9418-5e2105244eb6 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:50.865345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ea939-708c-4ef6-8472-8d9251523fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:50.866560 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ea939-708c-4ef6-8472-8d9251523fcd admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:50.867035 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ea939-708c-4ef6-8472-8d9251523fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:50.867308 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ea939-708c-4ef6-8472-8d9251523fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:50.867946 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ea939-708c-4ef6-8472-8d9251523fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:50.869954 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ea939-708c-4ef6-8472-8d9251523fcd admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:50.933876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1102/2232] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:50 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:50.937686 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b017e8-39a8-4d95-b7ee-e93bb9138a57 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:50.954556 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b017e8-39a8-4d95-b7ee-e93bb9138a57 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:51.101386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b755d-6c27-454e-a71a-954394dc6632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:51.102541 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b755d-6c27-454e-a71a-954394dc6632 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:51.103862 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b755d-6c27-454e-a71a-954394dc6632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:51.104370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b755d-6c27-454e-a71a-954394dc6632 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:51.105389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b755d-6c27-454e-a71a-954394dc6632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:51.108260 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b755d-6c27-454e-a71a-954394dc6632 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:51.257238 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1131/2233] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:50 2022] POST /identity/v3/users => generated 286 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:51.258516 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ea939-708c-4ef6-8472-8d9251523fcd admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:51.292665 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ea939-708c-4ef6-8472-8d9251523fcd admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:51.309878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2e87b-1df3-491c-9e95-73e73cdf91f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:51.310436 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2e87b-1df3-491c-9e95-73e73cdf91f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:51.310718 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2e87b-1df3-491c-9e95-73e73cdf91f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:51.310998 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2e87b-1df3-491c-9e95-73e73cdf91f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:51.311739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2e87b-1df3-491c-9e95-73e73cdf91f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:51.313608 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2e87b-1df3-491c-9e95-73e73cdf91f6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:51.362349 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1103/2234] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 00:45:51.376167 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b755d-6c27-454e-a71a-954394dc6632 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:51.392006 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:51.399801 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b755d-6c27-454e-a71a-954394dc6632 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:51.407254 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31468a6-1092-4177-a5e0-0b546a44833c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:51.408200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31468a6-1092-4177-a5e0-0b546a44833c admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:51.408741 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31468a6-1092-4177-a5e0-0b546a44833c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:51.409297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31468a6-1092-4177-a5e0-0b546a44833c admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:51.410168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31468a6-1092-4177-a5e0-0b546a44833c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:51.411997 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31468a6-1092-4177-a5e0-0b546a44833c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:51.428039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1132/2235] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:51.432738 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2e87b-1df3-491c-9e95-73e73cdf91f6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:51.451292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2e87b-1df3-491c-9e95-73e73cdf91f6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:51.458333 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5ac32-081a-4202-b35d-45be9d4d023d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:51.459142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5ac32-081a-4202-b35d-45be9d4d023d admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:51.460106 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5ac32-081a-4202-b35d-45be9d4d023d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:51.460424 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5ac32-081a-4202-b35d-45be9d4d023d admin admin] PATH_INFO: `/v3/projects/e9977cfd5a004452b89d1286a803c45e/users/fa5d9f4ea4fa4dfcac8052e6fcb76f44/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:51.496294 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5ac32-081a-4202-b35d-45be9d4d023d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9977cfd5a004452b89d1286a803c45e, user_id=fa5d9f4ea4fa4dfcac8052e6fcb76f44, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:51.502659 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5ac32-081a-4202-b35d-45be9d4d023d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:51.544389 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1104/2236] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:51 2022] PUT /identity/v3/projects/e9977cfd5a004452b89d1286a803c45e/users/fa5d9f4ea4fa4dfcac8052e6fcb76f44/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:51.549542 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813a694-7c86-462d-9e68-b98fed00fcf1 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:51.550460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813a694-7c86-462d-9e68-b98fed00fcf1 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:51.550883 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813a694-7c86-462d-9e68-b98fed00fcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:51.593591 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-0813a694-7c86-462d-9e68-b98fed00fcf1 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:51.597744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0813a694-7c86-462d-9e68-b98fed00fcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:51.793554 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1133/2237] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:45:51.809572 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5ac32-081a-4202-b35d-45be9d4d023d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:51.811646 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-adc5ac32-081a-4202-b35d-45be9d4d023d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:51.841372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5ac32-081a-4202-b35d-45be9d4d023d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:51.848848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813a694-7c86-462d-9e68-b98fed00fcf1 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:51.853381 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0813a694-7c86-462d-9e68-b98fed00fcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:51.865974 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d568f-2a96-4e95-b074-a3cecbc20f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:51.870988 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d568f-2a96-4e95-b074-a3cecbc20f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:51.874259 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d568f-2a96-4e95-b074-a3cecbc20f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:51.877361 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d568f-2a96-4e95-b074-a3cecbc20f0b admin admin] PATH_INFO: `/v3/users/01fb0f46a96e4605aa6cb05613008d88` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:51.882600 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d568f-2a96-4e95-b074-a3cecbc20f0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=01fb0f46a96e4605aa6cb05613008d88)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:51.893310 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d568f-2a96-4e95-b074-a3cecbc20f0b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:52.073532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813a694-7c86-462d-9e68-b98fed00fcf1 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:52.083540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc3ac7-ab78-4e50-8201-8266108aac0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:52.084182 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc3ac7-ab78-4e50-8201-8266108aac0d service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:52.085017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc3ac7-ab78-4e50-8201-8266108aac0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:52.085321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc3ac7-ab78-4e50-8201-8266108aac0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:52.101042 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e33d568f-2a96-4e95-b074-a3cecbc20f0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01fb0f46a96e4605aa6cb05613008d88'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:52.113806 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc3ac7-ab78-4e50-8201-8266108aac0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:52.116900 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc3ac7-ab78-4e50-8201-8266108aac0d service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:52.121300 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e33d568f-2a96-4e95-b074-a3cecbc20f0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01fb0f46a96e4605aa6cb05613008d88'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:52.124007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e33d568f-2a96-4e95-b074-a3cecbc20f0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01fb0f46a96e4605aa6cb05613008d88'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:52.125134 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e33d568f-2a96-4e95-b074-a3cecbc20f0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01fb0f46a96e4605aa6cb05613008d88'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:52.148106 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1134/2238] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:52.156495 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e33d568f-2a96-4e95-b074-a3cecbc20f0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01fb0f46a96e4605aa6cb05613008d88'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:52.226976 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1105/2239] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:51 2022] DELETE /identity/v3/users/01fb0f46a96e4605aa6cb05613008d88 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:52.227967 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d857b5-66f5-4bf5-bb6a-7b35824c482b None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:52.228260 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d857b5-66f5-4bf5-bb6a-7b35824c482b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:52.228633 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d857b5-66f5-4bf5-bb6a-7b35824c482b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:52.273929 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-59d857b5-66f5-4bf5-bb6a-7b35824c482b None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:52.281751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-59d857b5-66f5-4bf5-bb6a-7b35824c482b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:52.431074 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884da578-ff6a-4e19-ad60-2594e6dcf9d6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:52.431945 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884da578-ff6a-4e19-ad60-2594e6dcf9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:52.432396 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884da578-ff6a-4e19-ad60-2594e6dcf9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:52.458681 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1135/2240] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:52.465594 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d857b5-66f5-4bf5-bb6a-7b35824c482b None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:52.467171 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-59d857b5-66f5-4bf5-bb6a-7b35824c482b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:52.497930 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=79,keystone:DELETE=17,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:52.532875 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-884da578-ff6a-4e19-ad60-2594e6dcf9d6 None None] MFA Rules not processed for user `8361506717694758bd7759273ff892d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:52.534369 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-884da578-ff6a-4e19-ad60-2594e6dcf9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:52.602763 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:52.642313 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d857b5-66f5-4bf5-bb6a-7b35824c482b None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:52.653728 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680acfb4-21b2-4acf-9e22-be64f9fb4861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:52.655552 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680acfb4-21b2-4acf-9e22-be64f9fb4861 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:52.655986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680acfb4-21b2-4acf-9e22-be64f9fb4861 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:52.656362 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680acfb4-21b2-4acf-9e22-be64f9fb4861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:52.679836 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680acfb4-21b2-4acf-9e22-be64f9fb4861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:52.681400 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680acfb4-21b2-4acf-9e22-be64f9fb4861 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:52.707826 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1106/2241] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:52.727046 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fec624-6c46-4348-bdd9-971240848dd1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:52.727345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fec624-6c46-4348-bdd9-971240848dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:52.727613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fec624-6c46-4348-bdd9-971240848dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:52.731274 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1136/2242] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:52.765165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-22fec624-6c46-4348-bdd9-971240848dd1 None None] MFA Rules not processed for user `8361506717694758bd7759273ff892d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:52.766608 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-22fec624-6c46-4348-bdd9-971240848dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:52.791646 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1107/2243] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:52.806831 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680acfb4-21b2-4acf-9e22-be64f9fb4861 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:52.808949 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-680acfb4-21b2-4acf-9e22-be64f9fb4861 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:53.109487 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680acfb4-21b2-4acf-9e22-be64f9fb4861 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:53.143705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea445f-9c38-4a37-b4c7-b50d69218f89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:53.144293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea445f-9c38-4a37-b4c7-b50d69218f89 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:53.144560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea445f-9c38-4a37-b4c7-b50d69218f89 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:53.144834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea445f-9c38-4a37-b4c7-b50d69218f89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:53.178181 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea445f-9c38-4a37-b4c7-b50d69218f89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:53.179803 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea445f-9c38-4a37-b4c7-b50d69218f89 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:53.214978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1137/2244] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:53.447450 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fec624-6c46-4348-bdd9-971240848dd1 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:53.450492 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-22fec624-6c46-4348-bdd9-971240848dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:53.504880 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fec624-6c46-4348-bdd9-971240848dd1 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:53.539860 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b524cf-801c-43cb-ac72-fa0a6cf47b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:53.540547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b524cf-801c-43cb-ac72-fa0a6cf47b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:53.541018 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b524cf-801c-43cb-ac72-fa0a6cf47b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:53.541463 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b524cf-801c-43cb-ac72-fa0a6cf47b3c admin admin] PATH_INFO: `/v3/projects/17b1e6127d9d4a8da8cfb54863aca424` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:53.543512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b524cf-801c-43cb-ac72-fa0a6cf47b3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b1e6127d9d4a8da8cfb54863aca424)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:53.545905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b524cf-801c-43cb-ac72-fa0a6cf47b3c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:53.659414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-29b524cf-801c-43cb-ac72-fa0a6cf47b3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b1e6127d9d4a8da8cfb54863aca424', 'request_id': 'req-29b524cf-801c-43cb-ac72-fa0a6cf47b3c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:53.676207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-29b524cf-801c-43cb-ac72-fa0a6cf47b3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b1e6127d9d4a8da8cfb54863aca424', 'request_id': 'req-29b524cf-801c-43cb-ac72-fa0a6cf47b3c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:53.687807 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-29b524cf-801c-43cb-ac72-fa0a6cf47b3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b1e6127d9d4a8da8cfb54863aca424', 'request_id': 'req-29b524cf-801c-43cb-ac72-fa0a6cf47b3c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:53.705642 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-29b524cf-801c-43cb-ac72-fa0a6cf47b3c admin admin] The token cache is being invalidate because project 17b1e6127d9d4a8da8cfb54863aca424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:53.706133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-29b524cf-801c-43cb-ac72-fa0a6cf47b3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:53.708120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-29b524cf-801c-43cb-ac72-fa0a6cf47b3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:53.712319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1108/2245] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:53 2022] DELETE /identity/v3/projects/17b1e6127d9d4a8da8cfb54863aca424 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:45:53.717991 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea445f-9c38-4a37-b4c7-b50d69218f89 service nova] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:53.732496 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea445f-9c38-4a37-b4c7-b50d69218f89 service nova] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:53.858481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26474d44-11ee-4609-bb53-3cbceb1e7628 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:53.859041 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26474d44-11ee-4609-bb53-3cbceb1e7628 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:53.859572 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26474d44-11ee-4609-bb53-3cbceb1e7628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:53.958357 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d913310-e711-4b68-b710-e3de621db1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:53.962244 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d913310-e711-4b68-b710-e3de621db1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:53.967074 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d913310-e711-4b68-b710-e3de621db1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:53.968256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d913310-e711-4b68-b710-e3de621db1a0 admin admin] PATH_INFO: `/v3/users/8a59e90a9f3244049c2e96f76bc8d020` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:53.971497 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d913310-e711-4b68-b710-e3de621db1a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a59e90a9f3244049c2e96f76bc8d020)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:53.982013 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d913310-e711-4b68-b710-e3de621db1a0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:53.998116 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-26474d44-11ee-4609-bb53-3cbceb1e7628 None None] MFA Rules not processed for user `fa5d9f4ea4fa4dfcac8052e6fcb76f44`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:54.004570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-26474d44-11ee-4609-bb53-3cbceb1e7628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:54.125414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-9d913310-e711-4b68-b710-e3de621db1a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a59e90a9f3244049c2e96f76bc8d020'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:54.151992 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-9d913310-e711-4b68-b710-e3de621db1a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a59e90a9f3244049c2e96f76bc8d020'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:54.153333 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-9d913310-e711-4b68-b710-e3de621db1a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a59e90a9f3244049c2e96f76bc8d020'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:54.154818 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-9d913310-e711-4b68-b710-e3de621db1a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a59e90a9f3244049c2e96f76bc8d020'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:54.187880 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-9d913310-e711-4b68-b710-e3de621db1a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a59e90a9f3244049c2e96f76bc8d020'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:54.198993 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1109/2246] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:54.200172 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26474d44-11ee-4609-bb53-3cbceb1e7628 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:54.200548 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:54.203077 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-26474d44-11ee-4609-bb53-3cbceb1e7628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:54.225129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:54.229955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26474d44-11ee-4609-bb53-3cbceb1e7628 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:54.235674 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44640b9-42ef-42de-a166-d68ac14bc416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:54.236745 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44640b9-42ef-42de-a166-d68ac14bc416 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:54.237267 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44640b9-42ef-42de-a166-d68ac14bc416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:54.238279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44640b9-42ef-42de-a166-d68ac14bc416 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:54.239360 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44640b9-42ef-42de-a166-d68ac14bc416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:54.243065 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44640b9-42ef-42de-a166-d68ac14bc416 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:54.250151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1138/2247] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:53 2022] DELETE /identity/v3/users/8a59e90a9f3244049c2e96f76bc8d020 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:54.309325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1110/2248] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:54 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:54.314374 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d913310-e711-4b68-b710-e3de621db1a0 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:54.478805 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d913310-e711-4b68-b710-e3de621db1a0 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:54.580374 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435256a-19d6-463c-8556-a00ea6e50ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:54.581000 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435256a-19d6-463c-8556-a00ea6e50ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:54.581319 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435256a-19d6-463c-8556-a00ea6e50ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:54.585796 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435256a-19d6-463c-8556-a00ea6e50ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:54.586531 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435256a-19d6-463c-8556-a00ea6e50ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:54.588573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435256a-19d6-463c-8556-a00ea6e50ee9 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:54.638036 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1139/2249] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:54 2022] POST /identity/v3/users => generated 293 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:54.641987 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44640b9-42ef-42de-a166-d68ac14bc416 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:54.657263 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44640b9-42ef-42de-a166-d68ac14bc416 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:54.667410 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddea1c7-2ce8-4bcd-9356-138c6ce31e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:54.668812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddea1c7-2ce8-4bcd-9356-138c6ce31e24 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:54.669269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddea1c7-2ce8-4bcd-9356-138c6ce31e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:54.670926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddea1c7-2ce8-4bcd-9356-138c6ce31e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:54.672346 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddea1c7-2ce8-4bcd-9356-138c6ce31e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:54.674213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddea1c7-2ce8-4bcd-9356-138c6ce31e24 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:54.698719 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1111/2250] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:54.703255 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435256a-19d6-463c-8556-a00ea6e50ee9 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:54.743248 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435256a-19d6-463c-8556-a00ea6e50ee9 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:54.753980 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151830b-ea16-4d4c-800c-56336432c219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:54.754727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151830b-ea16-4d4c-800c-56336432c219 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:54.755010 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151830b-ea16-4d4c-800c-56336432c219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:54.755340 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151830b-ea16-4d4c-800c-56336432c219 admin admin] PATH_INFO: `/v3/projects/953af303e8b0451abf48d688e71ccb3b/users/7116156146354746bb78d13794315eaa/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:54.779078 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddea1c7-2ce8-4bcd-9356-138c6ce31e24 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:54.780940 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-bddea1c7-2ce8-4bcd-9356-138c6ce31e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:54.794263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151830b-ea16-4d4c-800c-56336432c219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=953af303e8b0451abf48d688e71ccb3b, user_id=7116156146354746bb78d13794315eaa, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:54.797173 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151830b-ea16-4d4c-800c-56336432c219 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:54.811935 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddea1c7-2ce8-4bcd-9356-138c6ce31e24 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:54.820332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13d05e-0e15-4136-91b4-50be6c2fddff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:54.826385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13d05e-0e15-4136-91b4-50be6c2fddff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:54.826747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13d05e-0e15-4136-91b4-50be6c2fddff admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:54.827186 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13d05e-0e15-4136-91b4-50be6c2fddff admin admin] PATH_INFO: `/v3/projects/c2d81eea048e457e90f731df4e2f9530` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:54.839597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13d05e-0e15-4136-91b4-50be6c2fddff admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2d81eea048e457e90f731df4e2f9530)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:54.843131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13d05e-0e15-4136-91b4-50be6c2fddff admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:54.862617 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1140/2251] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:54 2022] PUT /identity/v3/projects/953af303e8b0451abf48d688e71ccb3b/users/7116156146354746bb78d13794315eaa/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:54.867234 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151830b-ea16-4d4c-800c-56336432c219 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:54.980692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7d13d05e-0e15-4136-91b4-50be6c2fddff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2d81eea048e457e90f731df4e2f9530', 'request_id': 'req-7d13d05e-0e15-4136-91b4-50be6c2fddff'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:54.996037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7d13d05e-0e15-4136-91b4-50be6c2fddff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2d81eea048e457e90f731df4e2f9530', 'request_id': 'req-7d13d05e-0e15-4136-91b4-50be6c2fddff'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:55.009535 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7d13d05e-0e15-4136-91b4-50be6c2fddff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2d81eea048e457e90f731df4e2f9530', 'request_id': 'req-7d13d05e-0e15-4136-91b4-50be6c2fddff'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:55.043134 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7d13d05e-0e15-4136-91b4-50be6c2fddff admin admin] The token cache is being invalidate because project c2d81eea048e457e90f731df4e2f9530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:55.043620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7d13d05e-0e15-4136-91b4-50be6c2fddff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:55.045466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7d13d05e-0e15-4136-91b4-50be6c2fddff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:55.049382 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1112/2252] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:54 2022] DELETE /identity/v3/projects/c2d81eea048e457e90f731df4e2f9530 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:55.053740 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:55.055172 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38be479-c2e8-4ac5-9aed-ca0265dacd73 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:55.055627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38be479-c2e8-4ac5-9aed-ca0265dacd73 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:55.057546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38be479-c2e8-4ac5-9aed-ca0265dacd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:55.069702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151830b-ea16-4d4c-800c-56336432c219 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:55.102073 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c38be479-c2e8-4ac5-9aed-ca0265dacd73 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:55.103571 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c38be479-c2e8-4ac5-9aed-ca0265dacd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:55.193785 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84179ea-a7b3-4dd5-ac72-4c7725823568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:55.194550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84179ea-a7b3-4dd5-ac72-4c7725823568 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:55.194866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84179ea-a7b3-4dd5-ac72-4c7725823568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:55.195404 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84179ea-a7b3-4dd5-ac72-4c7725823568 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:55.196061 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84179ea-a7b3-4dd5-ac72-4c7725823568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:55.197702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84179ea-a7b3-4dd5-ac72-4c7725823568 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:55.214927 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1141/2253] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 00:45:55.215800 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84179ea-a7b3-4dd5-ac72-4c7725823568 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:55.217632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f84179ea-a7b3-4dd5-ac72-4c7725823568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:55.235866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84179ea-a7b3-4dd5-ac72-4c7725823568 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:55.241368 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4410445-67fb-4e51-bbec-403076cf4b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:55.242266 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4410445-67fb-4e51-bbec-403076cf4b19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:55.242606 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4410445-67fb-4e51-bbec-403076cf4b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:55.243824 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1113/2254] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:55.251925 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a13609-07d1-4baa-a5f0-67ab5bd0edab None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:55.252084 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4410445-67fb-4e51-bbec-403076cf4b19 admin admin] PATH_INFO: `/v3/projects/953af303e8b0451abf48d688e71ccb3b/users/7116156146354746bb78d13794315eaa/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:55.252477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a13609-07d1-4baa-a5f0-67ab5bd0edab None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:55.252571 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a13609-07d1-4baa-a5f0-67ab5bd0edab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:55.262705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4410445-67fb-4e51-bbec-403076cf4b19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=953af303e8b0451abf48d688e71ccb3b, user_id=7116156146354746bb78d13794315eaa, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:55.265958 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4410445-67fb-4e51-bbec-403076cf4b19 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:55.289898 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d3a13609-07d1-4baa-a5f0-67ab5bd0edab None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:55.291127 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d3a13609-07d1-4baa-a5f0-67ab5bd0edab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:55.292600 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1142/2255] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:55 2022] PUT /identity/v3/projects/953af303e8b0451abf48d688e71ccb3b/users/7116156146354746bb78d13794315eaa/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:55.411340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:55.449665 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1114/2256] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:55.453614 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4410445-67fb-4e51-bbec-403076cf4b19 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:55.490669 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4410445-67fb-4e51-bbec-403076cf4b19 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:55.517978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3d02e-e5b6-43e4-9961-88ebc262ef06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:55.520759 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3d02e-e5b6-43e4-9961-88ebc262ef06 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:55.521107 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3d02e-e5b6-43e4-9961-88ebc262ef06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:55.524218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3d02e-e5b6-43e4-9961-88ebc262ef06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:55.524937 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3d02e-e5b6-43e4-9961-88ebc262ef06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:45:55.525283 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3d02e-e5b6-43e4-9961-88ebc262ef06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:55.531401 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3d02e-e5b6-43e4-9961-88ebc262ef06 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:55.573973 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1143/2257] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:45:55.575846 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a13609-07d1-4baa-a5f0-67ab5bd0edab None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:55.596433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a13609-07d1-4baa-a5f0-67ab5bd0edab None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:55.607729 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c60ec-149f-4f19-a5eb-7033c7ec34e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:55.608529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c60ec-149f-4f19-a5eb-7033c7ec34e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:55.608964 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c60ec-149f-4f19-a5eb-7033c7ec34e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:55.609428 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c60ec-149f-4f19-a5eb-7033c7ec34e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:55.612038 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c60ec-149f-4f19-a5eb-7033c7ec34e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:55.614164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c60ec-149f-4f19-a5eb-7033c7ec34e6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:55.674131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1115/2258] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:55 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:55.680771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3d02e-e5b6-43e4-9961-88ebc262ef06 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:55.703568 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3d02e-e5b6-43e4-9961-88ebc262ef06 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:55.752484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c60ec-149f-4f19-a5eb-7033c7ec34e6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:55.754691 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-821c60ec-149f-4f19-a5eb-7033c7ec34e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:55.785789 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f35b4-dcf2-43d8-a51c-a3720f191d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:55.789099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f35b4-dcf2-43d8-a51c-a3720f191d31 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:55.789394 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f35b4-dcf2-43d8-a51c-a3720f191d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:55.789671 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f35b4-dcf2-43d8-a51c-a3720f191d31 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:55.790381 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f35b4-dcf2-43d8-a51c-a3720f191d31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:55.796544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f35b4-dcf2-43d8-a51c-a3720f191d31 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:55.848151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1144/2259] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:45:55 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:45:55.854548 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f35b4-dcf2-43d8-a51c-a3720f191d31 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:55.877003 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f35b4-dcf2-43d8-a51c-a3720f191d31 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:55.889618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b532087-edb4-4d50-a242-995016a6c567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:55.890377 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b532087-edb4-4d50-a242-995016a6c567 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:55.890735 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b532087-edb4-4d50-a242-995016a6c567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:55.891080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b532087-edb4-4d50-a242-995016a6c567 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:55.891802 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b532087-edb4-4d50-a242-995016a6c567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:55.893595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b532087-edb4-4d50-a242-995016a6c567 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:55.916920 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1145/2260] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:55.920841 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b532087-edb4-4d50-a242-995016a6c567 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:55.952372 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b532087-edb4-4d50-a242-995016a6c567 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:55.956640 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c60ec-149f-4f19-a5eb-7033c7ec34e6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:55.966819 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b20e52-7bc1-41c2-bb3b-9eedf03facfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:55.967658 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b20e52-7bc1-41c2-bb3b-9eedf03facfa admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:55.968191 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08355add-9d2d-47d6-a09a-41ed53d454c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:55.968454 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b20e52-7bc1-41c2-bb3b-9eedf03facfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:55.968872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b20e52-7bc1-41c2-bb3b-9eedf03facfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:55.969064 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08355add-9d2d-47d6-a09a-41ed53d454c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:55.969853 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b20e52-7bc1-41c2-bb3b-9eedf03facfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:55.970671 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08355add-9d2d-47d6-a09a-41ed53d454c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:55.971345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08355add-9d2d-47d6-a09a-41ed53d454c7 admin admin] PATH_INFO: `/v3/users/d146cf212b0a4cad9f361a6716ee82e4` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:55.973429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08355add-9d2d-47d6-a09a-41ed53d454c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d146cf212b0a4cad9f361a6716ee82e4)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:55.973799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b20e52-7bc1-41c2-bb3b-9eedf03facfa admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:55.975861 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08355add-9d2d-47d6-a09a-41ed53d454c7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:55.993821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1146/2261] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:45:55.997765 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b20e52-7bc1-41c2-bb3b-9eedf03facfa admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:56.015170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b20e52-7bc1-41c2-bb3b-9eedf03facfa admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:56.023044 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83008fb1-32a1-4d88-98fc-f465d2b758b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:56.024301 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83008fb1-32a1-4d88-98fc-f465d2b758b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:56.030255 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83008fb1-32a1-4d88-98fc-f465d2b758b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:56.030708 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83008fb1-32a1-4d88-98fc-f465d2b758b4 admin admin] PATH_INFO: `/v3/projects/445d874ba65d470b9cd2a5052f66f3a1/users/443c9423661c48bb9c24925019818d40/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:56.050841 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83008fb1-32a1-4d88-98fc-f465d2b758b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=445d874ba65d470b9cd2a5052f66f3a1, user_id=443c9423661c48bb9c24925019818d40, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:56.056870 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83008fb1-32a1-4d88-98fc-f465d2b758b4 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:56.088900 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1147/2262] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:45:55 2022] PUT /identity/v3/projects/445d874ba65d470b9cd2a5052f66f3a1/users/443c9423661c48bb9c24925019818d40/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:56.100420 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bc9e2-9fcd-4e2e-b0e3-1208efbac19b None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:56.100998 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bc9e2-9fcd-4e2e-b0e3-1208efbac19b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:56.101545 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bc9e2-9fcd-4e2e-b0e3-1208efbac19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:56.177694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-08355add-9d2d-47d6-a09a-41ed53d454c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd146cf212b0a4cad9f361a6716ee82e4'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:56.191796 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-08355add-9d2d-47d6-a09a-41ed53d454c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd146cf212b0a4cad9f361a6716ee82e4'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:56.196758 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-055bc9e2-9fcd-4e2e-b0e3-1208efbac19b None None] MFA Rules not processed for user `443c9423661c48bb9c24925019818d40`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:56.197057 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-08355add-9d2d-47d6-a09a-41ed53d454c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd146cf212b0a4cad9f361a6716ee82e4'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:56.198174 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-055bc9e2-9fcd-4e2e-b0e3-1208efbac19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:56.198753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-08355add-9d2d-47d6-a09a-41ed53d454c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd146cf212b0a4cad9f361a6716ee82e4'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:56.205188 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:56.234722 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-08355add-9d2d-47d6-a09a-41ed53d454c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd146cf212b0a4cad9f361a6716ee82e4'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:56.300214 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1116/2263] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:55 2022] DELETE /identity/v3/users/d146cf212b0a4cad9f361a6716ee82e4 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:56.301998 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46349b-35c1-44aa-988f-18b4390c7c89 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:56.302402 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46349b-35c1-44aa-988f-18b4390c7c89 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:56.302802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46349b-35c1-44aa-988f-18b4390c7c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:56.357546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-eb46349b-35c1-44aa-988f-18b4390c7c89 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:56.358527 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1148/2264] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:56.362989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-eb46349b-35c1-44aa-988f-18b4390c7c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:56.376230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bc9e2-9fcd-4e2e-b0e3-1208efbac19b None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:56.378115 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-055bc9e2-9fcd-4e2e-b0e3-1208efbac19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:56.456336 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:56.485695 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bc9e2-9fcd-4e2e-b0e3-1208efbac19b None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:56.514209 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1117/2265] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:56.520092 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46349b-35c1-44aa-988f-18b4390c7c89 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:56.521593 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-eb46349b-35c1-44aa-988f-18b4390c7c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:56.598943 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fc8e7-5a35-44bf-88a4-86320846efeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:56.600831 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fc8e7-5a35-44bf-88a4-86320846efeb service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:56.601174 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fc8e7-5a35-44bf-88a4-86320846efeb service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:56.602051 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fc8e7-5a35-44bf-88a4-86320846efeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:56.689883 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46349b-35c1-44aa-988f-18b4390c7c89 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:56.700753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957a757-031c-463c-811e-6e3da083fb5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:56.702764 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957a757-031c-463c-811e-6e3da083fb5e service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:56.703056 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957a757-031c-463c-811e-6e3da083fb5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:56.703335 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957a757-031c-463c-811e-6e3da083fb5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:56.748579 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957a757-031c-463c-811e-6e3da083fb5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:56.751827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957a757-031c-463c-811e-6e3da083fb5e service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:56.779869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1118/2266] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:56.788090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669ce95-d33e-4f42-be5f-a4a3b9e0da7f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:56.788381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669ce95-d33e-4f42-be5f-a4a3b9e0da7f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:56.789227 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669ce95-d33e-4f42-be5f-a4a3b9e0da7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:56.801811 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fc8e7-5a35-44bf-88a4-86320846efeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:56.807308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0fc8e7-5a35-44bf-88a4-86320846efeb service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:56.830634 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1149/2267] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:56.859695 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fc8e7-5a35-44bf-88a4-86320846efeb service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:56.861819 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-bb0fc8e7-5a35-44bf-88a4-86320846efeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:56.872000 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8669ce95-d33e-4f42-be5f-a4a3b9e0da7f None None] MFA Rules not processed for user `7116156146354746bb78d13794315eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:56.874020 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8669ce95-d33e-4f42-be5f-a4a3b9e0da7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:56.909927 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0fc8e7-5a35-44bf-88a4-86320846efeb service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:56.933965 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf19c7c-4528-4177-b697-41d52a3fe9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:56.935837 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf19c7c-4528-4177-b697-41d52a3fe9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:56.936367 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf19c7c-4528-4177-b697-41d52a3fe9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:56.936868 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf19c7c-4528-4177-b697-41d52a3fe9e2 admin admin] PATH_INFO: `/v3/users/443c9423661c48bb9c24925019818d40` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:56.939819 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf19c7c-4528-4177-b697-41d52a3fe9e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=443c9423661c48bb9c24925019818d40)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:56.944452 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf19c7c-4528-4177-b697-41d52a3fe9e2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:56.992243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:57.106423 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7cf19c7c-4528-4177-b697-41d52a3fe9e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '443c9423661c48bb9c24925019818d40'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:57.138560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7cf19c7c-4528-4177-b697-41d52a3fe9e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '443c9423661c48bb9c24925019818d40'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:57.144352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7cf19c7c-4528-4177-b697-41d52a3fe9e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '443c9423661c48bb9c24925019818d40'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:57.156732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7cf19c7c-4528-4177-b697-41d52a3fe9e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '443c9423661c48bb9c24925019818d40'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:57.168079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7cf19c7c-4528-4177-b697-41d52a3fe9e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '443c9423661c48bb9c24925019818d40'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:57.202879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1119/2268] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:57.219670 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01fa81-25a5-4625-942b-e5d9fd299079 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:57.219869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01fa81-25a5-4625-942b-e5d9fd299079 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:57.220166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01fa81-25a5-4625-942b-e5d9fd299079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:57.220635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1150/2269] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:56 2022] DELETE /identity/v3/users/443c9423661c48bb9c24925019818d40 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:57.224020 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee872987-980a-4616-8565-456bc0e1519a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:57.225068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee872987-980a-4616-8565-456bc0e1519a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:57.225690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee872987-980a-4616-8565-456bc0e1519a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:57.302853 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9f01fa81-25a5-4625-942b-e5d9fd299079 None None] MFA Rules not processed for user `fa5d9f4ea4fa4dfcac8052e6fcb76f44`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:57.326594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9f01fa81-25a5-4625-942b-e5d9fd299079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:57.331897 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ee872987-980a-4616-8565-456bc0e1519a None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:57.335898 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ee872987-980a-4616-8565-456bc0e1519a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:57.586042 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1151/2270] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:45:57.649450 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1120/2271] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:57.658983 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee872987-980a-4616-8565-456bc0e1519a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:57.660801 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ee872987-980a-4616-8565-456bc0e1519a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:57.705854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01fa81-25a5-4625-942b-e5d9fd299079 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:57.715133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9f01fa81-25a5-4625-942b-e5d9fd299079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:57.817898 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:57.876159 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01fa81-25a5-4625-942b-e5d9fd299079 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:57.877460 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee872987-980a-4616-8565-456bc0e1519a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:57.881998 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6cc73c-82f6-41a1-bbb9-18c8aad44a0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:57.882701 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cc73c-82f6-41a1-bbb9-18c8aad44a0b service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:57.882983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cc73c-82f6-41a1-bbb9-18c8aad44a0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:57.883264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cc73c-82f6-41a1-bbb9-18c8aad44a0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:57.895152 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f1bcf-4d25-4c19-b083-c1bc01e76c4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:57.895514 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6cc73c-82f6-41a1-bbb9-18c8aad44a0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:57.897173 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f1bcf-4d25-4c19-b083-c1bc01e76c4b service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:57.897345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6cc73c-82f6-41a1-bbb9-18c8aad44a0b service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:57.898825 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f1bcf-4d25-4c19-b083-c1bc01e76c4b service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:57.899213 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f1bcf-4d25-4c19-b083-c1bc01e76c4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:57.904804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d40f1bcf-4d25-4c19-b083-c1bc01e76c4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:57.910092 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1121/2272] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:57.935332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f1bcf-4d25-4c19-b083-c1bc01e76c4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:57.936983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6cc73c-82f6-41a1-bbb9-18c8aad44a0b service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:57.938343 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f1bcf-4d25-4c19-b083-c1bc01e76c4b service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:57.940632 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ce6cc73c-82f6-41a1-bbb9-18c8aad44a0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:57.986917 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1152/2273] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:45:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:45:57.988236 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6cc73c-82f6-41a1-bbb9-18c8aad44a0b service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:58.009923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7228ea-a0ce-4cc1-8aa4-5a7ae118020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:58.012407 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7228ea-a0ce-4cc1-8aa4-5a7ae118020b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:58.013425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7228ea-a0ce-4cc1-8aa4-5a7ae118020b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:58.013951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7228ea-a0ce-4cc1-8aa4-5a7ae118020b admin admin] PATH_INFO: `/v3/projects/b9863436544346db927f9124ed697008` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:58.015331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7228ea-a0ce-4cc1-8aa4-5a7ae118020b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9863436544346db927f9124ed697008)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:58.018988 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7228ea-a0ce-4cc1-8aa4-5a7ae118020b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:58.126874 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6c7228ea-a0ce-4cc1-8aa4-5a7ae118020b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9863436544346db927f9124ed697008', 'request_id': 'req-6c7228ea-a0ce-4cc1-8aa4-5a7ae118020b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:58.167409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6c7228ea-a0ce-4cc1-8aa4-5a7ae118020b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9863436544346db927f9124ed697008', 'request_id': 'req-6c7228ea-a0ce-4cc1-8aa4-5a7ae118020b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:58.178489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6c7228ea-a0ce-4cc1-8aa4-5a7ae118020b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9863436544346db927f9124ed697008', 'request_id': 'req-6c7228ea-a0ce-4cc1-8aa4-5a7ae118020b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:58.202997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6c7228ea-a0ce-4cc1-8aa4-5a7ae118020b admin admin] The token cache is being invalidate because project b9863436544346db927f9124ed697008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:58.202997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6c7228ea-a0ce-4cc1-8aa4-5a7ae118020b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:58.204189 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6c7228ea-a0ce-4cc1-8aa4-5a7ae118020b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:58.206255 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1122/2274] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:57 2022] DELETE /identity/v3/projects/b9863436544346db927f9124ed697008 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:58.210722 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f1bcf-4d25-4c19-b083-c1bc01e76c4b service nova] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:58.229360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f1bcf-4d25-4c19-b083-c1bc01e76c4b service nova] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:58.311161 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:58.572467 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca295722-0568-4588-9609-f489f1e3cca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:58.573377 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca295722-0568-4588-9609-f489f1e3cca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:58.573662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca295722-0568-4588-9609-f489f1e3cca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:58.573945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca295722-0568-4588-9609-f489f1e3cca5 admin admin] PATH_INFO: `/v3/users/5f5ef20656b248eca51afc4befdfee7e` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:58.575201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca295722-0568-4588-9609-f489f1e3cca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f5ef20656b248eca51afc4befdfee7e)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:58.579697 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca295722-0568-4588-9609-f489f1e3cca5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:58.729647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-ca295722-0568-4588-9609-f489f1e3cca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f5ef20656b248eca51afc4befdfee7e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:58.747999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-ca295722-0568-4588-9609-f489f1e3cca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f5ef20656b248eca51afc4befdfee7e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:58.748695 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-ca295722-0568-4588-9609-f489f1e3cca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f5ef20656b248eca51afc4befdfee7e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:58.749373 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-ca295722-0568-4588-9609-f489f1e3cca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f5ef20656b248eca51afc4befdfee7e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:58.759161 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-ca295722-0568-4588-9609-f489f1e3cca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f5ef20656b248eca51afc4befdfee7e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:58.868159 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1153/2275] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:45:58 2022] DELETE /identity/v3/users/5f5ef20656b248eca51afc4befdfee7e => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:58.914877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7228ea-a0ce-4cc1-8aa4-5a7ae118020b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:58.916499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6c7228ea-a0ce-4cc1-8aa4-5a7ae118020b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:58.951537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7228ea-a0ce-4cc1-8aa4-5a7ae118020b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:59.127168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab96339-c1f4-4217-bd3c-34be0eda19d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:59.128861 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab96339-c1f4-4217-bd3c-34be0eda19d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:59.128861 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab96339-c1f4-4217-bd3c-34be0eda19d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:59.129732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab96339-c1f4-4217-bd3c-34be0eda19d2 admin admin] PATH_INFO: `/v3/projects/445d874ba65d470b9cd2a5052f66f3a1` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:59.132237 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab96339-c1f4-4217-bd3c-34be0eda19d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=445d874ba65d470b9cd2a5052f66f3a1)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:59.134547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab96339-c1f4-4217-bd3c-34be0eda19d2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:59.263969 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f7e09-441f-44d1-a322-c33363b87526 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:59.264632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f7e09-441f-44d1-a322-c33363b87526 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:59.264632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f7e09-441f-44d1-a322-c33363b87526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:59.273208 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0ab96339-c1f4-4217-bd3c-34be0eda19d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '445d874ba65d470b9cd2a5052f66f3a1', 'request_id': 'req-0ab96339-c1f4-4217-bd3c-34be0eda19d2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:59.281258 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:45:59.295083 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0ab96339-c1f4-4217-bd3c-34be0eda19d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '445d874ba65d470b9cd2a5052f66f3a1', 'request_id': 'req-0ab96339-c1f4-4217-bd3c-34be0eda19d2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:59.301684 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-359f7e09-441f-44d1-a322-c33363b87526 None None] MFA Rules not processed for user `8361506717694758bd7759273ff892d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:59.303719 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-359f7e09-441f-44d1-a322-c33363b87526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:59.312295 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0ab96339-c1f4-4217-bd3c-34be0eda19d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '445d874ba65d470b9cd2a5052f66f3a1', 'request_id': 'req-0ab96339-c1f4-4217-bd3c-34be0eda19d2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:59.339318 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0ab96339-c1f4-4217-bd3c-34be0eda19d2 admin admin] The token cache is being invalidate because project 445d874ba65d470b9cd2a5052f66f3a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:45:59.342536 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0ab96339-c1f4-4217-bd3c-34be0eda19d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:59.343790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0ab96339-c1f4-4217-bd3c-34be0eda19d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:45:59.382930 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1123/2276] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:58 2022] DELETE /identity/v3/projects/445d874ba65d470b9cd2a5052f66f3a1 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:45:59.391548 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c0187-3bcb-4fbc-b707-6a60bd110be4 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:59.392935 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c0187-3bcb-4fbc-b707-6a60bd110be4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:59.394550 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c0187-3bcb-4fbc-b707-6a60bd110be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:59.467464 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-473c0187-3bcb-4fbc-b707-6a60bd110be4 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:59.472115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-473c0187-3bcb-4fbc-b707-6a60bd110be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:59.495378 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1154/2277] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:45:59.763714 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1124/2278] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:45:59.772878 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8466f6e-0336-4fef-a89c-ddb7a27a45fe None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:59.773490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8466f6e-0336-4fef-a89c-ddb7a27a45fe None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:59.773909 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8466f6e-0336-4fef-a89c-ddb7a27a45fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:59.826257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-c8466f6e-0336-4fef-a89c-ddb7a27a45fe None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:45:59.827471 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c8466f6e-0336-4fef-a89c-ddb7a27a45fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:59.859274 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1155/2279] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:45:59.860370 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c0187-3bcb-4fbc-b707-6a60bd110be4 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:59.860370 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-473c0187-3bcb-4fbc-b707-6a60bd110be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:45:59.860702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8466f6e-0336-4fef-a89c-ddb7a27a45fe None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:59.884376 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8466f6e-0336-4fef-a89c-ddb7a27a45fe None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:59.898886 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c0187-3bcb-4fbc-b707-6a60bd110be4 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:45:59.906158 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0383bd-97d7-4177-a781-a9500f9ee98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:59.906824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0383bd-97d7-4177-a781-a9500f9ee98d admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:59.907051 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0383bd-97d7-4177-a781-a9500f9ee98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:59.907327 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0383bd-97d7-4177-a781-a9500f9ee98d admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:59.910999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0383bd-97d7-4177-a781-a9500f9ee98d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:45:59.910999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0383bd-97d7-4177-a781-a9500f9ee98d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:59.910999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0383bd-97d7-4177-a781-a9500f9ee98d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:59.919749 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ed4ff-2477-4bfc-bb2f-e597e2e071ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:45:59.920713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ed4ff-2477-4bfc-bb2f-e597e2e071ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:45:59.921293 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ed4ff-2477-4bfc-bb2f-e597e2e071ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:45:59.921758 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ed4ff-2477-4bfc-bb2f-e597e2e071ce admin admin] PATH_INFO: `/v3/projects/f3ca2845f4964987a67cd224924624f9` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:45:59.923212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ed4ff-2477-4bfc-bb2f-e597e2e071ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3ca2845f4964987a67cd224924624f9)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:45:59.925863 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ed4ff-2477-4bfc-bb2f-e597e2e071ce admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:45:59.957511 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1156/2280] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:45:59.962678 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0383bd-97d7-4177-a781-a9500f9ee98d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:45:59.982556 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0383bd-97d7-4177-a781-a9500f9ee98d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:00.015836 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:00.038231 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0b6ed4ff-2477-4bfc-bb2f-e597e2e071ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3ca2845f4964987a67cd224924624f9', 'request_id': 'req-0b6ed4ff-2477-4bfc-bb2f-e597e2e071ce'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:00.057511 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0b6ed4ff-2477-4bfc-bb2f-e597e2e071ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3ca2845f4964987a67cd224924624f9', 'request_id': 'req-0b6ed4ff-2477-4bfc-bb2f-e597e2e071ce'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:00.083097 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0b6ed4ff-2477-4bfc-bb2f-e597e2e071ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3ca2845f4964987a67cd224924624f9', 'request_id': 'req-0b6ed4ff-2477-4bfc-bb2f-e597e2e071ce'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:00.162487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0b6ed4ff-2477-4bfc-bb2f-e597e2e071ce admin admin] The token cache is being invalidate because project f3ca2845f4964987a67cd224924624f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:46:00.162995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0b6ed4ff-2477-4bfc-bb2f-e597e2e071ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:00.166199 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-0b6ed4ff-2477-4bfc-bb2f-e597e2e071ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:00.172576 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1125/2281] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:45:59 2022] DELETE /identity/v3/projects/f3ca2845f4964987a67cd224924624f9 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:00.177996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c299d8-1ed4-4ed5-85bb-fd34b663b130 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:00.178765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c299d8-1ed4-4ed5-85bb-fd34b663b130 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:00.179040 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c299d8-1ed4-4ed5-85bb-fd34b663b130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:00.200963 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524ce67-a62d-4fa0-bbcb-a5e6100f5883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:00.201628 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524ce67-a62d-4fa0-bbcb-a5e6100f5883 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:00.201906 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524ce67-a62d-4fa0-bbcb-a5e6100f5883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:00.202177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524ce67-a62d-4fa0-bbcb-a5e6100f5883 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:00.209564 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524ce67-a62d-4fa0-bbcb-a5e6100f5883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:00.220192 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524ce67-a62d-4fa0-bbcb-a5e6100f5883 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:00.258749 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e2c299d8-1ed4-4ed5-85bb-fd34b663b130 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:00.263360 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e2c299d8-1ed4-4ed5-85bb-fd34b663b130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:00.300272 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1157/2282] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:45:59 2022] POST /identity/v3/projects => generated 361 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:46:00.304598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524ce67-a62d-4fa0-bbcb-a5e6100f5883 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:00.306834 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1126/2283] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:00.312950 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16928fe-aaff-494d-862e-ff6f674523b8 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:00.326429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1524ce67-a62d-4fa0-bbcb-a5e6100f5883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:00.353333 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16928fe-aaff-494d-862e-ff6f674523b8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:00.353666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16928fe-aaff-494d-862e-ff6f674523b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:00.478620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d16928fe-aaff-494d-862e-ff6f674523b8 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:00.482458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d16928fe-aaff-494d-862e-ff6f674523b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:00.543000 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524ce67-a62d-4fa0-bbcb-a5e6100f5883 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:00.561359 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43f967-2a79-4df4-b8d1-373b768180c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:00.562257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43f967-2a79-4df4-b8d1-373b768180c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:00.562431 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43f967-2a79-4df4-b8d1-373b768180c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:00.562749 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43f967-2a79-4df4-b8d1-373b768180c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:00.563412 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43f967-2a79-4df4-b8d1-373b768180c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:00.565670 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43f967-2a79-4df4-b8d1-373b768180c3 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:00.645524 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1158/2284] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:46:00 2022] POST /identity/v3/users => generated 281 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:00.646494 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43f967-2a79-4df4-b8d1-373b768180c3 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:00.661305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:00.675698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1127/2285] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:00.683997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16928fe-aaff-494d-862e-ff6f674523b8 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:00.684190 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43f967-2a79-4df4-b8d1-373b768180c3 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:00.694464 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16928fe-aaff-494d-862e-ff6f674523b8 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:00.704349 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3496a-62a6-4dda-b891-ce2e52632a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:00.705289 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3496a-62a6-4dda-b891-ce2e52632a5c admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:00.705732 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3496a-62a6-4dda-b891-ce2e52632a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:00.706161 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3496a-62a6-4dda-b891-ce2e52632a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:00.706959 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3496a-62a6-4dda-b891-ce2e52632a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:00.710319 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3496a-62a6-4dda-b891-ce2e52632a5c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:00.721862 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde58503-3f86-400c-beac-32929cc0e8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:00.726340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde58503-3f86-400c-beac-32929cc0e8ce admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:00.726664 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde58503-3f86-400c-beac-32929cc0e8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:00.727447 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde58503-3f86-400c-beac-32929cc0e8ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:00.729628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde58503-3f86-400c-beac-32929cc0e8ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:46:00.729942 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde58503-3f86-400c-beac-32929cc0e8ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:00.731616 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde58503-3f86-400c-beac-32929cc0e8ce admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:00.759547 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1159/2286] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:00.760517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3496a-62a6-4dda-b891-ce2e52632a5c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:00.785552 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1128/2287] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:46:00.788812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde58503-3f86-400c-beac-32929cc0e8ce admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:00.790265 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3496a-62a6-4dda-b891-ce2e52632a5c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:00.813963 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfd8e0-4737-4e92-af12-edfc8797d04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:00.814589 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfd8e0-4737-4e92-af12-edfc8797d04e admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:00.814869 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfd8e0-4737-4e92-af12-edfc8797d04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:00.815142 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfd8e0-4737-4e92-af12-edfc8797d04e admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:00.815851 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cfd8e0-4737-4e92-af12-edfc8797d04e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:00.817853 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cfd8e0-4737-4e92-af12-edfc8797d04e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:00.827183 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde58503-3f86-400c-beac-32929cc0e8ce admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:00.843895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13197fc-7260-4d85-82ed-856631b07af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:00.847065 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1160/2288] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:00.851227 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13197fc-7260-4d85-82ed-856631b07af3 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:00.851540 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13197fc-7260-4d85-82ed-856631b07af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:00.851912 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13197fc-7260-4d85-82ed-856631b07af3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:00.852726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13197fc-7260-4d85-82ed-856631b07af3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:00.853559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfd8e0-4737-4e92-af12-edfc8797d04e admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:00.854722 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13197fc-7260-4d85-82ed-856631b07af3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:00.869295 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfd8e0-4737-4e92-af12-edfc8797d04e admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:00.875217 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75922d3-1f6b-463a-ba2a-c12c4cf8aadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:00.890126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75922d3-1f6b-463a-ba2a-c12c4cf8aadd admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:00.890126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75922d3-1f6b-463a-ba2a-c12c4cf8aadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:00.890126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75922d3-1f6b-463a-ba2a-c12c4cf8aadd admin admin] PATH_INFO: `/v3/projects/5cd5e1f738934ec4824c19fd4f351e3c/users/ebfde1eb5bb94f88b381109cbfec448b/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:00.898375 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75922d3-1f6b-463a-ba2a-c12c4cf8aadd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd5e1f738934ec4824c19fd4f351e3c, user_id=ebfde1eb5bb94f88b381109cbfec448b, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:00.902992 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75922d3-1f6b-463a-ba2a-c12c4cf8aadd admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:00.933403 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1129/2289] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:46:00 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:00.936353 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13197fc-7260-4d85-82ed-856631b07af3 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:00.945241 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1161/2290] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:46:00 2022] PUT /identity/v3/projects/5cd5e1f738934ec4824c19fd4f351e3c/users/ebfde1eb5bb94f88b381109cbfec448b/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:46:00.946499 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b63ed2-9758-4e1a-bc87-811aa910e16f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:00.946802 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b63ed2-9758-4e1a-bc87-811aa910e16f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:00.947040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b63ed2-9758-4e1a-bc87-811aa910e16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:01.002289 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-01b63ed2-9758-4e1a-bc87-811aa910e16f None None] MFA Rules not processed for user `ebfde1eb5bb94f88b381109cbfec448b`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:01.003519 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-01b63ed2-9758-4e1a-bc87-811aa910e16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:01.053930 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13197fc-7260-4d85-82ed-856631b07af3 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:01.072951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e6681-0b3c-40f6-bc0d-b2ecad9b6234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:01.073598 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e6681-0b3c-40f6-bc0d-b2ecad9b6234 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:01.073879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e6681-0b3c-40f6-bc0d-b2ecad9b6234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:01.074148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e6681-0b3c-40f6-bc0d-b2ecad9b6234 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:01.074789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e6681-0b3c-40f6-bc0d-b2ecad9b6234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:01.076750 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e6681-0b3c-40f6-bc0d-b2ecad9b6234 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:01.126574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:01.141332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1130/2291] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:46:00 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:01.143170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab21391-704f-49fc-86f8-45d8f6c68805 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:01.143170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab21391-704f-49fc-86f8-45d8f6c68805 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:01.143170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab21391-704f-49fc-86f8-45d8f6c68805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:01.179946 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-4ab21391-704f-49fc-86f8-45d8f6c68805 None None] MFA Rules not processed for user `14047d34c71345f49bcd4d4bf7bca89a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:01.181205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4ab21391-704f-49fc-86f8-45d8f6c68805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:01.199252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1162/2292] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:01.200505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b63ed2-9758-4e1a-bc87-811aa910e16f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:01.216345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b63ed2-9758-4e1a-bc87-811aa910e16f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:01.222395 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a1942-e621-4ab5-be7d-00021a412f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:01.223027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a1942-e621-4ab5-be7d-00021a412f59 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:01.223308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a1942-e621-4ab5-be7d-00021a412f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:01.223650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a1942-e621-4ab5-be7d-00021a412f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:01.224307 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a1942-e621-4ab5-be7d-00021a412f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:01.228247 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a1942-e621-4ab5-be7d-00021a412f59 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:01.241499 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1163/2293] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:01.243526 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a1942-e621-4ab5-be7d-00021a412f59 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:01.246146 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9f4a1942-e621-4ab5-be7d-00021a412f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:01.290382 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1131/2294] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:01.290382 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab21391-704f-49fc-86f8-45d8f6c68805 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:01.329641 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab21391-704f-49fc-86f8-45d8f6c68805 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:01.340651 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b92127-f140-49fa-aff0-2a5c8a0e5b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:01.341476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b92127-f140-49fa-aff0-2a5c8a0e5b38 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:01.341819 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b92127-f140-49fa-aff0-2a5c8a0e5b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:01.342219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b92127-f140-49fa-aff0-2a5c8a0e5b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:01.343250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b92127-f140-49fa-aff0-2a5c8a0e5b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:01.361104 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b92127-f140-49fa-aff0-2a5c8a0e5b38 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:01.379862 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1132/2295] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:01.381053 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b92127-f140-49fa-aff0-2a5c8a0e5b38 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:01.407313 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a1942-e621-4ab5-be7d-00021a412f59 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:01.412655 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b92127-f140-49fa-aff0-2a5c8a0e5b38 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:01.428186 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867243c-bdc2-4481-9e9f-960d5ade743c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:01.429678 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867243c-bdc2-4481-9e9f-960d5ade743c service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:01.430011 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867243c-bdc2-4481-9e9f-960d5ade743c service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:01.430338 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867243c-bdc2-4481-9e9f-960d5ade743c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:01.443020 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489dbbb-a470-473b-868f-6a174c26bd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:01.444395 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489dbbb-a470-473b-868f-6a174c26bd07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:01.444983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489dbbb-a470-473b-868f-6a174c26bd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:01.445383 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489dbbb-a470-473b-868f-6a174c26bd07 admin admin] PATH_INFO: `/v3/projects/ee04979a81084625852fbac3756d420f/users/1ffaa17d196845f6b2b7546b8ffebbe8/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:01.455653 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867243c-bdc2-4481-9e9f-960d5ade743c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:01.457136 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867243c-bdc2-4481-9e9f-960d5ade743c service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:01.493201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1164/2296] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:01.522206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867243c-bdc2-4481-9e9f-960d5ade743c service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:01.555673 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867243c-bdc2-4481-9e9f-960d5ade743c service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:01.576967 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146a59f-8cdb-4ae8-b0a5-1f9b46e5fccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:01.579071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146a59f-8cdb-4ae8-b0a5-1f9b46e5fccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:01.582495 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146a59f-8cdb-4ae8-b0a5-1f9b46e5fccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:01.582741 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146a59f-8cdb-4ae8-b0a5-1f9b46e5fccd admin admin] PATH_INFO: `/v3/users/ebfde1eb5bb94f88b381109cbfec448b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:01.585639 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146a59f-8cdb-4ae8-b0a5-1f9b46e5fccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebfde1eb5bb94f88b381109cbfec448b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:01.589938 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489dbbb-a470-473b-868f-6a174c26bd07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee04979a81084625852fbac3756d420f, user_id=1ffaa17d196845f6b2b7546b8ffebbe8, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:01.590099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146a59f-8cdb-4ae8-b0a5-1f9b46e5fccd admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:01.608436 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489dbbb-a470-473b-868f-6a174c26bd07 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:01.658480 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1133/2297] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:46:01 2022] PUT /identity/v3/projects/ee04979a81084625852fbac3756d420f/users/1ffaa17d196845f6b2b7546b8ffebbe8/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:01.671835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a745881-0a72-4435-b3c7-0835e134bfd3 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:01.676871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a745881-0a72-4435-b3c7-0835e134bfd3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:01.677367 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a745881-0a72-4435-b3c7-0835e134bfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:01.710295 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2146a59f-8cdb-4ae8-b0a5-1f9b46e5fccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebfde1eb5bb94f88b381109cbfec448b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:01.752737 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0a745881-0a72-4435-b3c7-0835e134bfd3 None None] MFA Rules not processed for user `1ffaa17d196845f6b2b7546b8ffebbe8`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:01.766771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2146a59f-8cdb-4ae8-b0a5-1f9b46e5fccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebfde1eb5bb94f88b381109cbfec448b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:01.767550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2146a59f-8cdb-4ae8-b0a5-1f9b46e5fccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebfde1eb5bb94f88b381109cbfec448b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:01.768262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2146a59f-8cdb-4ae8-b0a5-1f9b46e5fccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebfde1eb5bb94f88b381109cbfec448b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:01.770391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0a745881-0a72-4435-b3c7-0835e134bfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:01.797773 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2146a59f-8cdb-4ae8-b0a5-1f9b46e5fccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebfde1eb5bb94f88b381109cbfec448b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:01.805118 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:01.872249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1165/2298] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:46:01 2022] DELETE /identity/v3/users/ebfde1eb5bb94f88b381109cbfec448b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:01.873928 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41191d0-9f13-4dcd-bfe8-d4ac80a73f15 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:01.876090 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41191d0-9f13-4dcd-bfe8-d4ac80a73f15 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:01.877883 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41191d0-9f13-4dcd-bfe8-d4ac80a73f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:01.945192 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-e41191d0-9f13-4dcd-bfe8-d4ac80a73f15 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:01.946733 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e41191d0-9f13-4dcd-bfe8-d4ac80a73f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:01.969848 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1134/2299] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:01.971026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a745881-0a72-4435-b3c7-0835e134bfd3 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:01.973903 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0a745881-0a72-4435-b3c7-0835e134bfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:02.000329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:02.069872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1166/2300] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:02.072173 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41191d0-9f13-4dcd-bfe8-d4ac80a73f15 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:02.075553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e41191d0-9f13-4dcd-bfe8-d4ac80a73f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:02.116617 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41191d0-9f13-4dcd-bfe8-d4ac80a73f15 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:02.128416 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091f10c-f5a4-4976-af83-b919c11a8bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:02.129901 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091f10c-f5a4-4976-af83-b919c11a8bdd admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:02.130390 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091f10c-f5a4-4976-af83-b919c11a8bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:02.131496 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091f10c-f5a4-4976-af83-b919c11a8bdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:02.132921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091f10c-f5a4-4976-af83-b919c11a8bdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:02.147394 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091f10c-f5a4-4976-af83-b919c11a8bdd admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:02.186297 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a745881-0a72-4435-b3c7-0835e134bfd3 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:02.203954 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1167/2301] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:46:02 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:02.204143 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a62e9-43f6-41e7-ab1d-32404f37f411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:02.206248 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091f10c-f5a4-4976-af83-b919c11a8bdd admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:02.206879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a62e9-43f6-41e7-ab1d-32404f37f411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:02.207175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a62e9-43f6-41e7-ab1d-32404f37f411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:02.207492 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a62e9-43f6-41e7-ab1d-32404f37f411 admin admin] PATH_INFO: `/v3/users/5d2180a6224a4932ae5aab741856b02b` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:02.210314 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a62e9-43f6-41e7-ab1d-32404f37f411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d2180a6224a4932ae5aab741856b02b)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:02.215836 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a62e9-43f6-41e7-ab1d-32404f37f411 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:02.222331 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2091f10c-f5a4-4976-af83-b919c11a8bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:02.312057 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7e1a62e9-43f6-41e7-ab1d-32404f37f411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d2180a6224a4932ae5aab741856b02b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:02.328919 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7e1a62e9-43f6-41e7-ab1d-32404f37f411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d2180a6224a4932ae5aab741856b02b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:02.330724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7e1a62e9-43f6-41e7-ab1d-32404f37f411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d2180a6224a4932ae5aab741856b02b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:02.332867 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7e1a62e9-43f6-41e7-ab1d-32404f37f411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d2180a6224a4932ae5aab741856b02b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:02.344941 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091f10c-f5a4-4976-af83-b919c11a8bdd admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:02.350224 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141615aa-4362-45ba-8d3b-e334e1138fe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:02.351175 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141615aa-4362-45ba-8d3b-e334e1138fe7 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:02.351663 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141615aa-4362-45ba-8d3b-e334e1138fe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:02.352128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141615aa-4362-45ba-8d3b-e334e1138fe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:02.354166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-141615aa-4362-45ba-8d3b-e334e1138fe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:02.358341 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7e1a62e9-43f6-41e7-ab1d-32404f37f411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d2180a6224a4932ae5aab741856b02b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:02.426678 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1135/2302] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:46:01 2022] DELETE /identity/v3/users/5d2180a6224a4932ae5aab741856b02b => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:02.428363 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a62e9-43f6-41e7-ab1d-32404f37f411 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:02.432001 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7e1a62e9-43f6-41e7-ab1d-32404f37f411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:02.485155 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141615aa-4362-45ba-8d3b-e334e1138fe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:02.485155 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141615aa-4362-45ba-8d3b-e334e1138fe7 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:02.508141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1168/2303] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:02.509829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adc8cd-9044-445a-9e6c-30ed417eca54 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:02.510280 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adc8cd-9044-445a-9e6c-30ed417eca54 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:02.511410 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adc8cd-9044-445a-9e6c-30ed417eca54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:02.512312 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:02.543938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-07adc8cd-9044-445a-9e6c-30ed417eca54 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:02.545170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-07adc8cd-9044-445a-9e6c-30ed417eca54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:02.557803 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a62e9-43f6-41e7-ab1d-32404f37f411 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:02.560608 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1169/2304] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:02.564986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59c4f1-77d5-4a47-8de1-176036508a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:02.567128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adc8cd-9044-445a-9e6c-30ed417eca54 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:02.567857 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59c4f1-77d5-4a47-8de1-176036508a0f admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:02.568204 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59c4f1-77d5-4a47-8de1-176036508a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:02.569453 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-07adc8cd-9044-445a-9e6c-30ed417eca54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:02.571011 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59c4f1-77d5-4a47-8de1-176036508a0f admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:02.571690 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59c4f1-77d5-4a47-8de1-176036508a0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:02.574818 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59c4f1-77d5-4a47-8de1-176036508a0f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:02.611515 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1136/2305] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:46:02 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:02.615499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59c4f1-77d5-4a47-8de1-176036508a0f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:02.630309 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59c4f1-77d5-4a47-8de1-176036508a0f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:02.644349 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ad442-524c-4f9e-baa4-526d0f00785e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:02.645028 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ad442-524c-4f9e-baa4-526d0f00785e admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:02.645341 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ad442-524c-4f9e-baa4-526d0f00785e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:02.645660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ad442-524c-4f9e-baa4-526d0f00785e admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:02.647181 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ad442-524c-4f9e-baa4-526d0f00785e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:02.651288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adc8cd-9044-445a-9e6c-30ed417eca54 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:02.655845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62ecca-c42c-489e-8b09-af0d672e6ef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:02.656526 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62ecca-c42c-489e-8b09-af0d672e6ef0 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:02.656914 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62ecca-c42c-489e-8b09-af0d672e6ef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:02.657268 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62ecca-c42c-489e-8b09-af0d672e6ef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:02.664517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ad442-524c-4f9e-baa4-526d0f00785e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:02.681677 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1137/2306] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:02.685916 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62ecca-c42c-489e-8b09-af0d672e6ef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:02.686326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ad442-524c-4f9e-baa4-526d0f00785e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:02.688337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62ecca-c42c-489e-8b09-af0d672e6ef0 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:02.701723 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ad442-524c-4f9e-baa4-526d0f00785e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:02.701903 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1170/2307] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:46:02.708465 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89ebcb-d1e8-4294-af97-f2231e5c0886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:02.709909 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89ebcb-d1e8-4294-af97-f2231e5c0886 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:02.710237 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89ebcb-d1e8-4294-af97-f2231e5c0886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:02.710478 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89ebcb-d1e8-4294-af97-f2231e5c0886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:02.711233 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89ebcb-d1e8-4294-af97-f2231e5c0886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:02.713057 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89ebcb-d1e8-4294-af97-f2231e5c0886 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:02.729135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1138/2308] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:02.731797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62ecca-c42c-489e-8b09-af0d672e6ef0 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:02.743110 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62ecca-c42c-489e-8b09-af0d672e6ef0 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:02.748333 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb6d66-734c-4856-98a5-f067cba4fc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:02.749359 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb6d66-734c-4856-98a5-f067cba4fc9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:02.749799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb6d66-734c-4856-98a5-f067cba4fc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:02.750369 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb6d66-734c-4856-98a5-f067cba4fc9b admin admin] PATH_INFO: `/v3/projects/b789916ef64e415d8e1649947e9bc52a/users/a6ca9303a8574658acccd6d6edbb5bf7/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:02.755691 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:02.775037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb6d66-734c-4856-98a5-f067cba4fc9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b789916ef64e415d8e1649947e9bc52a, user_id=a6ca9303a8574658acccd6d6edbb5bf7, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:02.779246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb6d66-734c-4856-98a5-f067cba4fc9b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:02.807275 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1171/2309] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:46:02 2022] PUT /identity/v3/projects/b789916ef64e415d8e1649947e9bc52a/users/a6ca9303a8574658acccd6d6edbb5bf7/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:46:02.818598 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cc7e9-d52c-48f9-8b4f-fd32913c3fa3 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:02.818900 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cc7e9-d52c-48f9-8b4f-fd32913c3fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:02.819159 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cc7e9-d52c-48f9-8b4f-fd32913c3fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:02.894830 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-7d0cc7e9-d52c-48f9-8b4f-fd32913c3fa3 None None] MFA Rules not processed for user `a6ca9303a8574658acccd6d6edbb5bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:02.898879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7d0cc7e9-d52c-48f9-8b4f-fd32913c3fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:03.096684 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1139/2310] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:46:03.098296 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb6d66-734c-4856-98a5-f067cba4fc9b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:03.201743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb6d66-734c-4856-98a5-f067cba4fc9b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:03.207184 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d07346-226e-4143-821e-22894a56f6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:03.208077 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d07346-226e-4143-821e-22894a56f6d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:03.208638 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d07346-226e-4143-821e-22894a56f6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:03.209192 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d07346-226e-4143-821e-22894a56f6d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:03.210002 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d07346-226e-4143-821e-22894a56f6d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:03.212127 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d07346-226e-4143-821e-22894a56f6d2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:03.251197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1172/2311] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:46:03 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:46:03.262192 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cc7e9-d52c-48f9-8b4f-fd32913c3fa3 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:03.290798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cc7e9-d52c-48f9-8b4f-fd32913c3fa3 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:03.408127 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420acaa2-44b7-45fc-8451-0111f3590066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:03.408986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420acaa2-44b7-45fc-8451-0111f3590066 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:03.409522 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420acaa2-44b7-45fc-8451-0111f3590066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:03.409996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420acaa2-44b7-45fc-8451-0111f3590066 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:03.411002 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420acaa2-44b7-45fc-8451-0111f3590066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:03.413941 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420acaa2-44b7-45fc-8451-0111f3590066 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:03.440177 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1140/2312] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:46:03 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:03.444286 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d07346-226e-4143-821e-22894a56f6d2 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:03.456097 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d07346-226e-4143-821e-22894a56f6d2 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:03.461520 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e7f61-8617-45e9-92ee-2e54b8fd969e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:03.462478 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e7f61-8617-45e9-92ee-2e54b8fd969e admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:03.462825 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e7f61-8617-45e9-92ee-2e54b8fd969e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:03.463164 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e7f61-8617-45e9-92ee-2e54b8fd969e admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:03.464350 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e7f61-8617-45e9-92ee-2e54b8fd969e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:03.466223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e7f61-8617-45e9-92ee-2e54b8fd969e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:03.481234 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1173/2313] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:03.486285 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420acaa2-44b7-45fc-8451-0111f3590066 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:03.495966 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420acaa2-44b7-45fc-8451-0111f3590066 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:03.501584 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f44e01-b259-49cc-98f5-cd6f5d524aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:03.501868 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f44e01-b259-49cc-98f5-cd6f5d524aef admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:03.502146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f44e01-b259-49cc-98f5-cd6f5d524aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:03.502423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f44e01-b259-49cc-98f5-cd6f5d524aef admin admin] PATH_INFO: `/v3/projects/fd193d2f28324fcc994c4a2743ebb1f0/users/72b475858db8420080b032b3794bfb88/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:03.522518 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f44e01-b259-49cc-98f5-cd6f5d524aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd193d2f28324fcc994c4a2743ebb1f0, user_id=72b475858db8420080b032b3794bfb88, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:03.525211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f44e01-b259-49cc-98f5-cd6f5d524aef admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:03.529353 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:03.549813 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e7f61-8617-45e9-92ee-2e54b8fd969e admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:03.552135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-273e7f61-8617-45e9-92ee-2e54b8fd969e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:03.553699 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1141/2314] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:46:03 2022] PUT /identity/v3/projects/fd193d2f28324fcc994c4a2743ebb1f0/users/72b475858db8420080b032b3794bfb88/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:03.557485 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f44e01-b259-49cc-98f5-cd6f5d524aef admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:03.579497 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e7f61-8617-45e9-92ee-2e54b8fd969e admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:03.653767 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f44e01-b259-49cc-98f5-cd6f5d524aef admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:03.674128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc5b88-aac4-4328-b7de-283674ea4706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:03.688142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc5b88-aac4-4328-b7de-283674ea4706 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:03.688503 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc5b88-aac4-4328-b7de-283674ea4706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:03.688783 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc5b88-aac4-4328-b7de-283674ea4706 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:03.691284 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc5b88-aac4-4328-b7de-283674ea4706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:03.695741 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc5b88-aac4-4328-b7de-283674ea4706 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:03.724980 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c8c4c-c34b-418f-936e-267c4ede6f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:03.726445 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c8c4c-c34b-418f-936e-267c4ede6f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:03.726795 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c8c4c-c34b-418f-936e-267c4ede6f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:03.727286 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c8c4c-c34b-418f-936e-267c4ede6f9f admin admin] PATH_INFO: `/v3/users/ee821e6c64fe439085921660623a0752` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:03.729766 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c8c4c-c34b-418f-936e-267c4ede6f9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee821e6c64fe439085921660623a0752)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:03.735740 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c8c4c-c34b-418f-936e-267c4ede6f9f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:03.765873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1142/2315] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 00:46:03.769039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc5b88-aac4-4328-b7de-283674ea4706 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:03.775800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-52bc5b88-aac4-4328-b7de-283674ea4706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:03.806635 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc5b88-aac4-4328-b7de-283674ea4706 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:03.818898 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e65582-bbf7-4d2f-812c-100bcc5e7019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:03.822709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e65582-bbf7-4d2f-812c-100bcc5e7019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:03.823078 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e65582-bbf7-4d2f-812c-100bcc5e7019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:03.823457 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e65582-bbf7-4d2f-812c-100bcc5e7019 admin admin] PATH_INFO: `/v3/projects/5cd5e1f738934ec4824c19fd4f351e3c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:03.824990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e65582-bbf7-4d2f-812c-100bcc5e7019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd5e1f738934ec4824c19fd4f351e3c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:03.829343 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e65582-bbf7-4d2f-812c-100bcc5e7019 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:03.904758 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7a0c8c4c-c34b-418f-936e-267c4ede6f9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee821e6c64fe439085921660623a0752'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:03.910208 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c6e65582-bbf7-4d2f-812c-100bcc5e7019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd5e1f738934ec4824c19fd4f351e3c', 'request_id': 'req-c6e65582-bbf7-4d2f-812c-100bcc5e7019'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:03.922428 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7a0c8c4c-c34b-418f-936e-267c4ede6f9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee821e6c64fe439085921660623a0752'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:03.923650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7a0c8c4c-c34b-418f-936e-267c4ede6f9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee821e6c64fe439085921660623a0752'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:03.925079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7a0c8c4c-c34b-418f-936e-267c4ede6f9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee821e6c64fe439085921660623a0752'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:03.933880 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c6e65582-bbf7-4d2f-812c-100bcc5e7019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd5e1f738934ec4824c19fd4f351e3c', 'request_id': 'req-c6e65582-bbf7-4d2f-812c-100bcc5e7019'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:03.938322 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:03.942415 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c6e65582-bbf7-4d2f-812c-100bcc5e7019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd5e1f738934ec4824c19fd4f351e3c', 'request_id': 'req-c6e65582-bbf7-4d2f-812c-100bcc5e7019'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:03.947003 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7a0c8c4c-c34b-418f-936e-267c4ede6f9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee821e6c64fe439085921660623a0752'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:03.957583 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c6e65582-bbf7-4d2f-812c-100bcc5e7019 admin admin] The token cache is being invalidate because project 5cd5e1f738934ec4824c19fd4f351e3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:46:03.958266 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c6e65582-bbf7-4d2f-812c-100bcc5e7019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:03.959650 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c6e65582-bbf7-4d2f-812c-100bcc5e7019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:03.961528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1143/2316] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:46:03 2022] DELETE /identity/v3/projects/5cd5e1f738934ec4824c19fd4f351e3c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:03.963197 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e65582-bbf7-4d2f-812c-100bcc5e7019 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:03.964688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c6e65582-bbf7-4d2f-812c-100bcc5e7019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:03.993963 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1174/2317] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:46:03 2022] DELETE /identity/v3/users/ee821e6c64fe439085921660623a0752 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:03.995679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c86e7-ec71-4fd2-a3f9-83465d37d330 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:03.999574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c86e7-ec71-4fd2-a3f9-83465d37d330 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:04.000840 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c86e7-ec71-4fd2-a3f9-83465d37d330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:04.076733 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-3c7c86e7-ec71-4fd2-a3f9-83465d37d330 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:04.078180 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3c7c86e7-ec71-4fd2-a3f9-83465d37d330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:04.190662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e65582-bbf7-4d2f-812c-100bcc5e7019 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:04.245879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1175/2318] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:04.247240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f9668-534a-44e3-b4e4-ed5f7a29a4cc None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:04.247524 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f9668-534a-44e3-b4e4-ed5f7a29a4cc None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:04.247792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f9668-534a-44e3-b4e4-ed5f7a29a4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:04.259987 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:04.321466 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-1b4f9668-534a-44e3-b4e4-ed5f7a29a4cc None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:04.325553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1b4f9668-534a-44e3-b4e4-ed5f7a29a4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:04.355361 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1176/2319] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:04.355361 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5d23c-6fcf-40de-bac4-3a9635f77eba None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:04.355361 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5d23c-6fcf-40de-bac4-3a9635f77eba None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:04.355361 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5d23c-6fcf-40de-bac4-3a9635f77eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:04.380417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61664c6d-c234-461e-9d4b-9d68ef531bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:04.382481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61664c6d-c234-461e-9d4b-9d68ef531bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:04.382771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61664c6d-c234-461e-9d4b-9d68ef531bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:04.383043 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61664c6d-c234-461e-9d4b-9d68ef531bc3 admin admin] PATH_INFO: `/v3/projects/fd193d2f28324fcc994c4a2743ebb1f0/users/72b475858db8420080b032b3794bfb88/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:04.387487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61664c6d-c234-461e-9d4b-9d68ef531bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd193d2f28324fcc994c4a2743ebb1f0, user_id=72b475858db8420080b032b3794bfb88, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:04.390261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61664c6d-c234-461e-9d4b-9d68ef531bc3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:04.395623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-14b5d23c-6fcf-40de-bac4-3a9635f77eba None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:04.397516 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-14b5d23c-6fcf-40de-bac4-3a9635f77eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:04.403894 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1144/2320] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:46:03 2022] PUT /identity/v3/projects/fd193d2f28324fcc994c4a2743ebb1f0/users/72b475858db8420080b032b3794bfb88/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:04.405179 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61664c6d-c234-461e-9d4b-9d68ef531bc3 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:04.407520 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-61664c6d-c234-461e-9d4b-9d68ef531bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:04.551580 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1177/2321] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:04.553414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61664c6d-c234-461e-9d4b-9d68ef531bc3 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:04.553543 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6334eb9-2055-4445-bce6-d30030e13a7a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:04.553922 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6334eb9-2055-4445-bce6-d30030e13a7a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:04.554384 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6334eb9-2055-4445-bce6-d30030e13a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:04.558450 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141517ef-2f24-4482-bb2a-0a62377e69f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:04.559316 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141517ef-2f24-4482-bb2a-0a62377e69f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:04.559610 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141517ef-2f24-4482-bb2a-0a62377e69f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:04.559882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141517ef-2f24-4482-bb2a-0a62377e69f9 admin admin] PATH_INFO: `/v3/projects/c26bc563ea194af48275e5bfee897323` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:04.561987 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141517ef-2f24-4482-bb2a-0a62377e69f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c26bc563ea194af48275e5bfee897323)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:04.563951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141517ef-2f24-4482-bb2a-0a62377e69f9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:04.598488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-e6334eb9-2055-4445-bce6-d30030e13a7a None None] MFA Rules not processed for user `72b475858db8420080b032b3794bfb88`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:04.600623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e6334eb9-2055-4445-bce6-d30030e13a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:04.652554 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-141517ef-2f24-4482-bb2a-0a62377e69f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c26bc563ea194af48275e5bfee897323', 'request_id': 'req-141517ef-2f24-4482-bb2a-0a62377e69f9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:04.666259 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-141517ef-2f24-4482-bb2a-0a62377e69f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c26bc563ea194af48275e5bfee897323', 'request_id': 'req-141517ef-2f24-4482-bb2a-0a62377e69f9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:04.676021 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-141517ef-2f24-4482-bb2a-0a62377e69f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c26bc563ea194af48275e5bfee897323', 'request_id': 'req-141517ef-2f24-4482-bb2a-0a62377e69f9'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:04.691593 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-141517ef-2f24-4482-bb2a-0a62377e69f9 admin admin] The token cache is being invalidate because project c26bc563ea194af48275e5bfee897323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:46:04.691801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-141517ef-2f24-4482-bb2a-0a62377e69f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:04.692419 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-141517ef-2f24-4482-bb2a-0a62377e69f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:04.697865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1145/2322] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:46:04 2022] DELETE /identity/v3/projects/c26bc563ea194af48275e5bfee897323 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:04.697865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141517ef-2f24-4482-bb2a-0a62377e69f9 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:04.697865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-141517ef-2f24-4482-bb2a-0a62377e69f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:04.707160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:04.727715 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1178/2323] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:04.728838 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6334eb9-2055-4445-bce6-d30030e13a7a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:04.730866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e6334eb9-2055-4445-bce6-d30030e13a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:04.748430 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6334eb9-2055-4445-bce6-d30030e13a7a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:04.783182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:04.791031 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141517ef-2f24-4482-bb2a-0a62377e69f9 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:04.798794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59314992-a937-41f6-81a3-34c362ee2ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:04.800148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59314992-a937-41f6-81a3-34c362ee2ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:04.800436 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59314992-a937-41f6-81a3-34c362ee2ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:04.800722 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59314992-a937-41f6-81a3-34c362ee2ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:04.804914 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-59314992-a937-41f6-81a3-34c362ee2ad1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:04.847809 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624c965-a6eb-45b3-b49c-40430e1fa7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:04.848379 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624c965-a6eb-45b3-b49c-40430e1fa7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:04.848728 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624c965-a6eb-45b3-b49c-40430e1fa7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:04.848945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624c965-a6eb-45b3-b49c-40430e1fa7c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:04.850211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624c965-a6eb-45b3-b49c-40430e1fa7c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:46:04.850502 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624c965-a6eb-45b3-b49c-40430e1fa7c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:04.853926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624c965-a6eb-45b3-b49c-40430e1fa7c0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:04.880005 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1179/2324] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:46:04.882271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9944c-a434-4f08-b7d1-519e96556eb2 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:04.882780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9944c-a434-4f08-b7d1-519e96556eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:04.883795 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9944c-a434-4f08-b7d1-519e96556eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:04.893343 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59314992-a937-41f6-81a3-34c362ee2ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:04.895717 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59314992-a937-41f6-81a3-34c362ee2ad1 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:04.910855 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1146/2325] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:04.912597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59314992-a937-41f6-81a3-34c362ee2ad1 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:04.913996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-59314992-a937-41f6-81a3-34c362ee2ad1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:04.916631 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-49a9944c-a434-4f08-b7d1-519e96556eb2 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:04.918527 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-49a9944c-a434-4f08-b7d1-519e96556eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:04.932934 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1180/2326] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:04.934199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9944c-a434-4f08-b7d1-519e96556eb2 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:04.950180 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9944c-a434-4f08-b7d1-519e96556eb2 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:04.957917 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3c22d-86bc-4d90-a650-894db94662b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:04.959710 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3c22d-86bc-4d90-a650-894db94662b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:04.960265 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3c22d-86bc-4d90-a650-894db94662b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:04.960695 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3c22d-86bc-4d90-a650-894db94662b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:04.961710 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3c22d-86bc-4d90-a650-894db94662b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:04.964622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3c22d-86bc-4d90-a650-894db94662b3 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:05.000835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59314992-a937-41f6-81a3-34c362ee2ad1 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:05.005948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20253bee-ef3a-4731-9491-6b9224259cb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:05.006855 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20253bee-ef3a-4731-9491-6b9224259cb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:05.007236 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20253bee-ef3a-4731-9491-6b9224259cb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:05.007759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20253bee-ef3a-4731-9491-6b9224259cb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:05.009267 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1181/2327] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:46:04 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:05.010252 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-20253bee-ef3a-4731-9491-6b9224259cb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:05.011308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35750572-9240-413b-971c-6ac60093bbdf None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:05.011868 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35750572-9240-413b-971c-6ac60093bbdf None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:05.012345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35750572-9240-413b-971c-6ac60093bbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:05.076977 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-35750572-9240-413b-971c-6ac60093bbdf None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:05.093647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-35750572-9240-413b-971c-6ac60093bbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:05.135674 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20253bee-ef3a-4731-9491-6b9224259cb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:05.142137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20253bee-ef3a-4731-9491-6b9224259cb7 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:05.166390 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1147/2328] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:05.167663 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20253bee-ef3a-4731-9491-6b9224259cb7 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:05.182597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20253bee-ef3a-4731-9491-6b9224259cb7 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:05.233162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1182/2329] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:05.234305 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35750572-9240-413b-971c-6ac60093bbdf None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:05.248618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35750572-9240-413b-971c-6ac60093bbdf None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:05.260464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be48bd-b061-4c4b-ba49-4978a1193964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:05.261278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be48bd-b061-4c4b-ba49-4978a1193964 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:05.262181 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be48bd-b061-4c4b-ba49-4978a1193964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:05.263025 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be48bd-b061-4c4b-ba49-4978a1193964 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:05.264500 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be48bd-b061-4c4b-ba49-4978a1193964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:46:05.264950 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be48bd-b061-4c4b-ba49-4978a1193964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:05.268253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be48bd-b061-4c4b-ba49-4978a1193964 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:05.268935 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:05.286684 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fd9d1-409d-4ccd-80c3-6e49ad58995e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:05.288291 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fd9d1-409d-4ccd-80c3-6e49ad58995e admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:05.289036 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fd9d1-409d-4ccd-80c3-6e49ad58995e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:05.289817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fd9d1-409d-4ccd-80c3-6e49ad58995e admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:05.290905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1183/2330] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:46:05.291090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fd9d1-409d-4ccd-80c3-6e49ad58995e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:05.293329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fd9d1-409d-4ccd-80c3-6e49ad58995e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:05.295912 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be48bd-b061-4c4b-ba49-4978a1193964 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:05.314468 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be48bd-b061-4c4b-ba49-4978a1193964 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:05.326444 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667035bc-e3a4-4461-9fea-e91669899d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:05.327076 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667035bc-e3a4-4461-9fea-e91669899d53 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:05.327360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667035bc-e3a4-4461-9fea-e91669899d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:05.327635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667035bc-e3a4-4461-9fea-e91669899d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:05.328948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1148/2331] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:46:05 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:05.329505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667035bc-e3a4-4461-9fea-e91669899d53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:05.331428 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667035bc-e3a4-4461-9fea-e91669899d53 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:05.333138 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fd9d1-409d-4ccd-80c3-6e49ad58995e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:05.347495 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fd9d1-409d-4ccd-80c3-6e49ad58995e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:05.353902 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48013e-9607-4991-b193-73dbcbd6a8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:05.354869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48013e-9607-4991-b193-73dbcbd6a8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:05.355360 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48013e-9607-4991-b193-73dbcbd6a8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:05.355822 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48013e-9607-4991-b193-73dbcbd6a8f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:05.356644 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48013e-9607-4991-b193-73dbcbd6a8f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:05.358502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48013e-9607-4991-b193-73dbcbd6a8f3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:05.371574 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1149/2332] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 00:46:05.377282 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48013e-9607-4991-b193-73dbcbd6a8f3 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:05.392200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1184/2333] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:46:05 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:05.394115 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667035bc-e3a4-4461-9fea-e91669899d53 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:05.403288 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48013e-9607-4991-b193-73dbcbd6a8f3 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:05.465920 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:05.508924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712621e9-349a-48a7-af02-1ec3b545df66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:05.509877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712621e9-349a-48a7-af02-1ec3b545df66 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:05.510095 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712621e9-349a-48a7-af02-1ec3b545df66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:05.510421 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712621e9-349a-48a7-af02-1ec3b545df66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:05.511931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712621e9-349a-48a7-af02-1ec3b545df66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:05.513316 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667035bc-e3a4-4461-9fea-e91669899d53 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:05.513682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712621e9-349a-48a7-af02-1ec3b545df66 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:05.524223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36962b79-a16a-455c-9766-23b55c2afd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:05.525141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36962b79-a16a-455c-9766-23b55c2afd15 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:05.525717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36962b79-a16a-455c-9766-23b55c2afd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:05.526149 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36962b79-a16a-455c-9766-23b55c2afd15 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:05.526925 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36962b79-a16a-455c-9766-23b55c2afd15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:05.535991 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1150/2334] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:05.535991 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b093237-61d9-4339-a38b-19dbf783063a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:05.535991 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b093237-61d9-4339-a38b-19dbf783063a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:05.535991 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b093237-61d9-4339-a38b-19dbf783063a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:05.539821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36962b79-a16a-455c-9766-23b55c2afd15 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:05.557534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0b093237-61d9-4339-a38b-19dbf783063a None None] MFA Rules not processed for user `ed49a596f15542a29ce331bae4640274`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:05.558917 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0b093237-61d9-4339-a38b-19dbf783063a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:05.580589 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1185/2335] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:46:05 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:05.581427 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36962b79-a16a-455c-9766-23b55c2afd15 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:05.604453 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36962b79-a16a-455c-9766-23b55c2afd15 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:05.612194 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f77d4-4aec-44ea-820d-c140a03b6a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:05.612878 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f77d4-4aec-44ea-820d-c140a03b6a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:05.613225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f77d4-4aec-44ea-820d-c140a03b6a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:05.613492 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f77d4-4aec-44ea-820d-c140a03b6a80 admin admin] PATH_INFO: `/v3/projects/e68669c80f8c4b4bbdce962f84ee260b/users/8cd1efe137d042fc9258e2849162dc4c/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:05.634129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f77d4-4aec-44ea-820d-c140a03b6a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68669c80f8c4b4bbdce962f84ee260b, user_id=8cd1efe137d042fc9258e2849162dc4c, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:05.637768 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f77d4-4aec-44ea-820d-c140a03b6a80 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:05.674082 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1151/2336] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 15 00:46:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:05.675371 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b093237-61d9-4339-a38b-19dbf783063a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:05.685658 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1186/2337] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:46:05 2022] PUT /identity/v3/projects/e68669c80f8c4b4bbdce962f84ee260b/users/8cd1efe137d042fc9258e2849162dc4c/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:05.691001 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f77d4-4aec-44ea-820d-c140a03b6a80 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:05.695333 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b95f77d4-4aec-44ea-820d-c140a03b6a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:05.726576 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b093237-61d9-4339-a38b-19dbf783063a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:05.845364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f77d4-4aec-44ea-820d-c140a03b6a80 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:05.853746 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5505035-77c3-4e45-9e21-afa890e619de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb248b85aba45b39132d0f92ede0b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:05.856304 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5505035-77c3-4e45-9e21-afa890e619de service swift] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:05.856973 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5505035-77c3-4e45-9e21-afa890e619de service swift] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:05.857496 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5505035-77c3-4e45-9e21-afa890e619de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:05.868029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e1c90-f4f1-4845-a233-561b20144d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:05.868676 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e1c90-f4f1-4845-a233-561b20144d1c admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:05.868989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e1c90-f4f1-4845-a233-561b20144d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:05.869288 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e1c90-f4f1-4845-a233-561b20144d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:05.873072 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e1c90-f4f1-4845-a233-561b20144d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:05.874987 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e1c90-f4f1-4845-a233-561b20144d1c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:05.907458 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1152/2338] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:05.912556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7c8dc-4ec8-4c0d-a843-89806b44cd91 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:05.912842 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7c8dc-4ec8-4c0d-a843-89806b44cd91 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:05.913168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7c8dc-4ec8-4c0d-a843-89806b44cd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:05.962180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:05.992742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5505035-77c3-4e45-9e21-afa890e619de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:05.995990 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5505035-77c3-4e45-9e21-afa890e619de service swift] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:06.009881 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1187/2339] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 15 00:46:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 00:46:06.011195 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5505035-77c3-4e45-9e21-afa890e619de service swift] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:06.022105 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e1b7c8dc-4ec8-4c0d-a843-89806b44cd91 None None] MFA Rules not processed for user `8cd1efe137d042fc9258e2849162dc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:06.023356 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e1b7c8dc-4ec8-4c0d-a843-89806b44cd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:06.027559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5505035-77c3-4e45-9e21-afa890e619de service swift] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:06.037885 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107c21c-3849-4ae5-b7d7-29c3b38c3075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:06.038880 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107c21c-3849-4ae5-b7d7-29c3b38c3075 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:06.039467 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107c21c-3849-4ae5-b7d7-29c3b38c3075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:06.040351 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107c21c-3849-4ae5-b7d7-29c3b38c3075 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:06.041621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107c21c-3849-4ae5-b7d7-29c3b38c3075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:06.046959 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107c21c-3849-4ae5-b7d7-29c3b38c3075 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:06.063053 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1188/2340] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:06.067054 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107c21c-3849-4ae5-b7d7-29c3b38c3075 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:06.094882 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107c21c-3849-4ae5-b7d7-29c3b38c3075 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:06.101356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea67b7-8268-4c53-8762-a4aa72678253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:06.102304 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea67b7-8268-4c53-8762-a4aa72678253 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:06.102693 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea67b7-8268-4c53-8762-a4aa72678253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:06.103449 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea67b7-8268-4c53-8762-a4aa72678253 admin admin] PATH_INFO: `/v3/projects/248f2b11e3d64b248de0867c10cc120f/users/d2d3ed4b4a91453d83969d79c6ad15f5/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:06.147341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea67b7-8268-4c53-8762-a4aa72678253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=248f2b11e3d64b248de0867c10cc120f, user_id=d2d3ed4b4a91453d83969d79c6ad15f5, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:06.157298 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea67b7-8268-4c53-8762-a4aa72678253 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:06.178311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:06.192296 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1189/2341] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:46:06 2022] PUT /identity/v3/projects/248f2b11e3d64b248de0867c10cc120f/users/d2d3ed4b4a91453d83969d79c6ad15f5/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:46:06.202809 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f633e4-1250-49e5-8690-95be0f0a4052 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:06.203576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f633e4-1250-49e5-8690-95be0f0a4052 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:06.203576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f633e4-1250-49e5-8690-95be0f0a4052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:06.236922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1153/2342] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:06.238783 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7c8dc-4ec8-4c0d-a843-89806b44cd91 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:06.254251 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7c8dc-4ec8-4c0d-a843-89806b44cd91 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:06.302961 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-26f633e4-1250-49e5-8690-95be0f0a4052 None None] MFA Rules not processed for user `d2d3ed4b4a91453d83969d79c6ad15f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:06.304398 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-26f633e4-1250-49e5-8690-95be0f0a4052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:06.364665 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edc523-5c25-4577-bda8-89fe794212c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:06.367208 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edc523-5c25-4577-bda8-89fe794212c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:06.368070 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edc523-5c25-4577-bda8-89fe794212c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:06.368834 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edc523-5c25-4577-bda8-89fe794212c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:06.370806 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edc523-5c25-4577-bda8-89fe794212c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:06.375827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edc523-5c25-4577-bda8-89fe794212c0 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:06.446920 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1154/2343] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:46:06 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:46:06.448940 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edc523-5c25-4577-bda8-89fe794212c0 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:06.498898 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1190/2344] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:46:06.517857 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f633e4-1250-49e5-8690-95be0f0a4052 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:06.623107 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f633e4-1250-49e5-8690-95be0f0a4052 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:06.658611 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edc523-5c25-4577-bda8-89fe794212c0 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:06.678684 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb71cae-006a-4129-92b4-4f0679666c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:06.679324 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb71cae-006a-4129-92b4-4f0679666c40 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:06.679823 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb71cae-006a-4129-92b4-4f0679666c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:06.680148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb71cae-006a-4129-92b4-4f0679666c40 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:06.680771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb71cae-006a-4129-92b4-4f0679666c40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:06.683036 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb71cae-006a-4129-92b4-4f0679666c40 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:06.702008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31fcf8-6b50-489c-9e68-474380d00044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:06.703665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31fcf8-6b50-489c-9e68-474380d00044 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:06.705452 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31fcf8-6b50-489c-9e68-474380d00044 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:06.706764 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31fcf8-6b50-489c-9e68-474380d00044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:06.739963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1155/2345] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:46:06 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:06.741132 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb71cae-006a-4129-92b4-4f0679666c40 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:06.782470 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb71cae-006a-4129-92b4-4f0679666c40 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:06.798179 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11757de-63f6-472b-9e34-b612387cf9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:06.798816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11757de-63f6-472b-9e34-b612387cf9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:06.799098 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11757de-63f6-472b-9e34-b612387cf9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:06.801241 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11757de-63f6-472b-9e34-b612387cf9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:06.805779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11757de-63f6-472b-9e34-b612387cf9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:06.807426 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11757de-63f6-472b-9e34-b612387cf9c0 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:06.819590 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:06.829396 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1156/2346] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:06.832550 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11757de-63f6-472b-9e34-b612387cf9c0 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:06.865700 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11757de-63f6-472b-9e34-b612387cf9c0 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:06.884032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74457d6-1ac6-43c3-9787-0164dad84522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:06.884688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74457d6-1ac6-43c3-9787-0164dad84522 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:06.884971 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74457d6-1ac6-43c3-9787-0164dad84522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:06.885592 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74457d6-1ac6-43c3-9787-0164dad84522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:06.886121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74457d6-1ac6-43c3-9787-0164dad84522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:06.889080 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74457d6-1ac6-43c3-9787-0164dad84522 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:06.912145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1157/2347] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:06.919198 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74457d6-1ac6-43c3-9787-0164dad84522 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:06.930641 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31fcf8-6b50-489c-9e68-474380d00044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:06.932112 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31fcf8-6b50-489c-9e68-474380d00044 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:06.935342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74457d6-1ac6-43c3-9787-0164dad84522 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:06.942191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:06.950625 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c4f88-9ccc-4df3-874a-0cc769bb1c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:06.951313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c4f88-9ccc-4df3-874a-0cc769bb1c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:06.951597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c4f88-9ccc-4df3-874a-0cc769bb1c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:06.952105 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c4f88-9ccc-4df3-874a-0cc769bb1c96 admin admin] PATH_INFO: `/v3/projects/17befb21ba0347f2a5137d615cbc68fd/users/10b40da06bd043379b5c370d1bee7f64/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:06.968452 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1191/2348] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:06.989972 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c4f88-9ccc-4df3-874a-0cc769bb1c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17befb21ba0347f2a5137d615cbc68fd, user_id=10b40da06bd043379b5c370d1bee7f64, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:06.993237 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c4f88-9ccc-4df3-874a-0cc769bb1c96 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:07.031450 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1158/2349] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:46:06 2022] PUT /identity/v3/projects/17befb21ba0347f2a5137d615cbc68fd/users/10b40da06bd043379b5c370d1bee7f64/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:07.043745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfd2cf-7973-4b69-8d42-22cbeef3afca None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:07.044308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfd2cf-7973-4b69-8d42-22cbeef3afca None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:07.045690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfd2cf-7973-4b69-8d42-22cbeef3afca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:07.169150 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-a3cfd2cf-7973-4b69-8d42-22cbeef3afca None None] MFA Rules not processed for user `10b40da06bd043379b5c370d1bee7f64`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:07.171801 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a3cfd2cf-7973-4b69-8d42-22cbeef3afca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:07.182450 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c4f88-9ccc-4df3-874a-0cc769bb1c96 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:07.184231 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ca9c4f88-9ccc-4df3-874a-0cc769bb1c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:07.482535 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c4f88-9ccc-4df3-874a-0cc769bb1c96 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:07.509914 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f183f-97b9-44ba-b979-c4c2d503046e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:07.514688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f183f-97b9-44ba-b979-c4c2d503046e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:07.515810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f183f-97b9-44ba-b979-c4c2d503046e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:07.516162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f183f-97b9-44ba-b979-c4c2d503046e admin admin] PATH_INFO: `/v3/projects/2eb00e526dc14e91a2d8fbc5154f2f5b` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:07.529857 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f183f-97b9-44ba-b979-c4c2d503046e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eb00e526dc14e91a2d8fbc5154f2f5b)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:07.536402 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f183f-97b9-44ba-b979-c4c2d503046e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:07.544077 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1192/2350] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:07.551845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfd2cf-7973-4b69-8d42-22cbeef3afca None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:07.579546 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfd2cf-7973-4b69-8d42-22cbeef3afca None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:07.594452 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a2698-19dd-476c-9b43-0288f5891170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:07.597724 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a2698-19dd-476c-9b43-0288f5891170 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:07.598094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a2698-19dd-476c-9b43-0288f5891170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:07.598434 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a2698-19dd-476c-9b43-0288f5891170 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:07.599377 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a2698-19dd-476c-9b43-0288f5891170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:07.604653 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a2698-19dd-476c-9b43-0288f5891170 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:07.666466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-db7f183f-97b9-44ba-b979-c4c2d503046e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eb00e526dc14e91a2d8fbc5154f2f5b', 'request_id': 'req-db7f183f-97b9-44ba-b979-c4c2d503046e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:07.687274 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1193/2351] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:46:07 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:07.689628 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a2698-19dd-476c-9b43-0288f5891170 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:07.692129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-db7f183f-97b9-44ba-b979-c4c2d503046e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eb00e526dc14e91a2d8fbc5154f2f5b', 'request_id': 'req-db7f183f-97b9-44ba-b979-c4c2d503046e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:07.697705 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-151a2698-19dd-476c-9b43-0288f5891170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:07.707944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-db7f183f-97b9-44ba-b979-c4c2d503046e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eb00e526dc14e91a2d8fbc5154f2f5b', 'request_id': 'req-db7f183f-97b9-44ba-b979-c4c2d503046e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:07.743484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-db7f183f-97b9-44ba-b979-c4c2d503046e admin admin] The token cache is being invalidate because project 2eb00e526dc14e91a2d8fbc5154f2f5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:46:07.743818 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-db7f183f-97b9-44ba-b979-c4c2d503046e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:07.746086 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-db7f183f-97b9-44ba-b979-c4c2d503046e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:07.767039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1159/2352] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:46:07 2022] DELETE /identity/v3/projects/2eb00e526dc14e91a2d8fbc5154f2f5b => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:07.767039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f183f-97b9-44ba-b979-c4c2d503046e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:07.780414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-db7f183f-97b9-44ba-b979-c4c2d503046e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:07.934235 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a2698-19dd-476c-9b43-0288f5891170 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:07.949255 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e3ebe-e36c-49a6-a565-da5717825ec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:07.952900 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e3ebe-e36c-49a6-a565-da5717825ec3 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:07.957129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e3ebe-e36c-49a6-a565-da5717825ec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:07.957474 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e3ebe-e36c-49a6-a565-da5717825ec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:07.963253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b62e3ebe-e36c-49a6-a565-da5717825ec3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:08.007916 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:08.011760 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f183f-97b9-44ba-b979-c4c2d503046e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:08.128643 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e3ebe-e36c-49a6-a565-da5717825ec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:08.131387 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e3ebe-e36c-49a6-a565-da5717825ec3 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:08.162213 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1194/2353] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:08.163818 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968596a-7587-4dcb-8951-c9aa6a7737b4 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:08.163967 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968596a-7587-4dcb-8951-c9aa6a7737b4 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:08.164357 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968596a-7587-4dcb-8951-c9aa6a7737b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:08.212066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da985ae-be5e-47b0-9969-ffc55d8b77ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:08.213204 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da985ae-be5e-47b0-9969-ffc55d8b77ee admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:08.213800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da985ae-be5e-47b0-9969-ffc55d8b77ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:08.214213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da985ae-be5e-47b0-9969-ffc55d8b77ee admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:08.215011 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da985ae-be5e-47b0-9969-ffc55d8b77ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:08.218054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da985ae-be5e-47b0-9969-ffc55d8b77ee admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:08.219358 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-4968596a-7587-4dcb-8951-c9aa6a7737b4 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:08.224087 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4968596a-7587-4dcb-8951-c9aa6a7737b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:08.245341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1195/2354] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:08.256696 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658f98b-fabe-46c6-9b99-2bbfa81cb8af None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:08.257054 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658f98b-fabe-46c6-9b99-2bbfa81cb8af None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:08.257284 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658f98b-fabe-46c6-9b99-2bbfa81cb8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:08.288563 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f658f98b-fabe-46c6-9b99-2bbfa81cb8af None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:08.290063 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f658f98b-fabe-46c6-9b99-2bbfa81cb8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:08.291149 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1160/2355] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:46:07 2022] POST /identity/v3/users => generated 298 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:08.295803 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da985ae-be5e-47b0-9969-ffc55d8b77ee admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:08.303816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1196/2356] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:08.308015 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658f98b-fabe-46c6-9b99-2bbfa81cb8af None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:08.315989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da985ae-be5e-47b0-9969-ffc55d8b77ee admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:08.327524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50754f2-ec3d-4e3e-a38e-e355be574c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:08.328159 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50754f2-ec3d-4e3e-a38e-e355be574c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:08.328556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50754f2-ec3d-4e3e-a38e-e355be574c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:08.329014 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50754f2-ec3d-4e3e-a38e-e355be574c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:08.329924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50754f2-ec3d-4e3e-a38e-e355be574c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:08.331569 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658f98b-fabe-46c6-9b99-2bbfa81cb8af None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:08.331945 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50754f2-ec3d-4e3e-a38e-e355be574c01 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:08.349398 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1161/2357] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:08.350647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79823de-bc76-48ba-8837-927d0e070495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:08.351603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79823de-bc76-48ba-8837-927d0e070495 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:08.352155 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79823de-bc76-48ba-8837-927d0e070495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:08.353218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79823de-bc76-48ba-8837-927d0e070495 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:08.355340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50754f2-ec3d-4e3e-a38e-e355be574c01 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:08.357394 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79823de-bc76-48ba-8837-927d0e070495 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:46:08.357856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79823de-bc76-48ba-8837-927d0e070495 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:08.359793 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79823de-bc76-48ba-8837-927d0e070495 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:08.362227 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:08.376657 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50754f2-ec3d-4e3e-a38e-e355be574c01 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:08.391724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e593f2e-6205-4a52-ab7b-8a08fe9271f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:08.392515 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e593f2e-6205-4a52-ab7b-8a08fe9271f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:08.392803 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e593f2e-6205-4a52-ab7b-8a08fe9271f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:08.393103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e593f2e-6205-4a52-ab7b-8a08fe9271f2 admin admin] PATH_INFO: `/v3/projects/14fa7dbbaf974e08a24174547614a546/users/dcc8909918a445a2a7a49e6e6ecb03c9/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:08.400144 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1197/2358] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:46:08.404304 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79823de-bc76-48ba-8837-927d0e070495 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:08.433771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79823de-bc76-48ba-8837-927d0e070495 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:08.433961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e593f2e-6205-4a52-ab7b-8a08fe9271f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14fa7dbbaf974e08a24174547614a546, user_id=dcc8909918a445a2a7a49e6e6ecb03c9, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:08.437037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e593f2e-6205-4a52-ab7b-8a08fe9271f2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:08.444084 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bac5c9-155c-4389-8300-d81be5639191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:08.444714 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bac5c9-155c-4389-8300-d81be5639191 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:08.445135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bac5c9-155c-4389-8300-d81be5639191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:08.445423 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bac5c9-155c-4389-8300-d81be5639191 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:08.446525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bac5c9-155c-4389-8300-d81be5639191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:08.451296 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bac5c9-155c-4389-8300-d81be5639191 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:08.472436 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1162/2359] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:46:08 2022] PUT /identity/v3/projects/14fa7dbbaf974e08a24174547614a546/users/dcc8909918a445a2a7a49e6e6ecb03c9/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:08.477679 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e593f2e-6205-4a52-ab7b-8a08fe9271f2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:08.522300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1198/2360] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:46:08 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:08.527190 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bac5c9-155c-4389-8300-d81be5639191 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:08.639521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e593f2e-6205-4a52-ab7b-8a08fe9271f2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:08.660453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaeded7-9081-4eb9-9ef8-2eaff9a6bd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:08.661265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaeded7-9081-4eb9-9ef8-2eaff9a6bd44 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:08.661631 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaeded7-9081-4eb9-9ef8-2eaff9a6bd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:08.662115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaeded7-9081-4eb9-9ef8-2eaff9a6bd44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:08.662773 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaeded7-9081-4eb9-9ef8-2eaff9a6bd44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:08.664724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaeded7-9081-4eb9-9ef8-2eaff9a6bd44 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:08.677791 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bac5c9-155c-4389-8300-d81be5639191 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:08.688736 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6745169-c3aa-4570-8735-54b0be06b099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:08.689911 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6745169-c3aa-4570-8735-54b0be06b099 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:08.689911 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6745169-c3aa-4570-8735-54b0be06b099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:08.689911 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6745169-c3aa-4570-8735-54b0be06b099 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:08.690570 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6745169-c3aa-4570-8735-54b0be06b099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:08.692493 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6745169-c3aa-4570-8735-54b0be06b099 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:08.717521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1163/2361] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:08.720862 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaeded7-9081-4eb9-9ef8-2eaff9a6bd44 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:08.743792 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaeded7-9081-4eb9-9ef8-2eaff9a6bd44 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:08.750270 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1199/2362] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:46:08 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:08.751955 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6745169-c3aa-4570-8735-54b0be06b099 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:08.758229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf226c2-c401-4cdf-a97c-746651ee036f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:08.761225 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf226c2-c401-4cdf-a97c-746651ee036f admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:08.761900 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf226c2-c401-4cdf-a97c-746651ee036f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:08.762423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf226c2-c401-4cdf-a97c-746651ee036f admin admin] PATH_INFO: `/v3/projects/14fa7dbbaf974e08a24174547614a546/users/dcc8909918a445a2a7a49e6e6ecb03c9/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:08.769681 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6745169-c3aa-4570-8735-54b0be06b099 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:08.776960 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf226c2-c401-4cdf-a97c-746651ee036f admin admin] RBAC: Authorizing `identity:create_grant(project_id=14fa7dbbaf974e08a24174547614a546, user_id=dcc8909918a445a2a7a49e6e6ecb03c9, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:08.778351 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94903ba-acf5-4d8f-aaaa-794351e9cef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:08.779169 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94903ba-acf5-4d8f-aaaa-794351e9cef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:08.780599 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94903ba-acf5-4d8f-aaaa-794351e9cef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:08.781192 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94903ba-acf5-4d8f-aaaa-794351e9cef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:08.782041 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94903ba-acf5-4d8f-aaaa-794351e9cef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:08.783911 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94903ba-acf5-4d8f-aaaa-794351e9cef1 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:08.790078 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf226c2-c401-4cdf-a97c-746651ee036f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:08.802826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1200/2363] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:08.804817 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94903ba-acf5-4d8f-aaaa-794351e9cef1 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:08.819660 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94903ba-acf5-4d8f-aaaa-794351e9cef1 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:08.841134 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1164/2364] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:46:08 2022] PUT /identity/v3/projects/14fa7dbbaf974e08a24174547614a546/users/dcc8909918a445a2a7a49e6e6ecb03c9/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:08.847615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490b028-0ab4-414b-8466-4c79b200665f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:08.848358 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490b028-0ab4-414b-8466-4c79b200665f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:08.849522 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490b028-0ab4-414b-8466-4c79b200665f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:08.926051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f490b028-0ab4-414b-8466-4c79b200665f None None] MFA Rules not processed for user `dcc8909918a445a2a7a49e6e6ecb03c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:08.932215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f490b028-0ab4-414b-8466-4c79b200665f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:08.998495 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4019187-05d2-45a9-ac1c-673393de2658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:08.999173 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4019187-05d2-45a9-ac1c-673393de2658 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:08.999465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4019187-05d2-45a9-ac1c-673393de2658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:08.999871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4019187-05d2-45a9-ac1c-673393de2658 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:09.000887 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4019187-05d2-45a9-ac1c-673393de2658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:09.003113 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4019187-05d2-45a9-ac1c-673393de2658 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:09.042964 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:09.092082 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1201/2365] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:09.096563 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4019187-05d2-45a9-ac1c-673393de2658 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:09.119936 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4019187-05d2-45a9-ac1c-673393de2658 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:09.132845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753f6c0-66bb-4d69-9947-18104280f6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:09.133745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753f6c0-66bb-4d69-9947-18104280f6d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:09.134013 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753f6c0-66bb-4d69-9947-18104280f6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:09.134316 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753f6c0-66bb-4d69-9947-18104280f6d4 admin admin] PATH_INFO: `/v3/projects/c5e35e13d75e461b91d185bb70a99787/users/e1b875d395c44272896ee6e840ca4289/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:09.191156 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753f6c0-66bb-4d69-9947-18104280f6d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e35e13d75e461b91d185bb70a99787, user_id=e1b875d395c44272896ee6e840ca4289, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:09.195096 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753f6c0-66bb-4d69-9947-18104280f6d4 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:09.233147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1202/2366] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:46:09 2022] PUT /identity/v3/projects/c5e35e13d75e461b91d185bb70a99787/users/e1b875d395c44272896ee6e840ca4289/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:46:09.247950 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1165/2367] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:09.260906 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f18f7c-9c7c-4138-b41f-e5304c7ba6b9 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:09.260906 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f18f7c-9c7c-4138-b41f-e5304c7ba6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:09.260906 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f18f7c-9c7c-4138-b41f-e5304c7ba6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:09.276464 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490b028-0ab4-414b-8466-4c79b200665f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:09.278041 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f490b028-0ab4-414b-8466-4c79b200665f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:09.356871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-48f18f7c-9c7c-4138-b41f-e5304c7ba6b9 None None] MFA Rules not processed for user `e1b875d395c44272896ee6e840ca4289`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:09.362101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-48f18f7c-9c7c-4138-b41f-e5304c7ba6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:09.393830 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:09.419537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490b028-0ab4-414b-8466-4c79b200665f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:09.565804 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f986a3-f2f0-4e48-a85e-c5803e49744d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:09.565804 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f986a3-f2f0-4e48-a85e-c5803e49744d service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:09.565804 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f986a3-f2f0-4e48-a85e-c5803e49744d service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:09.565804 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f986a3-f2f0-4e48-a85e-c5803e49744d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:09.573534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-30f986a3-f2f0-4e48-a85e-c5803e49744d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:09.594537 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1203/2368] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:09.599881 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f18f7c-9c7c-4138-b41f-e5304c7ba6b9 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:09.766877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f18f7c-9c7c-4138-b41f-e5304c7ba6b9 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:09.779518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c272c-3c67-4ff1-80f5-d997148bb06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:09.780668 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c272c-3c67-4ff1-80f5-d997148bb06d admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:09.780668 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c272c-3c67-4ff1-80f5-d997148bb06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:09.780903 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c272c-3c67-4ff1-80f5-d997148bb06d admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:09.781400 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c272c-3c67-4ff1-80f5-d997148bb06d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:09.783347 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c272c-3c67-4ff1-80f5-d997148bb06d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:09.796360 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f986a3-f2f0-4e48-a85e-c5803e49744d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:09.813474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f986a3-f2f0-4e48-a85e-c5803e49744d service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:09.831275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1166/2369] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:46:09.834249 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f986a3-f2f0-4e48-a85e-c5803e49744d service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:09.836975 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-30f986a3-f2f0-4e48-a85e-c5803e49744d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:09.846923 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1204/2370] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:46:09 2022] POST /identity/v3/projects => generated 385 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:46:09.852246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c272c-3c67-4ff1-80f5-d997148bb06d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:09.860761 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f986a3-f2f0-4e48-a85e-c5803e49744d service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:09.951287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:09.997986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34ebc3-b7b8-49d3-b9fe-14dc3875f60e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:10.000005 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34ebc3-b7b8-49d3-b9fe-14dc3875f60e service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:10.002643 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34ebc3-b7b8-49d3-b9fe-14dc3875f60e service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:10.003037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34ebc3-b7b8-49d3-b9fe-14dc3875f60e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:10.008510 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6b34ebc3-b7b8-49d3-b9fe-14dc3875f60e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:10.019467 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c272c-3c67-4ff1-80f5-d997148bb06d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:10.034203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a18d0f-fe52-4187-b271-1df3091a517d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:10.036109 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a18d0f-fe52-4187-b271-1df3091a517d admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:10.038013 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a18d0f-fe52-4187-b271-1df3091a517d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:10.038393 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a18d0f-fe52-4187-b271-1df3091a517d admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:10.039192 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a18d0f-fe52-4187-b271-1df3091a517d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:10.042299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a18d0f-fe52-4187-b271-1df3091a517d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:10.100567 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1205/2371] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:46:09 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:10.104151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a18d0f-fe52-4187-b271-1df3091a517d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:10.125656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a18d0f-fe52-4187-b271-1df3091a517d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:10.133560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1a19b-4593-4b0a-9959-b7f4e2205552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:10.134195 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1a19b-4593-4b0a-9959-b7f4e2205552 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:10.134599 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1a19b-4593-4b0a-9959-b7f4e2205552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:10.134798 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1a19b-4593-4b0a-9959-b7f4e2205552 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:10.135583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1a19b-4593-4b0a-9959-b7f4e2205552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:10.137491 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1a19b-4593-4b0a-9959-b7f4e2205552 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:10.149941 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1206/2372] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:10.163352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1a19b-4593-4b0a-9959-b7f4e2205552 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:10.186906 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1a19b-4593-4b0a-9959-b7f4e2205552 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:10.198806 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34ebc3-b7b8-49d3-b9fe-14dc3875f60e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:10.199274 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ea7cf-6eb4-4ba7-b585-573faa746bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:10.200005 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ea7cf-6eb4-4ba7-b585-573faa746bbf admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:10.200813 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ea7cf-6eb4-4ba7-b585-573faa746bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:10.201214 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34ebc3-b7b8-49d3-b9fe-14dc3875f60e service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:10.201620 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ea7cf-6eb4-4ba7-b585-573faa746bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:10.203143 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ea7cf-6eb4-4ba7-b585-573faa746bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:10.206640 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ea7cf-6eb4-4ba7-b585-573faa746bbf admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:10.232765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1167/2373] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:10.232889 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1207/2374] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:10.234218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34ebc3-b7b8-49d3-b9fe-14dc3875f60e service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:10.248614 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34ebc3-b7b8-49d3-b9fe-14dc3875f60e service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:10.256509 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0165eb5-387d-4a26-b311-2e69ab087c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:10.258737 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0165eb5-387d-4a26-b311-2e69ab087c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:10.259017 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0165eb5-387d-4a26-b311-2e69ab087c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:10.259292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0165eb5-387d-4a26-b311-2e69ab087c78 admin admin] PATH_INFO: `/v3/projects/190b7d320752454a812fa559f8a7514c/users/02f28173e9804134bf9aa4afddbbe96c/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:10.279959 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0165eb5-387d-4a26-b311-2e69ab087c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=190b7d320752454a812fa559f8a7514c, user_id=02f28173e9804134bf9aa4afddbbe96c, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:10.284627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0165eb5-387d-4a26-b311-2e69ab087c78 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:10.324353 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1168/2375] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:46:10 2022] PUT /identity/v3/projects/190b7d320752454a812fa559f8a7514c/users/02f28173e9804134bf9aa4afddbbe96c/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:46:10.335166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4523679-e8a8-4e8c-94cd-c359029224c6 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:10.336090 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4523679-e8a8-4e8c-94cd-c359029224c6 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:10.336571 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4523679-e8a8-4e8c-94cd-c359029224c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:10.349565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:10.399726 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b4523679-e8a8-4e8c-94cd-c359029224c6 None None] MFA Rules not processed for user `02f28173e9804134bf9aa4afddbbe96c`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:10.402923 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b4523679-e8a8-4e8c-94cd-c359029224c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:10.568191 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0165eb5-387d-4a26-b311-2e69ab087c78 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:10.570182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e0165eb5-387d-4a26-b311-2e69ab087c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:10.577512 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1208/2376] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:10.587081 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4523679-e8a8-4e8c-94cd-c359029224c6 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:10.721314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4523679-e8a8-4e8c-94cd-c359029224c6 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:10.725706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0165eb5-387d-4a26-b311-2e69ab087c78 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:10.732319 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ec5e2-64ad-4525-bad0-6efa9b03244a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:10.733483 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ec5e2-64ad-4525-bad0-6efa9b03244a admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:10.734196 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ec5e2-64ad-4525-bad0-6efa9b03244a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:10.735395 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ec5e2-64ad-4525-bad0-6efa9b03244a admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:10.737499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520f444-798c-436a-9ab5-6033a190456b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:10.737499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520f444-798c-436a-9ab5-6033a190456b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:10.737499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520f444-798c-436a-9ab5-6033a190456b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:10.737764 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520f444-798c-436a-9ab5-6033a190456b admin admin] PATH_INFO: `/v3/users/d2d3ed4b4a91453d83969d79c6ad15f5` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:10.738426 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ec5e2-64ad-4525-bad0-6efa9b03244a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:10.741853 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520f444-798c-436a-9ab5-6033a190456b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2d3ed4b4a91453d83969d79c6ad15f5)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:10.744946 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ec5e2-64ad-4525-bad0-6efa9b03244a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:10.747175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520f444-798c-436a-9ab5-6033a190456b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:10.836424 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1209/2377] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:46:10 2022] POST /identity/v3/projects => generated 385 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:10.838107 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ec5e2-64ad-4525-bad0-6efa9b03244a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:10.893858 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1520f444-798c-436a-9ab5-6033a190456b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2d3ed4b4a91453d83969d79c6ad15f5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:10.914180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1520f444-798c-436a-9ab5-6033a190456b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2d3ed4b4a91453d83969d79c6ad15f5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:10.915246 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1520f444-798c-436a-9ab5-6033a190456b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2d3ed4b4a91453d83969d79c6ad15f5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:10.916173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1520f444-798c-436a-9ab5-6033a190456b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2d3ed4b4a91453d83969d79c6ad15f5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:10.925927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-1520f444-798c-436a-9ab5-6033a190456b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2d3ed4b4a91453d83969d79c6ad15f5'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:10.927992 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:10.999752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1169/2378] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:46:10 2022] DELETE /identity/v3/users/d2d3ed4b4a91453d83969d79c6ad15f5 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:11.003587 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70f14f-b87e-4244-8513-24ac24836843 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:11.004893 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70f14f-b87e-4244-8513-24ac24836843 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:11.005515 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70f14f-b87e-4244-8513-24ac24836843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:11.037212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ec5e2-64ad-4525-bad0-6efa9b03244a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:11.056861 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2d70f14f-b87e-4244-8513-24ac24836843 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:11.059570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2d70f14f-b87e-4244-8513-24ac24836843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:11.098599 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:11.207793 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1770e-7743-452f-97f5-879cc2268b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:11.210131 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1770e-7743-452f-97f5-879cc2268b35 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:11.212784 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1770e-7743-452f-97f5-879cc2268b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:11.213723 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1770e-7743-452f-97f5-879cc2268b35 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:11.215862 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b1770e-7743-452f-97f5-879cc2268b35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:11.224576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b1770e-7743-452f-97f5-879cc2268b35 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:11.239293 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1170/2379] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:11.264926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1210/2380] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:46:10 2022] POST /identity/v3/users => generated 299 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:11.268918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70f14f-b87e-4244-8513-24ac24836843 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:11.270472 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2d70f14f-b87e-4244-8513-24ac24836843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:11.283996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70f14f-b87e-4244-8513-24ac24836843 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:11.289246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1770e-7743-452f-97f5-879cc2268b35 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:11.291679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c1b1770e-7743-452f-97f5-879cc2268b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:11.314063 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7838d0-7d46-41e3-a2a2-336328d3ec6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:11.315024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7838d0-7d46-41e3-a2a2-336328d3ec6b admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:11.318298 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7838d0-7d46-41e3-a2a2-336328d3ec6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:11.325734 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7838d0-7d46-41e3-a2a2-336328d3ec6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:11.328114 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7838d0-7d46-41e3-a2a2-336328d3ec6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:11.344817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7838d0-7d46-41e3-a2a2-336328d3ec6b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:11.381813 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1171/2381] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:11.389839 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7838d0-7d46-41e3-a2a2-336328d3ec6b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:11.416107 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7838d0-7d46-41e3-a2a2-336328d3ec6b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:11.427683 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b6576-a1b0-4c40-8494-23f8abb7da92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:11.430725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b6576-a1b0-4c40-8494-23f8abb7da92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:11.431656 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b6576-a1b0-4c40-8494-23f8abb7da92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:11.432177 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b6576-a1b0-4c40-8494-23f8abb7da92 admin admin] PATH_INFO: `/v3/projects/c3286a81473f48f081b3c4c8cf406248/users/08c29bf1e3b346998b8b78710cd5afb4/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:11.466782 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b6576-a1b0-4c40-8494-23f8abb7da92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3286a81473f48f081b3c4c8cf406248, user_id=08c29bf1e3b346998b8b78710cd5afb4, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:11.467106 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1770e-7743-452f-97f5-879cc2268b35 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:11.472492 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b6576-a1b0-4c40-8494-23f8abb7da92 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:11.479238 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414a082-03e1-42fe-9f4c-6c16c523bebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:11.480107 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414a082-03e1-42fe-9f4c-6c16c523bebe service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:11.480448 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414a082-03e1-42fe-9f4c-6c16c523bebe service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:11.480790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414a082-03e1-42fe-9f4c-6c16c523bebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:11.503299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414a082-03e1-42fe-9f4c-6c16c523bebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:11.509269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1172/2382] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:46:11 2022] PUT /identity/v3/projects/c3286a81473f48f081b3c4c8cf406248/users/08c29bf1e3b346998b8b78710cd5afb4/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:11.511153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b6576-a1b0-4c40-8494-23f8abb7da92 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:11.511935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414a082-03e1-42fe-9f4c-6c16c523bebe service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:11.549168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1211/2383] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:11.702653 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b6576-a1b0-4c40-8494-23f8abb7da92 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:11.711691 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb73e5-765f-4525-bc02-76c272ebce24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:11.712532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb73e5-765f-4525-bc02-76c272ebce24 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:11.712901 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb73e5-765f-4525-bc02-76c272ebce24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:11.713170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb73e5-765f-4525-bc02-76c272ebce24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:11.713925 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb73e5-765f-4525-bc02-76c272ebce24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:11.718669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb73e5-765f-4525-bc02-76c272ebce24 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:11.744363 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414a082-03e1-42fe-9f4c-6c16c523bebe service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:11.760484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1173/2384] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:11.768208 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414a082-03e1-42fe-9f4c-6c16c523bebe service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:11.787770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d34c6-6017-4978-8e8e-3ec40991733e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:11.790502 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d34c6-6017-4978-8e8e-3ec40991733e admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:11.790801 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d34c6-6017-4978-8e8e-3ec40991733e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:11.791075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d34c6-6017-4978-8e8e-3ec40991733e admin admin] PATH_INFO: `/v3/projects/c3286a81473f48f081b3c4c8cf406248/users/08c29bf1e3b346998b8b78710cd5afb4/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:11.795885 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d34c6-6017-4978-8e8e-3ec40991733e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3286a81473f48f081b3c4c8cf406248, user_id=08c29bf1e3b346998b8b78710cd5afb4, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:11.804589 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d34c6-6017-4978-8e8e-3ec40991733e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:11.860438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1212/2385] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:46:11 2022] PUT /identity/v3/projects/c3286a81473f48f081b3c4c8cf406248/users/08c29bf1e3b346998b8b78710cd5afb4/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:11.862005 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfab47e-a7d2-4b2a-acc9-9a79f6dcb1c4 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:11.863021 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfab47e-a7d2-4b2a-acc9-9a79f6dcb1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:11.863021 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfab47e-a7d2-4b2a-acc9-9a79f6dcb1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:11.939947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9cfab47e-a7d2-4b2a-acc9-9a79f6dcb1c4 None None] MFA Rules not processed for user `08c29bf1e3b346998b8b78710cd5afb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:11.944051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9cfab47e-a7d2-4b2a-acc9-9a79f6dcb1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:12.072269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:12.144577 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d34c6-6017-4978-8e8e-3ec40991733e admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:12.148985 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-594d34c6-6017-4978-8e8e-3ec40991733e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:12.203998 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1174/2386] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:12.309232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d34c6-6017-4978-8e8e-3ec40991733e admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:12.334594 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332efb7-b5f1-45ff-8a65-6c08a25a21cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:12.335249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332efb7-b5f1-45ff-8a65-6c08a25a21cf service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:12.335535 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332efb7-b5f1-45ff-8a65-6c08a25a21cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:12.346499 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332efb7-b5f1-45ff-8a65-6c08a25a21cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:12.352041 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c332efb7-b5f1-45ff-8a65-6c08a25a21cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:12.355808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfab47e-a7d2-4b2a-acc9-9a79f6dcb1c4 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:12.357303 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9cfab47e-a7d2-4b2a-acc9-9a79f6dcb1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:12.389671 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfab47e-a7d2-4b2a-acc9-9a79f6dcb1c4 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:12.403243 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4041c1-186c-41ab-8018-3a5ac6d431cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:12.404081 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4041c1-186c-41ab-8018-3a5ac6d431cc service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:12.404636 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4041c1-186c-41ab-8018-3a5ac6d431cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:12.405158 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4041c1-186c-41ab-8018-3a5ac6d431cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:12.410104 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-da4041c1-186c-41ab-8018-3a5ac6d431cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:12.546539 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332efb7-b5f1-45ff-8a65-6c08a25a21cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:12.548790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332efb7-b5f1-45ff-8a65-6c08a25a21cf service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:12.582159 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:12.604458 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1213/2387] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:46:12.608578 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4041c1-186c-41ab-8018-3a5ac6d431cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:12.610268 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4041c1-186c-41ab-8018-3a5ac6d431cc service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:12.637103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1175/2388] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:13.748608 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332efb7-b5f1-45ff-8a65-6c08a25a21cf service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:13.757606 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332efb7-b5f1-45ff-8a65-6c08a25a21cf service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:13.762082 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31f98e-f68d-4d51-86ec-8918d5d27d5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:13.762825 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31f98e-f68d-4d51-86ec-8918d5d27d5b service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:13.763120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31f98e-f68d-4d51-86ec-8918d5d27d5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:13.763397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31f98e-f68d-4d51-86ec-8918d5d27d5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:13.765338 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cd31f98e-f68d-4d51-86ec-8918d5d27d5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:13.815650 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4041c1-186c-41ab-8018-3a5ac6d431cc service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:13.818532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-da4041c1-186c-41ab-8018-3a5ac6d431cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:13.897656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31f98e-f68d-4d51-86ec-8918d5d27d5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:13.899340 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31f98e-f68d-4d51-86ec-8918d5d27d5b service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:13.921727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1214/2389] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:13.935559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4041c1-186c-41ab-8018-3a5ac6d431cc service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:13.950152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da34bfa-7f14-42ee-8619-edc5fbc3546f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:13.951411 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da34bfa-7f14-42ee-8619-edc5fbc3546f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:13.951872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da34bfa-7f14-42ee-8619-edc5fbc3546f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:13.952225 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da34bfa-7f14-42ee-8619-edc5fbc3546f admin admin] PATH_INFO: `/v3/projects/248f2b11e3d64b248de0867c10cc120f` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:13.953817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da34bfa-7f14-42ee-8619-edc5fbc3546f admin admin] RBAC: Authorizing `identity:delete_project(project_id=248f2b11e3d64b248de0867c10cc120f)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:13.956371 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da34bfa-7f14-42ee-8619-edc5fbc3546f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:14.066212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9da34bfa-7f14-42ee-8619-edc5fbc3546f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '248f2b11e3d64b248de0867c10cc120f', 'request_id': 'req-9da34bfa-7f14-42ee-8619-edc5fbc3546f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:14.093941 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9da34bfa-7f14-42ee-8619-edc5fbc3546f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '248f2b11e3d64b248de0867c10cc120f', 'request_id': 'req-9da34bfa-7f14-42ee-8619-edc5fbc3546f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:14.110283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9da34bfa-7f14-42ee-8619-edc5fbc3546f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '248f2b11e3d64b248de0867c10cc120f', 'request_id': 'req-9da34bfa-7f14-42ee-8619-edc5fbc3546f'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:14.113546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:14.128106 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9da34bfa-7f14-42ee-8619-edc5fbc3546f admin admin] The token cache is being invalidate because project 248f2b11e3d64b248de0867c10cc120f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:46:14.128404 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9da34bfa-7f14-42ee-8619-edc5fbc3546f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:14.129330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9da34bfa-7f14-42ee-8619-edc5fbc3546f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:14.131798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1176/2390] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:46:13 2022] DELETE /identity/v3/projects/248f2b11e3d64b248de0867c10cc120f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:14.141977 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bee5da-06f5-4faa-84ea-a4f26e06fa41 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:14.142338 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bee5da-06f5-4faa-84ea-a4f26e06fa41 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:14.142943 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bee5da-06f5-4faa-84ea-a4f26e06fa41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:14.166372 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-12bee5da-06f5-4faa-84ea-a4f26e06fa41 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:14.167625 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-12bee5da-06f5-4faa-84ea-a4f26e06fa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:14.289241 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7226c4c-4aae-47e3-a2a0-7b3d22824d01 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:14.289509 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7226c4c-4aae-47e3-a2a0-7b3d22824d01 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:14.290167 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7226c4c-4aae-47e3-a2a0-7b3d22824d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:14.293359 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1215/2391] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:14.329450 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a7226c4c-4aae-47e3-a2a0-7b3d22824d01 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:14.332879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a7226c4c-4aae-47e3-a2a0-7b3d22824d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:14.351543 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1177/2392] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:14.355986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bee5da-06f5-4faa-84ea-a4f26e06fa41 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:14.397243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bee5da-06f5-4faa-84ea-a4f26e06fa41 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:14.417896 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e7e0e-a56b-4340-bf97-1aacfb6bd716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:14.418536 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e7e0e-a56b-4340-bf97-1aacfb6bd716 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:14.418855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e7e0e-a56b-4340-bf97-1aacfb6bd716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:14.419139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e7e0e-a56b-4340-bf97-1aacfb6bd716 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:14.419841 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e7e0e-a56b-4340-bf97-1aacfb6bd716 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:46:14.420152 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e7e0e-a56b-4340-bf97-1aacfb6bd716 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:14.421783 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e7e0e-a56b-4340-bf97-1aacfb6bd716 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:14.440013 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1216/2393] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:46:14.441632 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7226c4c-4aae-47e3-a2a0-7b3d22824d01 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:14.452453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7226c4c-4aae-47e3-a2a0-7b3d22824d01 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:14.457668 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f888bf5-cc8f-4e35-9181-ae4061ab295f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:14.465470 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f888bf5-cc8f-4e35-9181-ae4061ab295f admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:14.465662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f888bf5-cc8f-4e35-9181-ae4061ab295f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:14.465943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f888bf5-cc8f-4e35-9181-ae4061ab295f admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:14.466640 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f888bf5-cc8f-4e35-9181-ae4061ab295f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:14.471517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f888bf5-cc8f-4e35-9181-ae4061ab295f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:14.534475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1178/2394] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:46:14 2022] POST /identity/v3/projects => generated 365 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:14.536031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e7e0e-a56b-4340-bf97-1aacfb6bd716 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:14.547872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e7e0e-a56b-4340-bf97-1aacfb6bd716 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:14.632116 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f3851-e3de-49b8-9b4d-88f354bf61a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:14.633510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f3851-e3de-49b8-9b4d-88f354bf61a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:14.634023 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f3851-e3de-49b8-9b4d-88f354bf61a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:14.634303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f3851-e3de-49b8-9b4d-88f354bf61a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:14.634979 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f3851-e3de-49b8-9b4d-88f354bf61a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:14.637202 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f3851-e3de-49b8-9b4d-88f354bf61a2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:14.690252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1217/2395] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:46:14 2022] POST /identity/v3/users => generated 283 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:14.691653 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f888bf5-cc8f-4e35-9181-ae4061ab295f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:14.705967 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f888bf5-cc8f-4e35-9181-ae4061ab295f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:14.712386 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf9f7f-a68a-4ca8-8c40-c0713e214f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:14.713479 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf9f7f-a68a-4ca8-8c40-c0713e214f6c admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:14.713818 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf9f7f-a68a-4ca8-8c40-c0713e214f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:14.718258 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf9f7f-a68a-4ca8-8c40-c0713e214f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:14.718258 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf9f7f-a68a-4ca8-8c40-c0713e214f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:14.718258 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf9f7f-a68a-4ca8-8c40-c0713e214f6c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:14.729751 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1179/2396] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:14.734063 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f3851-e3de-49b8-9b4d-88f354bf61a2 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:14.747429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f3851-e3de-49b8-9b4d-88f354bf61a2 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:14.758318 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce84d7b-acb5-44a9-92b3-a7d45127fecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:14.759169 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce84d7b-acb5-44a9-92b3-a7d45127fecf admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:14.761299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce84d7b-acb5-44a9-92b3-a7d45127fecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:14.761299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce84d7b-acb5-44a9-92b3-a7d45127fecf admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:14.761299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce84d7b-acb5-44a9-92b3-a7d45127fecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:14.764602 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce84d7b-acb5-44a9-92b3-a7d45127fecf admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:14.771229 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:14.782422 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf9f7f-a68a-4ca8-8c40-c0713e214f6c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:14.791906 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1218/2397] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:14.800888 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf9f7f-a68a-4ca8-8c40-c0713e214f6c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:14.818392 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715362e-066b-4996-9a1c-f396ca52f914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:14.819091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715362e-066b-4996-9a1c-f396ca52f914 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:14.819339 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715362e-066b-4996-9a1c-f396ca52f914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:14.819733 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715362e-066b-4996-9a1c-f396ca52f914 admin admin] PATH_INFO: `/v3/projects/d59dffacd0744fe1a7f2b167cb2b9f4a/users/b9f828d9035b40c08ed1a0dd4d71cae0/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:14.855076 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715362e-066b-4996-9a1c-f396ca52f914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59dffacd0744fe1a7f2b167cb2b9f4a, user_id=b9f828d9035b40c08ed1a0dd4d71cae0, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:14.859965 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715362e-066b-4996-9a1c-f396ca52f914 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:14.882850 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce84d7b-acb5-44a9-92b3-a7d45127fecf admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:14.884598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4ce84d7b-acb5-44a9-92b3-a7d45127fecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:14.900762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1180/2398] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:46:14 2022] PUT /identity/v3/projects/d59dffacd0744fe1a7f2b167cb2b9f4a/users/b9f828d9035b40c08ed1a0dd4d71cae0/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:46:14.912332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defec1d-38dd-4cfa-ab3a-1078895c7e73 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:14.913017 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defec1d-38dd-4cfa-ab3a-1078895c7e73 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:14.913631 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defec1d-38dd-4cfa-ab3a-1078895c7e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:14.960818 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1defec1d-38dd-4cfa-ab3a-1078895c7e73 None None] MFA Rules not processed for user `b9f828d9035b40c08ed1a0dd4d71cae0`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:14.962355 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1defec1d-38dd-4cfa-ab3a-1078895c7e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:15.020220 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce84d7b-acb5-44a9-92b3-a7d45127fecf admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:15.145696 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365fc46-7c17-41d2-95a5-3b20a1be6359 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:15.147509 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365fc46-7c17-41d2-95a5-3b20a1be6359 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:15.147933 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365fc46-7c17-41d2-95a5-3b20a1be6359 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:15.148911 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365fc46-7c17-41d2-95a5-3b20a1be6359 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:15.154298 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9365fc46-7c17-41d2-95a5-3b20a1be6359 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:15.172547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1181/2399] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:46:15.281575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365fc46-7c17-41d2-95a5-3b20a1be6359 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:15.284373 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365fc46-7c17-41d2-95a5-3b20a1be6359 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:15.319388 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1219/2400] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:46:15.523680 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defec1d-38dd-4cfa-ab3a-1078895c7e73 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:15.526015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1defec1d-38dd-4cfa-ab3a-1078895c7e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:15.541592 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365fc46-7c17-41d2-95a5-3b20a1be6359 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:15.543158 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9365fc46-7c17-41d2-95a5-3b20a1be6359 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:15.555454 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365fc46-7c17-41d2-95a5-3b20a1be6359 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:15.559508 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010b8db-836f-46e2-8cf0-a5f786d6e16f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:15.560126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010b8db-836f-46e2-8cf0-a5f786d6e16f service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:15.560407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010b8db-836f-46e2-8cf0-a5f786d6e16f service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:15.560783 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010b8db-836f-46e2-8cf0-a5f786d6e16f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:15.570340 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010b8db-836f-46e2-8cf0-a5f786d6e16f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:15.571991 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010b8db-836f-46e2-8cf0-a5f786d6e16f service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:15.612727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1220/2401] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:15.678744 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defec1d-38dd-4cfa-ab3a-1078895c7e73 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:15.685218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d6d57-743e-45e4-940a-b6954fd7997f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:15.686337 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d6d57-743e-45e4-940a-b6954fd7997f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:15.687270 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d6d57-743e-45e4-940a-b6954fd7997f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:15.688632 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d6d57-743e-45e4-940a-b6954fd7997f admin admin] PATH_INFO: `/v3/users/1ffaa17d196845f6b2b7546b8ffebbe8` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:15.690343 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d6d57-743e-45e4-940a-b6954fd7997f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ffaa17d196845f6b2b7546b8ffebbe8)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:15.693994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d6d57-743e-45e4-940a-b6954fd7997f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:15.731025 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:15.795028 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-386d6d57-743e-45e4-940a-b6954fd7997f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ffaa17d196845f6b2b7546b8ffebbe8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:15.815046 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-386d6d57-743e-45e4-940a-b6954fd7997f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ffaa17d196845f6b2b7546b8ffebbe8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:15.815692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-386d6d57-743e-45e4-940a-b6954fd7997f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ffaa17d196845f6b2b7546b8ffebbe8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:15.816368 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-386d6d57-743e-45e4-940a-b6954fd7997f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ffaa17d196845f6b2b7546b8ffebbe8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:15.827601 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-386d6d57-743e-45e4-940a-b6954fd7997f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ffaa17d196845f6b2b7546b8ffebbe8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:15.896374 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1182/2402] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:46:15 2022] DELETE /identity/v3/users/1ffaa17d196845f6b2b7546b8ffebbe8 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:15.901365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ecf49-31bf-4529-ae6e-3daf28f38e25 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:15.901849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ecf49-31bf-4529-ae6e-3daf28f38e25 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:15.901927 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ecf49-31bf-4529-ae6e-3daf28f38e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:15.946745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8d5ecf49-31bf-4529-ae6e-3daf28f38e25 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:15.952389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8d5ecf49-31bf-4529-ae6e-3daf28f38e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:16.062649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:16.079751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1221/2403] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:16.093858 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d6d57-743e-45e4-940a-b6954fd7997f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:16.097952 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-386d6d57-743e-45e4-940a-b6954fd7997f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:16.271001 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d6d57-743e-45e4-940a-b6954fd7997f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:16.282238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f95f1-867b-44eb-b294-28e4954c8d3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:16.284665 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f95f1-867b-44eb-b294-28e4954c8d3d service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:16.285818 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f95f1-867b-44eb-b294-28e4954c8d3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:16.286638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f95f1-867b-44eb-b294-28e4954c8d3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:16.336326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f95f1-867b-44eb-b294-28e4954c8d3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:16.346958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f95f1-867b-44eb-b294-28e4954c8d3d service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:16.359249 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1183/2404] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:16.556735 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ecf49-31bf-4529-ae6e-3daf28f38e25 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:16.560819 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8d5ecf49-31bf-4529-ae6e-3daf28f38e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:16.758457 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ecf49-31bf-4529-ae6e-3daf28f38e25 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:16.778926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a1e5a-b39b-4c1f-bc7d-5f74c0591dc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:16.779823 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a1e5a-b39b-4c1f-bc7d-5f74c0591dc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:16.780109 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a1e5a-b39b-4c1f-bc7d-5f74c0591dc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:16.780380 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a1e5a-b39b-4c1f-bc7d-5f74c0591dc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:16.789411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-877a1e5a-b39b-4c1f-bc7d-5f74c0591dc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:17.024594 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a1e5a-b39b-4c1f-bc7d-5f74c0591dc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:17.032069 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a1e5a-b39b-4c1f-bc7d-5f74c0591dc5 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:17.087937 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1222/2405] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:17.102240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f95f1-867b-44eb-b294-28e4954c8d3d service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:17.104219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d60f95f1-867b-44eb-b294-28e4954c8d3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:17.137732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f95f1-867b-44eb-b294-28e4954c8d3d service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:17.179143 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca60f6-2791-415f-a045-32d88dfdef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:17.180327 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca60f6-2791-415f-a045-32d88dfdef5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:17.180327 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca60f6-2791-415f-a045-32d88dfdef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:17.180327 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca60f6-2791-415f-a045-32d88dfdef5b admin admin] PATH_INFO: `/v3/projects/ee04979a81084625852fbac3756d420f` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:17.181730 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca60f6-2791-415f-a045-32d88dfdef5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee04979a81084625852fbac3756d420f)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:17.185902 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca60f6-2791-415f-a045-32d88dfdef5b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:17.459106 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c7ca60f6-2791-415f-a045-32d88dfdef5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee04979a81084625852fbac3756d420f', 'request_id': 'req-c7ca60f6-2791-415f-a045-32d88dfdef5b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:17.476168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c7ca60f6-2791-415f-a045-32d88dfdef5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee04979a81084625852fbac3756d420f', 'request_id': 'req-c7ca60f6-2791-415f-a045-32d88dfdef5b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:17.491452 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c7ca60f6-2791-415f-a045-32d88dfdef5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee04979a81084625852fbac3756d420f', 'request_id': 'req-c7ca60f6-2791-415f-a045-32d88dfdef5b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:17.516170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c7ca60f6-2791-415f-a045-32d88dfdef5b admin admin] The token cache is being invalidate because project ee04979a81084625852fbac3756d420f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:46:17.516515 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c7ca60f6-2791-415f-a045-32d88dfdef5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:17.519425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c7ca60f6-2791-415f-a045-32d88dfdef5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:17.522257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1184/2406] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:46:17 2022] DELETE /identity/v3/projects/ee04979a81084625852fbac3756d420f => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:17.525999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a1e5a-b39b-4c1f-bc7d-5f74c0591dc5 service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:17.542389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a1e5a-b39b-4c1f-bc7d-5f74c0591dc5 service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:17.704924 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770473cf-21f3-493a-aba2-3e2389ec317d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:17.705607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770473cf-21f3-493a-aba2-3e2389ec317d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:17.705887 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770473cf-21f3-493a-aba2-3e2389ec317d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:17.706164 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770473cf-21f3-493a-aba2-3e2389ec317d admin admin] PATH_INFO: `/v3/users/a6ca9303a8574658acccd6d6edbb5bf7` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:17.707344 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770473cf-21f3-493a-aba2-3e2389ec317d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6ca9303a8574658acccd6d6edbb5bf7)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:17.710298 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770473cf-21f3-493a-aba2-3e2389ec317d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:17.843353 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-770473cf-21f3-493a-aba2-3e2389ec317d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6ca9303a8574658acccd6d6edbb5bf7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:17.852549 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:17.868354 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-770473cf-21f3-493a-aba2-3e2389ec317d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6ca9303a8574658acccd6d6edbb5bf7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:17.871110 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-770473cf-21f3-493a-aba2-3e2389ec317d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6ca9303a8574658acccd6d6edbb5bf7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:17.874912 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-770473cf-21f3-493a-aba2-3e2389ec317d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6ca9303a8574658acccd6d6edbb5bf7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:17.907833 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-770473cf-21f3-493a-aba2-3e2389ec317d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6ca9303a8574658acccd6d6edbb5bf7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:17.977544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1223/2407] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:46:17 2022] DELETE /identity/v3/users/a6ca9303a8574658acccd6d6edbb5bf7 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:18.374844 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca60f6-2791-415f-a045-32d88dfdef5b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:18.377069 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c7ca60f6-2791-415f-a045-32d88dfdef5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:18.403144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca60f6-2791-415f-a045-32d88dfdef5b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:18.467315 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:18.579163 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03947562-fffa-4558-8d68-a45c70f09b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:18.579916 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03947562-fffa-4558-8d68-a45c70f09b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:18.580136 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03947562-fffa-4558-8d68-a45c70f09b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:18.580435 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03947562-fffa-4558-8d68-a45c70f09b07 admin admin] PATH_INFO: `/v3/users/8cd1efe137d042fc9258e2849162dc4c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:18.584467 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03947562-fffa-4558-8d68-a45c70f09b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cd1efe137d042fc9258e2849162dc4c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:18.586831 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03947562-fffa-4558-8d68-a45c70f09b07 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:19.064734 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-03947562-fffa-4558-8d68-a45c70f09b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cd1efe137d042fc9258e2849162dc4c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:19.081842 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-03947562-fffa-4558-8d68-a45c70f09b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cd1efe137d042fc9258e2849162dc4c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:19.082591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-03947562-fffa-4558-8d68-a45c70f09b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cd1efe137d042fc9258e2849162dc4c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:19.085783 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-03947562-fffa-4558-8d68-a45c70f09b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cd1efe137d042fc9258e2849162dc4c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:19.099756 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-03947562-fffa-4558-8d68-a45c70f09b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cd1efe137d042fc9258e2849162dc4c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:19.127185 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1185/2408] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:46:18 2022] DELETE /identity/v3/users/8cd1efe137d042fc9258e2849162dc4c => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:19.132116 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708c21d-eb78-4f37-aa6e-a7e339420598 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:19.132566 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708c21d-eb78-4f37-aa6e-a7e339420598 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:19.132566 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708c21d-eb78-4f37-aa6e-a7e339420598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:19.186473 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-a708c21d-eb78-4f37-aa6e-a7e339420598 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:19.189727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a708c21d-eb78-4f37-aa6e-a7e339420598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:19.382098 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1224/2409] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:19.394800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03947562-fffa-4558-8d68-a45c70f09b07 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:19.396824 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-03947562-fffa-4558-8d68-a45c70f09b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:19.493751 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03947562-fffa-4558-8d68-a45c70f09b07 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:19.497583 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3048f9e-87b3-4980-83d5-07a05b25a2f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:19.498411 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3048f9e-87b3-4980-83d5-07a05b25a2f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:19.498804 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3048f9e-87b3-4980-83d5-07a05b25a2f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:19.498968 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3048f9e-87b3-4980-83d5-07a05b25a2f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:19.511186 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3048f9e-87b3-4980-83d5-07a05b25a2f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:19.512917 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3048f9e-87b3-4980-83d5-07a05b25a2f3 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:19.524157 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708c21d-eb78-4f37-aa6e-a7e339420598 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:19.526082 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a708c21d-eb78-4f37-aa6e-a7e339420598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:19.530725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1186/2410] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:19.542519 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708c21d-eb78-4f37-aa6e-a7e339420598 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:19.547590 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a92c0e-f713-4112-8e3a-fe85c4ddb0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:19.548713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a92c0e-f713-4112-8e3a-fe85c4ddb0fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:19.549230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a92c0e-f713-4112-8e3a-fe85c4ddb0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:19.557952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a92c0e-f713-4112-8e3a-fe85c4ddb0fd admin admin] PATH_INFO: `/v3/projects/b789916ef64e415d8e1649947e9bc52a` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:19.562529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a92c0e-f713-4112-8e3a-fe85c4ddb0fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b789916ef64e415d8e1649947e9bc52a)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:19.565642 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a92c0e-f713-4112-8e3a-fe85c4ddb0fd admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:19.620008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c3a92c0e-f713-4112-8e3a-fe85c4ddb0fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b789916ef64e415d8e1649947e9bc52a', 'request_id': 'req-c3a92c0e-f713-4112-8e3a-fe85c4ddb0fd'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:19.626119 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c3a92c0e-f713-4112-8e3a-fe85c4ddb0fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b789916ef64e415d8e1649947e9bc52a', 'request_id': 'req-c3a92c0e-f713-4112-8e3a-fe85c4ddb0fd'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:19.633747 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c3a92c0e-f713-4112-8e3a-fe85c4ddb0fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b789916ef64e415d8e1649947e9bc52a', 'request_id': 'req-c3a92c0e-f713-4112-8e3a-fe85c4ddb0fd'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:19.645951 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c3a92c0e-f713-4112-8e3a-fe85c4ddb0fd admin admin] The token cache is being invalidate because project b789916ef64e415d8e1649947e9bc52a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:46:19.646374 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c3a92c0e-f713-4112-8e3a-fe85c4ddb0fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:19.646932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c3a92c0e-f713-4112-8e3a-fe85c4ddb0fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:19.648586 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1225/2411] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:46:19 2022] DELETE /identity/v3/projects/b789916ef64e415d8e1649947e9bc52a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:46:19.653150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3048f9e-87b3-4980-83d5-07a05b25a2f3 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:19.662734 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3048f9e-87b3-4980-83d5-07a05b25a2f3 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:19.719524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:19.742562 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f73889-2480-49e6-bffe-4eb62202fa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:19.743489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f73889-2480-49e6-bffe-4eb62202fa0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:19.744232 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f73889-2480-49e6-bffe-4eb62202fa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:19.744743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f73889-2480-49e6-bffe-4eb62202fa0e admin admin] PATH_INFO: `/v3/users/72b475858db8420080b032b3794bfb88` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:19.746220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f73889-2480-49e6-bffe-4eb62202fa0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=72b475858db8420080b032b3794bfb88)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:19.749057 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f73889-2480-49e6-bffe-4eb62202fa0e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:19.842827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a6f73889-2480-49e6-bffe-4eb62202fa0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72b475858db8420080b032b3794bfb88'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:19.854204 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a6f73889-2480-49e6-bffe-4eb62202fa0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72b475858db8420080b032b3794bfb88'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:19.855218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a6f73889-2480-49e6-bffe-4eb62202fa0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72b475858db8420080b032b3794bfb88'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:19.855996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a6f73889-2480-49e6-bffe-4eb62202fa0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72b475858db8420080b032b3794bfb88'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:19.867763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a6f73889-2480-49e6-bffe-4eb62202fa0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72b475858db8420080b032b3794bfb88'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:19.901910 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a92c0e-f713-4112-8e3a-fe85c4ddb0fd admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:19.903446 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c3a92c0e-f713-4112-8e3a-fe85c4ddb0fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:19.907326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1187/2412] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:46:19 2022] DELETE /identity/v3/users/72b475858db8420080b032b3794bfb88 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:46:19.920547 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a92c0e-f713-4112-8e3a-fe85c4ddb0fd admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:20.002640 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:20.020549 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba99df1-59c4-4243-8c0d-5fb394788d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:20.021309 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba99df1-59c4-4243-8c0d-5fb394788d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:20.021659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba99df1-59c4-4243-8c0d-5fb394788d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:20.022003 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba99df1-59c4-4243-8c0d-5fb394788d8d admin admin] PATH_INFO: `/v3/projects/e68669c80f8c4b4bbdce962f84ee260b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:20.023233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba99df1-59c4-4243-8c0d-5fb394788d8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e68669c80f8c4b4bbdce962f84ee260b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:20.029125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba99df1-59c4-4243-8c0d-5fb394788d8d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:20.109311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1ba99df1-59c4-4243-8c0d-5fb394788d8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e68669c80f8c4b4bbdce962f84ee260b', 'request_id': 'req-1ba99df1-59c4-4243-8c0d-5fb394788d8d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:20.118809 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1ba99df1-59c4-4243-8c0d-5fb394788d8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e68669c80f8c4b4bbdce962f84ee260b', 'request_id': 'req-1ba99df1-59c4-4243-8c0d-5fb394788d8d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:20.128234 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1ba99df1-59c4-4243-8c0d-5fb394788d8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e68669c80f8c4b4bbdce962f84ee260b', 'request_id': 'req-1ba99df1-59c4-4243-8c0d-5fb394788d8d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:20.165226 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1ba99df1-59c4-4243-8c0d-5fb394788d8d admin admin] The token cache is being invalidate because project e68669c80f8c4b4bbdce962f84ee260b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:46:20.165962 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1ba99df1-59c4-4243-8c0d-5fb394788d8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:20.166142 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-1ba99df1-59c4-4243-8c0d-5fb394788d8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:20.175379 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1226/2413] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:46:19 2022] DELETE /identity/v3/projects/e68669c80f8c4b4bbdce962f84ee260b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:46:20.175481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f73889-2480-49e6-bffe-4eb62202fa0e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:20.177528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a6f73889-2480-49e6-bffe-4eb62202fa0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:20.191710 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f73889-2480-49e6-bffe-4eb62202fa0e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:20.294451 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba99df1-59c4-4243-8c0d-5fb394788d8d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:20.296067 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1ba99df1-59c4-4243-8c0d-5fb394788d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:20.362527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edb2ec-42d3-40dd-ad02-96e89658a4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:20.363176 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edb2ec-42d3-40dd-ad02-96e89658a4b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:20.363452 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edb2ec-42d3-40dd-ad02-96e89658a4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:20.363452 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edb2ec-42d3-40dd-ad02-96e89658a4b9 admin admin] PATH_INFO: `/v3/users/10b40da06bd043379b5c370d1bee7f64` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:20.371887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edb2ec-42d3-40dd-ad02-96e89658a4b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b40da06bd043379b5c370d1bee7f64)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:20.373883 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edb2ec-42d3-40dd-ad02-96e89658a4b9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:20.464990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e4edb2ec-42d3-40dd-ad02-96e89658a4b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b40da06bd043379b5c370d1bee7f64'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:20.487276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba99df1-59c4-4243-8c0d-5fb394788d8d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:20.487824 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e4edb2ec-42d3-40dd-ad02-96e89658a4b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b40da06bd043379b5c370d1bee7f64'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:20.490033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e4edb2ec-42d3-40dd-ad02-96e89658a4b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b40da06bd043379b5c370d1bee7f64'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:20.491278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e4edb2ec-42d3-40dd-ad02-96e89658a4b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b40da06bd043379b5c370d1bee7f64'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:20.509235 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e4edb2ec-42d3-40dd-ad02-96e89658a4b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b40da06bd043379b5c370d1bee7f64'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:20.511246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c71015-da92-4cbf-bb39-a40dbab9f75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:20.511911 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c71015-da92-4cbf-bb39-a40dbab9f75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:20.512362 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c71015-da92-4cbf-bb39-a40dbab9f75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:20.512785 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c71015-da92-4cbf-bb39-a40dbab9f75f admin admin] PATH_INFO: `/v3/projects/fd193d2f28324fcc994c4a2743ebb1f0` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:20.514175 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c71015-da92-4cbf-bb39-a40dbab9f75f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd193d2f28324fcc994c4a2743ebb1f0)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:20.516585 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c71015-da92-4cbf-bb39-a40dbab9f75f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:20.517953 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:20.550052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1188/2414] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:46:20 2022] DELETE /identity/v3/users/10b40da06bd043379b5c370d1bee7f64 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:46:20.596210 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c1c71015-da92-4cbf-bb39-a40dbab9f75f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd193d2f28324fcc994c4a2743ebb1f0', 'request_id': 'req-c1c71015-da92-4cbf-bb39-a40dbab9f75f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:20.603549 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c1c71015-da92-4cbf-bb39-a40dbab9f75f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd193d2f28324fcc994c4a2743ebb1f0', 'request_id': 'req-c1c71015-da92-4cbf-bb39-a40dbab9f75f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:20.616249 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c1c71015-da92-4cbf-bb39-a40dbab9f75f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd193d2f28324fcc994c4a2743ebb1f0', 'request_id': 'req-c1c71015-da92-4cbf-bb39-a40dbab9f75f'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:20.638501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c1c71015-da92-4cbf-bb39-a40dbab9f75f admin admin] The token cache is being invalidate because project fd193d2f28324fcc994c4a2743ebb1f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:46:20.638829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c1c71015-da92-4cbf-bb39-a40dbab9f75f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:20.639457 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c1c71015-da92-4cbf-bb39-a40dbab9f75f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:20.647196 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1227/2415] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:46:20 2022] DELETE /identity/v3/projects/fd193d2f28324fcc994c4a2743ebb1f0 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:20.651755 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d0d7f-eae8-4bc3-8cf1-393d965a66bc None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:20.652252 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d0d7f-eae8-4bc3-8cf1-393d965a66bc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:20.652707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d0d7f-eae8-4bc3-8cf1-393d965a66bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:20.677552 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-5e3d0d7f-eae8-4bc3-8cf1-393d965a66bc None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:20.678669 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5e3d0d7f-eae8-4bc3-8cf1-393d965a66bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:20.769250 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1189/2416] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:20.774544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4699ef-40b6-4f19-93fc-e83f795f5a9d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:20.774855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4699ef-40b6-4f19-93fc-e83f795f5a9d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:20.775130 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4699ef-40b6-4f19-93fc-e83f795f5a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:20.796390 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-5f4699ef-40b6-4f19-93fc-e83f795f5a9d None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:20.798326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5f4699ef-40b6-4f19-93fc-e83f795f5a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:20.808200 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1228/2417] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:46:20.813556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d0d7f-eae8-4bc3-8cf1-393d965a66bc None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:20.824036 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d0d7f-eae8-4bc3-8cf1-393d965a66bc None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:20.829420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb80249-8b63-47cc-8182-782bd4924475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:20.830064 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb80249-8b63-47cc-8182-782bd4924475 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:20.830348 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb80249-8b63-47cc-8182-782bd4924475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:20.830619 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb80249-8b63-47cc-8182-782bd4924475 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:20.831658 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb80249-8b63-47cc-8182-782bd4924475 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:46:20.831658 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb80249-8b63-47cc-8182-782bd4924475 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:20.833824 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb80249-8b63-47cc-8182-782bd4924475 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:20.851174 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1190/2418] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:46:20.852847 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4699ef-40b6-4f19-93fc-e83f795f5a9d None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:20.860579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:20.866701 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4699ef-40b6-4f19-93fc-e83f795f5a9d None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:20.874799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ea7c0-1dc7-4abb-9078-31e560169fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:20.875914 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ea7c0-1dc7-4abb-9078-31e560169fbd admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:20.876736 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ea7c0-1dc7-4abb-9078-31e560169fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:20.877031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ea7c0-1dc7-4abb-9078-31e560169fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:20.877728 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ea7c0-1dc7-4abb-9078-31e560169fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:20.880254 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ea7c0-1dc7-4abb-9078-31e560169fbd admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:20.914570 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1229/2419] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:46:20 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:20.919870 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb80249-8b63-47cc-8182-782bd4924475 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:20.931318 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb80249-8b63-47cc-8182-782bd4924475 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:21.010886 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafbb84-ed59-49bf-8da1-b9b35fbfba9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:21.011508 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafbb84-ed59-49bf-8da1-b9b35fbfba9c admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:21.011771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafbb84-ed59-49bf-8da1-b9b35fbfba9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:21.012043 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafbb84-ed59-49bf-8da1-b9b35fbfba9c admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:21.013016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafbb84-ed59-49bf-8da1-b9b35fbfba9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:21.014729 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafbb84-ed59-49bf-8da1-b9b35fbfba9c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:21.042117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1191/2420] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:46:20 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:21.045643 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ea7c0-1dc7-4abb-9078-31e560169fbd admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:21.059522 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ea7c0-1dc7-4abb-9078-31e560169fbd admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:21.078281 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f98e9-5b56-463b-802d-e34ba49eb7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:21.079084 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f98e9-5b56-463b-802d-e34ba49eb7ef admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:21.079225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f98e9-5b56-463b-802d-e34ba49eb7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:21.079490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f98e9-5b56-463b-802d-e34ba49eb7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:21.080208 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f98e9-5b56-463b-802d-e34ba49eb7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:21.081881 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f98e9-5b56-463b-802d-e34ba49eb7ef admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:21.094077 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1230/2421] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:21.097846 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafbb84-ed59-49bf-8da1-b9b35fbfba9c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:21.108945 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafbb84-ed59-49bf-8da1-b9b35fbfba9c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:21.114723 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc42ef-b453-431d-83bc-7b0e90187533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:21.115487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc42ef-b453-431d-83bc-7b0e90187533 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:21.115743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc42ef-b453-431d-83bc-7b0e90187533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:21.116149 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc42ef-b453-431d-83bc-7b0e90187533 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:21.117139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc42ef-b453-431d-83bc-7b0e90187533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:21.118540 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc42ef-b453-431d-83bc-7b0e90187533 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:21.133720 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1192/2422] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:21.139550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f98e9-5b56-463b-802d-e34ba49eb7ef admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:21.156034 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f98e9-5b56-463b-802d-e34ba49eb7ef admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:21.162477 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9a088-f5a6-4f73-8bd9-2618be7dcff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:21.163162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9a088-f5a6-4f73-8bd9-2618be7dcff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:21.163572 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9a088-f5a6-4f73-8bd9-2618be7dcff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:21.164069 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9a088-f5a6-4f73-8bd9-2618be7dcff4 admin admin] PATH_INFO: `/v3/projects/1127e397662046898895d2e14d6c02e6/users/1b397d9d45b3441eba444571ff8a185b/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:21.202672 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9a088-f5a6-4f73-8bd9-2618be7dcff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1127e397662046898895d2e14d6c02e6, user_id=1b397d9d45b3441eba444571ff8a185b, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:21.205562 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9a088-f5a6-4f73-8bd9-2618be7dcff4 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:21.222309 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1231/2423] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:46:21 2022] PUT /identity/v3/projects/1127e397662046898895d2e14d6c02e6/users/1b397d9d45b3441eba444571ff8a185b/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:21.228725 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf31c1-c905-4171-b3d4-ef292f80e992 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:21.229010 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf31c1-c905-4171-b3d4-ef292f80e992 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:21.230639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf31c1-c905-4171-b3d4-ef292f80e992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:21.243996 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9a088-f5a6-4f73-8bd9-2618be7dcff4 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:21.246464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-34d9a088-f5a6-4f73-8bd9-2618be7dcff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:21.271134 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2dcf31c1-c905-4171-b3d4-ef292f80e992 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:21.271936 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2dcf31c1-c905-4171-b3d4-ef292f80e992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:21.330123 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9a088-f5a6-4f73-8bd9-2618be7dcff4 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:21.335119 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:21.336173 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e292e-2bb6-4ee6-bb4f-091b0686a256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:21.336952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e292e-2bb6-4ee6-bb4f-091b0686a256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:21.337516 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e292e-2bb6-4ee6-bb4f-091b0686a256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:21.337851 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e292e-2bb6-4ee6-bb4f-091b0686a256 admin admin] PATH_INFO: `/v3/projects/17befb21ba0347f2a5137d615cbc68fd` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:21.339133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e292e-2bb6-4ee6-bb4f-091b0686a256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17befb21ba0347f2a5137d615cbc68fd)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:21.341268 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e292e-2bb6-4ee6-bb4f-091b0686a256 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:21.357573 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1193/2424] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:21.368438 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf31c1-c905-4171-b3d4-ef292f80e992 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:21.370246 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2dcf31c1-c905-4171-b3d4-ef292f80e992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:21.397714 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-317e292e-2bb6-4ee6-bb4f-091b0686a256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17befb21ba0347f2a5137d615cbc68fd', 'request_id': 'req-317e292e-2bb6-4ee6-bb4f-091b0686a256'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:21.406782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-317e292e-2bb6-4ee6-bb4f-091b0686a256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17befb21ba0347f2a5137d615cbc68fd', 'request_id': 'req-317e292e-2bb6-4ee6-bb4f-091b0686a256'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:21.415501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-317e292e-2bb6-4ee6-bb4f-091b0686a256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17befb21ba0347f2a5137d615cbc68fd', 'request_id': 'req-317e292e-2bb6-4ee6-bb4f-091b0686a256'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:21.431891 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-317e292e-2bb6-4ee6-bb4f-091b0686a256 admin admin] The token cache is being invalidate because project 17befb21ba0347f2a5137d615cbc68fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:46:21.432353 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-317e292e-2bb6-4ee6-bb4f-091b0686a256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:21.433015 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-317e292e-2bb6-4ee6-bb4f-091b0686a256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:21.435532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1232/2425] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:46:21 2022] DELETE /identity/v3/projects/17befb21ba0347f2a5137d615cbc68fd => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:21.437506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf31c1-c905-4171-b3d4-ef292f80e992 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:21.439308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e292e-2bb6-4ee6-bb4f-091b0686a256 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:21.440633 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-317e292e-2bb6-4ee6-bb4f-091b0686a256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:21.490343 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:21.495286 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae9540-9439-4eba-a70c-c3d230a16696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:21.495924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae9540-9439-4eba-a70c-c3d230a16696 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:21.496204 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae9540-9439-4eba-a70c-c3d230a16696 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:21.496477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae9540-9439-4eba-a70c-c3d230a16696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:21.498338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c5ae9540-9439-4eba-a70c-c3d230a16696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:21.519423 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e292e-2bb6-4ee6-bb4f-091b0686a256 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:21.528682 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe158c9a-2192-4a7d-b363-121d508cab49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:21.529494 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe158c9a-2192-4a7d-b363-121d508cab49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:21.530158 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe158c9a-2192-4a7d-b363-121d508cab49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:21.530388 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe158c9a-2192-4a7d-b363-121d508cab49 admin admin] PATH_INFO: `/v3/users/dcc8909918a445a2a7a49e6e6ecb03c9` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:21.531681 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe158c9a-2192-4a7d-b363-121d508cab49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcc8909918a445a2a7a49e6e6ecb03c9)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:21.533644 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe158c9a-2192-4a7d-b363-121d508cab49 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:21.591237 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae9540-9439-4eba-a70c-c3d230a16696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:21.593057 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae9540-9439-4eba-a70c-c3d230a16696 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:21.595467 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fe158c9a-2192-4a7d-b363-121d508cab49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcc8909918a445a2a7a49e6e6ecb03c9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:21.607995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1194/2426] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:46:21.613066 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fe158c9a-2192-4a7d-b363-121d508cab49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcc8909918a445a2a7a49e6e6ecb03c9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:21.613495 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fe158c9a-2192-4a7d-b363-121d508cab49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcc8909918a445a2a7a49e6e6ecb03c9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:21.614726 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fe158c9a-2192-4a7d-b363-121d508cab49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcc8909918a445a2a7a49e6e6ecb03c9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:21.637215 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fe158c9a-2192-4a7d-b363-121d508cab49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcc8909918a445a2a7a49e6e6ecb03c9'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:21.673603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1233/2427] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:46:21 2022] DELETE /identity/v3/users/dcc8909918a445a2a7a49e6e6ecb03c9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:46:21.737347 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae9540-9439-4eba-a70c-c3d230a16696 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:21.739637 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c5ae9540-9439-4eba-a70c-c3d230a16696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:21.753372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae9540-9439-4eba-a70c-c3d230a16696 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:21.869433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2eb5cf-0d08-45fa-82dc-18c9f37d05c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:21.871018 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2eb5cf-0d08-45fa-82dc-18c9f37d05c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:21.871326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2eb5cf-0d08-45fa-82dc-18c9f37d05c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:21.871606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2eb5cf-0d08-45fa-82dc-18c9f37d05c5 admin admin] PATH_INFO: `/v3/users/e1b875d395c44272896ee6e840ca4289` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:21.873560 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2eb5cf-0d08-45fa-82dc-18c9f37d05c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1b875d395c44272896ee6e840ca4289)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:21.880359 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2eb5cf-0d08-45fa-82dc-18c9f37d05c5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:21.882531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:21.953376 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2c2eb5cf-0d08-45fa-82dc-18c9f37d05c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1b875d395c44272896ee6e840ca4289'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:21.966593 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2c2eb5cf-0d08-45fa-82dc-18c9f37d05c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1b875d395c44272896ee6e840ca4289'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:21.967695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2c2eb5cf-0d08-45fa-82dc-18c9f37d05c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1b875d395c44272896ee6e840ca4289'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:21.968665 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2c2eb5cf-0d08-45fa-82dc-18c9f37d05c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1b875d395c44272896ee6e840ca4289'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:21.984125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2c2eb5cf-0d08-45fa-82dc-18c9f37d05c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1b875d395c44272896ee6e840ca4289'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:22.011785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1195/2428] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:46:21 2022] DELETE /identity/v3/users/e1b875d395c44272896ee6e840ca4289 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:22.016070 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3ab27-04a8-4711-b19c-2ac5f312c473 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:22.016424 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3ab27-04a8-4711-b19c-2ac5f312c473 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:22.016634 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3ab27-04a8-4711-b19c-2ac5f312c473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:22.038784 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-65c3ab27-04a8-4711-b19c-2ac5f312c473 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:22.040119 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-65c3ab27-04a8-4711-b19c-2ac5f312c473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:22.121323 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1234/2429] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:22.158600 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2eb5cf-0d08-45fa-82dc-18c9f37d05c5 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:22.160195 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2c2eb5cf-0d08-45fa-82dc-18c9f37d05c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:22.261373 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2eb5cf-0d08-45fa-82dc-18c9f37d05c5 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:22.267844 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d3413-2cf5-4d6f-ac5c-225c8a253e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:22.268799 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d3413-2cf5-4d6f-ac5c-225c8a253e06 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:22.269318 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d3413-2cf5-4d6f-ac5c-225c8a253e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:22.269812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d3413-2cf5-4d6f-ac5c-225c8a253e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:22.285423 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d3413-2cf5-4d6f-ac5c-225c8a253e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:22.288687 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d3413-2cf5-4d6f-ac5c-225c8a253e06 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:22.306722 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1196/2430] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:22.406740 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3ab27-04a8-4711-b19c-2ac5f312c473 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:22.408304 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-65c3ab27-04a8-4711-b19c-2ac5f312c473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:22.435379 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3ab27-04a8-4711-b19c-2ac5f312c473 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:22.474499 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990aab0-a0a9-4290-90f0-c62b16230845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:22.475178 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990aab0-a0a9-4290-90f0-c62b16230845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:22.475463 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990aab0-a0a9-4290-90f0-c62b16230845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:22.475741 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990aab0-a0a9-4290-90f0-c62b16230845 admin admin] PATH_INFO: `/v3/projects/14fa7dbbaf974e08a24174547614a546` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:22.484637 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990aab0-a0a9-4290-90f0-c62b16230845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14fa7dbbaf974e08a24174547614a546)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:22.486852 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990aab0-a0a9-4290-90f0-c62b16230845 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:22.606341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4990aab0-a0a9-4290-90f0-c62b16230845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14fa7dbbaf974e08a24174547614a546', 'request_id': 'req-4990aab0-a0a9-4290-90f0-c62b16230845'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:22.639965 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:22.667742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4990aab0-a0a9-4290-90f0-c62b16230845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14fa7dbbaf974e08a24174547614a546', 'request_id': 'req-4990aab0-a0a9-4290-90f0-c62b16230845'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:22.704455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4990aab0-a0a9-4290-90f0-c62b16230845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14fa7dbbaf974e08a24174547614a546', 'request_id': 'req-4990aab0-a0a9-4290-90f0-c62b16230845'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:22.746058 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4990aab0-a0a9-4290-90f0-c62b16230845 admin admin] The token cache is being invalidate because project 14fa7dbbaf974e08a24174547614a546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:46:22.747992 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4990aab0-a0a9-4290-90f0-c62b16230845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:22.750064 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4990aab0-a0a9-4290-90f0-c62b16230845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:22.759306 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1235/2431] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:46:22 2022] DELETE /identity/v3/projects/14fa7dbbaf974e08a24174547614a546 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:22.759442 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823692be-3923-4b07-ab5f-51e7e9facb44 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:22.759858 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823692be-3923-4b07-ab5f-51e7e9facb44 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:22.759858 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823692be-3923-4b07-ab5f-51e7e9facb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:22.765427 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63913995-ca99-4d5c-bca0-308259f4cf38 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:22.765963 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63913995-ca99-4d5c-bca0-308259f4cf38 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:22.766449 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63913995-ca99-4d5c-bca0-308259f4cf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:22.792303 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-823692be-3923-4b07-ab5f-51e7e9facb44 None None] MFA Rules not processed for user `ed49a596f15542a29ce331bae4640274`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:22.793890 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-823692be-3923-4b07-ab5f-51e7e9facb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:22.831731 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-63913995-ca99-4d5c-bca0-308259f4cf38 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:22.833811 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-63913995-ca99-4d5c-bca0-308259f4cf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:22.946636 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1197/2432] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 15 00:46:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:46:22.950196 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823692be-3923-4b07-ab5f-51e7e9facb44 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:22.953597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-823692be-3923-4b07-ab5f-51e7e9facb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:22.994278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1236/2433] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:23.002445 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e90b7-f39a-4774-ba89-b52ea06a7073 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:23.002859 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e90b7-f39a-4774-ba89-b52ea06a7073 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:23.003576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e90b7-f39a-4774-ba89-b52ea06a7073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:23.020579 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:23.122444 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823692be-3923-4b07-ab5f-51e7e9facb44 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:23.138383 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e92c63-970a-4b68-b846-1f55bced2803 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb248b85aba45b39132d0f92ede0b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:23.139040 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e92c63-970a-4b68-b846-1f55bced2803 service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:23.139391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e92c63-970a-4b68-b846-1f55bced2803 service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:23.139671 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e92c63-970a-4b68-b846-1f55bced2803 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:23.160018 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e92c63-970a-4b68-b846-1f55bced2803 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:23.161680 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e92c63-970a-4b68-b846-1f55bced2803 service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:23.174783 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f32e90b7-f39a-4774-ba89-b52ea06a7073 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:23.177048 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f32e90b7-f39a-4774-ba89-b52ea06a7073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:23.183169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1198/2434] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 15 00:46:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 00:46:23.189301 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1237/2435] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:46:23.194406 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e92c63-970a-4b68-b846-1f55bced2803 service swift] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:23.240728 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e92c63-970a-4b68-b846-1f55bced2803 service swift] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:23.249357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931de27-670d-4aaf-804f-3ab7607dc32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:23.250008 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931de27-670d-4aaf-804f-3ab7607dc32d admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:23.250328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931de27-670d-4aaf-804f-3ab7607dc32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:23.250591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931de27-670d-4aaf-804f-3ab7607dc32d admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:23.251271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931de27-670d-4aaf-804f-3ab7607dc32d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:46:23.251623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931de27-670d-4aaf-804f-3ab7607dc32d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:23.253307 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931de27-670d-4aaf-804f-3ab7607dc32d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:23.290069 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1199/2436] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:46:23.294093 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e90b7-f39a-4774-ba89-b52ea06a7073 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:23.313668 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e90b7-f39a-4774-ba89-b52ea06a7073 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:23.322857 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3a387-768e-4cbf-931e-9190a19af7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:23.324481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3a387-768e-4cbf-931e-9190a19af7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:23.326362 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3a387-768e-4cbf-931e-9190a19af7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:23.326819 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3a387-768e-4cbf-931e-9190a19af7c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:23.327991 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3a387-768e-4cbf-931e-9190a19af7c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:23.331488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3a387-768e-4cbf-931e-9190a19af7c6 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:23.334993 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931de27-670d-4aaf-804f-3ab7607dc32d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:23.337025 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0931de27-670d-4aaf-804f-3ab7607dc32d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:23.365028 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931de27-670d-4aaf-804f-3ab7607dc32d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:23.389977 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1238/2437] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:46:23 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:23.391656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3a387-768e-4cbf-931e-9190a19af7c6 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:23.395473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110d4f5-7742-4961-9228-f6b3acd765bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:23.396869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110d4f5-7742-4961-9228-f6b3acd765bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:23.397195 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110d4f5-7742-4961-9228-f6b3acd765bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:23.397492 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110d4f5-7742-4961-9228-f6b3acd765bd admin admin] PATH_INFO: `/v3/projects/c5e35e13d75e461b91d185bb70a99787` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:23.399135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110d4f5-7742-4961-9228-f6b3acd765bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e35e13d75e461b91d185bb70a99787)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:23.401367 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110d4f5-7742-4961-9228-f6b3acd765bd admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:23.530086 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9110d4f5-7742-4961-9228-f6b3acd765bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e35e13d75e461b91d185bb70a99787', 'request_id': 'req-9110d4f5-7742-4961-9228-f6b3acd765bd'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:23.542971 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9110d4f5-7742-4961-9228-f6b3acd765bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e35e13d75e461b91d185bb70a99787', 'request_id': 'req-9110d4f5-7742-4961-9228-f6b3acd765bd'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:23.552670 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9110d4f5-7742-4961-9228-f6b3acd765bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e35e13d75e461b91d185bb70a99787', 'request_id': 'req-9110d4f5-7742-4961-9228-f6b3acd765bd'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:23.553431 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3a387-768e-4cbf-931e-9190a19af7c6 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:23.570082 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9110d4f5-7742-4961-9228-f6b3acd765bd admin admin] The token cache is being invalidate because project c5e35e13d75e461b91d185bb70a99787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:46:23.570378 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9110d4f5-7742-4961-9228-f6b3acd765bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:23.571059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9110d4f5-7742-4961-9228-f6b3acd765bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:23.572927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1200/2438] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:46:23 2022] DELETE /identity/v3/projects/c5e35e13d75e461b91d185bb70a99787 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:46:23.577034 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110d4f5-7742-4961-9228-f6b3acd765bd admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:23.581499 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9110d4f5-7742-4961-9228-f6b3acd765bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:23.680097 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314d3e6-e8dd-48bd-858d-5664ba25fdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:23.680881 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314d3e6-e8dd-48bd-858d-5664ba25fdc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:23.681259 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314d3e6-e8dd-48bd-858d-5664ba25fdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:23.681603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314d3e6-e8dd-48bd-858d-5664ba25fdc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:23.683471 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314d3e6-e8dd-48bd-858d-5664ba25fdc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:23.686736 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314d3e6-e8dd-48bd-858d-5664ba25fdc4 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:23.706224 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:23.718448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110d4f5-7742-4961-9228-f6b3acd765bd admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:23.737598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1239/2439] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:46:23 2022] POST /identity/v3/users => generated 288 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:23.737766 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eb8a4-ee8f-4223-a1f6-cd6f4daa881e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:23.738000 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08366bd4-28bf-4ca3-870b-e5cf3b95a615 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:23.738262 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eb8a4-ee8f-4223-a1f6-cd6f4daa881e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:23.738547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eb8a4-ee8f-4223-a1f6-cd6f4daa881e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:23.739011 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08366bd4-28bf-4ca3-870b-e5cf3b95a615 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:23.739361 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eb8a4-ee8f-4223-a1f6-cd6f4daa881e admin admin] PATH_INFO: `/v3/users/02f28173e9804134bf9aa4afddbbe96c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:23.739679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08366bd4-28bf-4ca3-870b-e5cf3b95a615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:23.744373 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0eb8a4-ee8f-4223-a1f6-cd6f4daa881e admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f28173e9804134bf9aa4afddbbe96c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:23.763565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0eb8a4-ee8f-4223-a1f6-cd6f4daa881e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:23.835146 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-08366bd4-28bf-4ca3-870b-e5cf3b95a615 None None] MFA Rules not processed for user `1b397d9d45b3441eba444571ff8a185b`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:23.835849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-08366bd4-28bf-4ca3-870b-e5cf3b95a615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:23.847482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:23.884834 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-eb0eb8a4-ee8f-4223-a1f6-cd6f4daa881e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f28173e9804134bf9aa4afddbbe96c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:23.900962 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-eb0eb8a4-ee8f-4223-a1f6-cd6f4daa881e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f28173e9804134bf9aa4afddbbe96c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:23.902094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-eb0eb8a4-ee8f-4223-a1f6-cd6f4daa881e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f28173e9804134bf9aa4afddbbe96c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:23.903015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-eb0eb8a4-ee8f-4223-a1f6-cd6f4daa881e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f28173e9804134bf9aa4afddbbe96c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:23.920536 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-eb0eb8a4-ee8f-4223-a1f6-cd6f4daa881e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f28173e9804134bf9aa4afddbbe96c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:23.963826 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1201/2440] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:46:23 2022] DELETE /identity/v3/users/02f28173e9804134bf9aa4afddbbe96c => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:23.965352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eb8a4-ee8f-4223-a1f6-cd6f4daa881e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:23.969422 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-eb0eb8a4-ee8f-4223-a1f6-cd6f4daa881e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:24.015899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1240/2441] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:24.028319 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08366bd4-28bf-4ca3-870b-e5cf3b95a615 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:24.030671 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-08366bd4-28bf-4ca3-870b-e5cf3b95a615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:24.152257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08366bd4-28bf-4ca3-870b-e5cf3b95a615 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:24.163775 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eb8a4-ee8f-4223-a1f6-cd6f4daa881e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:24.176929 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa03d20-d2be-4f06-b348-961e58a96739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:24.177812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa03d20-d2be-4f06-b348-961e58a96739 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:24.178405 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa03d20-d2be-4f06-b348-961e58a96739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:24.178972 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa03d20-d2be-4f06-b348-961e58a96739 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:24.181748 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa03d20-d2be-4f06-b348-961e58a96739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:24.186533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa03d20-d2be-4f06-b348-961e58a96739 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:24.211587 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1202/2442] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:24.215588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa03d20-d2be-4f06-b348-961e58a96739 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:24.244799 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa03d20-d2be-4f06-b348-961e58a96739 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:24.250615 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e8e0a-bae6-42ec-87e6-df75dac4222d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:24.251315 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e8e0a-bae6-42ec-87e6-df75dac4222d admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:24.251655 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e8e0a-bae6-42ec-87e6-df75dac4222d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:24.251995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e8e0a-bae6-42ec-87e6-df75dac4222d admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:24.252832 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e8e0a-bae6-42ec-87e6-df75dac4222d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:24.255427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e8e0a-bae6-42ec-87e6-df75dac4222d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:24.264598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9ad8a-567d-4512-859f-937f366dd33a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:24.266057 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9ad8a-567d-4512-859f-937f366dd33a service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:24.267389 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9ad8a-567d-4512-859f-937f366dd33a service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:24.267967 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9ad8a-567d-4512-859f-937f366dd33a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:24.270976 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1203/2443] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 00:46:24.275573 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e8e0a-bae6-42ec-87e6-df75dac4222d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:24.289737 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e8e0a-bae6-42ec-87e6-df75dac4222d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:24.295856 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a48204-4dd9-4cf7-b684-a42f421eea6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:24.296739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a48204-4dd9-4cf7-b684-a42f421eea6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:24.297426 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a48204-4dd9-4cf7-b684-a42f421eea6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:24.297825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a48204-4dd9-4cf7-b684-a42f421eea6c admin admin] PATH_INFO: `/v3/projects/1f843d68aab0482facaf95ced317b692/users/efa791ea39a940b29d1bb3a9815ba0ee/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:24.318683 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a48204-4dd9-4cf7-b684-a42f421eea6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f843d68aab0482facaf95ced317b692, user_id=efa791ea39a940b29d1bb3a9815ba0ee, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:24.328263 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a48204-4dd9-4cf7-b684-a42f421eea6c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:24.385808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1204/2444] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:46:24 2022] PUT /identity/v3/projects/1f843d68aab0482facaf95ced317b692/users/efa791ea39a940b29d1bb3a9815ba0ee/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:24.389838 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:24.396789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29188b-1e2c-46f2-bc07-741cb886ce7c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:24.397208 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29188b-1e2c-46f2-bc07-741cb886ce7c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:24.397390 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29188b-1e2c-46f2-bc07-741cb886ce7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:24.418264 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9ad8a-567d-4512-859f-937f366dd33a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:24.422539 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9ad8a-567d-4512-859f-937f366dd33a service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:24.453484 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1241/2445] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:46:24.480945 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-df29188b-1e2c-46f2-bc07-741cb886ce7c None None] MFA Rules not processed for user `efa791ea39a940b29d1bb3a9815ba0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:24.487353 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-df29188b-1e2c-46f2-bc07-741cb886ce7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:24.510273 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9ad8a-567d-4512-859f-937f366dd33a service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:24.511981 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ecd9ad8a-567d-4512-859f-937f366dd33a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:24.565978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9ad8a-567d-4512-859f-937f366dd33a service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:24.722134 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:24.751884 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1205/2446] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:24.763779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29188b-1e2c-46f2-bc07-741cb886ce7c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:24.766445 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-df29188b-1e2c-46f2-bc07-741cb886ce7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:24.775434 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1640c6-a956-4368-919d-1f7f96cd59ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:24.777693 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1640c6-a956-4368-919d-1f7f96cd59ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:24.779283 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1640c6-a956-4368-919d-1f7f96cd59ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:24.779723 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1640c6-a956-4368-919d-1f7f96cd59ae admin admin] PATH_INFO: `/v3/projects/190b7d320752454a812fa559f8a7514c` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:24.783517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1640c6-a956-4368-919d-1f7f96cd59ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=190b7d320752454a812fa559f8a7514c)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:24.788875 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1640c6-a956-4368-919d-1f7f96cd59ae admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:24.928678 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2b1640c6-a956-4368-919d-1f7f96cd59ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '190b7d320752454a812fa559f8a7514c', 'request_id': 'req-2b1640c6-a956-4368-919d-1f7f96cd59ae'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:24.944012 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29188b-1e2c-46f2-bc07-741cb886ce7c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:24.948812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2b1640c6-a956-4368-919d-1f7f96cd59ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '190b7d320752454a812fa559f8a7514c', 'request_id': 'req-2b1640c6-a956-4368-919d-1f7f96cd59ae'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:24.966591 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2b1640c6-a956-4368-919d-1f7f96cd59ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '190b7d320752454a812fa559f8a7514c', 'request_id': 'req-2b1640c6-a956-4368-919d-1f7f96cd59ae'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:25.029943 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2b1640c6-a956-4368-919d-1f7f96cd59ae admin admin] The token cache is being invalidate because project 190b7d320752454a812fa559f8a7514c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:46:25.030229 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2b1640c6-a956-4368-919d-1f7f96cd59ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:25.031776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2b1640c6-a956-4368-919d-1f7f96cd59ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:25.033657 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1242/2447] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:46:24 2022] DELETE /identity/v3/projects/190b7d320752454a812fa559f8a7514c => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:25.039894 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1640c6-a956-4368-919d-1f7f96cd59ae admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:25.044313 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2b1640c6-a956-4368-919d-1f7f96cd59ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:25.125473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe0170-eb8b-4ed3-896a-306a006738af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:25.126231 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe0170-eb8b-4ed3-896a-306a006738af service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:25.126750 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe0170-eb8b-4ed3-896a-306a006738af service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:25.126869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe0170-eb8b-4ed3-896a-306a006738af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:25.139912 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a7fe0170-eb8b-4ed3-896a-306a006738af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:25.234943 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1640c6-a956-4368-919d-1f7f96cd59ae admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:25.248167 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8302e-0ff2-43ad-9e28-6f5eadf296b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:25.248845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8302e-0ff2-43ad-9e28-6f5eadf296b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:25.249244 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8302e-0ff2-43ad-9e28-6f5eadf296b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:25.249393 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8302e-0ff2-43ad-9e28-6f5eadf296b0 admin admin] PATH_INFO: `/v3/users/08c29bf1e3b346998b8b78710cd5afb4` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:25.251974 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8302e-0ff2-43ad-9e28-6f5eadf296b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08c29bf1e3b346998b8b78710cd5afb4)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:25.254729 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8302e-0ff2-43ad-9e28-6f5eadf296b0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:25.328800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe0170-eb8b-4ed3-896a-306a006738af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:25.330086 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe0170-eb8b-4ed3-896a-306a006738af service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:25.336741 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:25.373211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1206/2448] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:25.401716 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-52b8302e-0ff2-43ad-9e28-6f5eadf296b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08c29bf1e3b346998b8b78710cd5afb4'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:25.422441 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-52b8302e-0ff2-43ad-9e28-6f5eadf296b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08c29bf1e3b346998b8b78710cd5afb4'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:25.423481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-52b8302e-0ff2-43ad-9e28-6f5eadf296b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08c29bf1e3b346998b8b78710cd5afb4'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:25.424259 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-52b8302e-0ff2-43ad-9e28-6f5eadf296b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08c29bf1e3b346998b8b78710cd5afb4'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:25.435261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-52b8302e-0ff2-43ad-9e28-6f5eadf296b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08c29bf1e3b346998b8b78710cd5afb4'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:25.460966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1243/2449] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:46:25 2022] DELETE /identity/v3/users/08c29bf1e3b346998b8b78710cd5afb4 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:25.961419 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe0170-eb8b-4ed3-896a-306a006738af service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:25.979937 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe0170-eb8b-4ed3-896a-306a006738af service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:26.125061 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa59d8-54b4-4f5e-acf4-3f75d589fd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:26.126037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa59d8-54b4-4f5e-acf4-3f75d589fd30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:26.126393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa59d8-54b4-4f5e-acf4-3f75d589fd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:26.126744 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa59d8-54b4-4f5e-acf4-3f75d589fd30 admin admin] PATH_INFO: `/v3/projects/c3286a81473f48f081b3c4c8cf406248` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:26.128083 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa59d8-54b4-4f5e-acf4-3f75d589fd30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3286a81473f48f081b3c4c8cf406248)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:26.130188 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa59d8-54b4-4f5e-acf4-3f75d589fd30 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:26.153574 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:26.234992 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5faa59d8-54b4-4f5e-acf4-3f75d589fd30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3286a81473f48f081b3c4c8cf406248', 'request_id': 'req-5faa59d8-54b4-4f5e-acf4-3f75d589fd30'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:26.252962 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5faa59d8-54b4-4f5e-acf4-3f75d589fd30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3286a81473f48f081b3c4c8cf406248', 'request_id': 'req-5faa59d8-54b4-4f5e-acf4-3f75d589fd30'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:26.277025 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5faa59d8-54b4-4f5e-acf4-3f75d589fd30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3286a81473f48f081b3c4c8cf406248', 'request_id': 'req-5faa59d8-54b4-4f5e-acf4-3f75d589fd30'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:26.290736 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5faa59d8-54b4-4f5e-acf4-3f75d589fd30 admin admin] The token cache is being invalidate because project c3286a81473f48f081b3c4c8cf406248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:46:26.290951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5faa59d8-54b4-4f5e-acf4-3f75d589fd30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:26.291622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-5faa59d8-54b4-4f5e-acf4-3f75d589fd30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:26.298255 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1207/2450] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:46:25 2022] DELETE /identity/v3/projects/c3286a81473f48f081b3c4c8cf406248 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:26.298974 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc074fb5-740a-4ea9-8d64-006234230f45 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:26.299487 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc074fb5-740a-4ea9-8d64-006234230f45 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:26.300264 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc074fb5-740a-4ea9-8d64-006234230f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:26.312356 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357b860-e942-45ca-bda2-801efe6d64eb None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:26.313647 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357b860-e942-45ca-bda2-801efe6d64eb None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:26.315039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357b860-e942-45ca-bda2-801efe6d64eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:26.343445 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-dc074fb5-740a-4ea9-8d64-006234230f45 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:26.345512 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-dc074fb5-740a-4ea9-8d64-006234230f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:26.380863 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9357b860-e942-45ca-bda2-801efe6d64eb None None] MFA Rules not processed for user `1b397d9d45b3441eba444571ff8a185b`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:26.382847 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9357b860-e942-45ca-bda2-801efe6d64eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:26.495343 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1244/2451] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:46:26.503439 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b0eec-64e5-4199-a0c3-8cc084777491 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:26.503734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b0eec-64e5-4199-a0c3-8cc084777491 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:26.504065 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b0eec-64e5-4199-a0c3-8cc084777491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:26.559759 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ba9b0eec-64e5-4199-a0c3-8cc084777491 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:26.560886 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ba9b0eec-64e5-4199-a0c3-8cc084777491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:26.593539 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1245/2452] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:46:26.596265 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b0eec-64e5-4199-a0c3-8cc084777491 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:26.611726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1208/2453] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:26.638589 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b0eec-64e5-4199-a0c3-8cc084777491 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:26.665076 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62916210-5d5b-4517-98ae-e177d5c36e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:26.665772 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62916210-5d5b-4517-98ae-e177d5c36e26 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:26.666069 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62916210-5d5b-4517-98ae-e177d5c36e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:26.677898 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62916210-5d5b-4517-98ae-e177d5c36e26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:26.677898 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62916210-5d5b-4517-98ae-e177d5c36e26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:46:26.677898 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62916210-5d5b-4517-98ae-e177d5c36e26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:26.677898 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62916210-5d5b-4517-98ae-e177d5c36e26 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:26.723521 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1246/2454] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:46:26.727983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357b860-e942-45ca-bda2-801efe6d64eb None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:26.742571 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357b860-e942-45ca-bda2-801efe6d64eb None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:26.753410 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c62c63-4d9c-4d5d-8668-3d874eef26f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:26.756235 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c62c63-4d9c-4d5d-8668-3d874eef26f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:26.756524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c62c63-4d9c-4d5d-8668-3d874eef26f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:26.756902 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c62c63-4d9c-4d5d-8668-3d874eef26f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:26.759301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c62c63-4d9c-4d5d-8668-3d874eef26f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:26.764786 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c62c63-4d9c-4d5d-8668-3d874eef26f4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:26.836692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1209/2455] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:46:26 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:26.837563 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62916210-5d5b-4517-98ae-e177d5c36e26 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:26.854122 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62916210-5d5b-4517-98ae-e177d5c36e26 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:27.008743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9cfed1-b7e1-453f-87d3-b28b29f4569f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:27.010342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cfed1-b7e1-453f-87d3-b28b29f4569f admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:27.010634 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cfed1-b7e1-453f-87d3-b28b29f4569f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:27.012418 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9cfed1-b7e1-453f-87d3-b28b29f4569f admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:27.012971 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9cfed1-b7e1-453f-87d3-b28b29f4569f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:27.022973 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9cfed1-b7e1-453f-87d3-b28b29f4569f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:27.081641 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1247/2456] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:46:26 2022] POST /identity/v3/users => generated 285 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:27.084898 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c62c63-4d9c-4d5d-8668-3d874eef26f4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:27.103180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c62c63-4d9c-4d5d-8668-3d874eef26f4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:27.119455 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d256d9-9ed0-4b23-8e6b-2c03f247a3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:27.120178 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d256d9-9ed0-4b23-8e6b-2c03f247a3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:27.120328 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d256d9-9ed0-4b23-8e6b-2c03f247a3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:27.120600 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d256d9-9ed0-4b23-8e6b-2c03f247a3a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:27.121326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d256d9-9ed0-4b23-8e6b-2c03f247a3a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:27.122936 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d256d9-9ed0-4b23-8e6b-2c03f247a3a6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:27.132146 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f57475-9f57-40eb-bbfb-4fa8bcf11b3f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:27.132471 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f57475-9f57-40eb-bbfb-4fa8bcf11b3f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:27.132746 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f57475-9f57-40eb-bbfb-4fa8bcf11b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:27.152619 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1210/2457] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:27.159734 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d256d9-9ed0-4b23-8e6b-2c03f247a3a6 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:27.172657 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b0f57475-9f57-40eb-bbfb-4fa8bcf11b3f None None] MFA Rules not processed for user `efa791ea39a940b29d1bb3a9815ba0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:27.173914 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b0f57475-9f57-40eb-bbfb-4fa8bcf11b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:27.181517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d256d9-9ed0-4b23-8e6b-2c03f247a3a6 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:27.184879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:27.187234 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a4d76-5060-442a-83d5-9f6e08959b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:27.188070 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a4d76-5060-442a-83d5-9f6e08959b7d admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:27.188196 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a4d76-5060-442a-83d5-9f6e08959b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:27.188454 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a4d76-5060-442a-83d5-9f6e08959b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:27.189330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a4d76-5060-442a-83d5-9f6e08959b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:27.191169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a4d76-5060-442a-83d5-9f6e08959b7d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:27.208956 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1211/2458] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:27.210016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a4d76-5060-442a-83d5-9f6e08959b7d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:27.226227 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a4d76-5060-442a-83d5-9f6e08959b7d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:27.231845 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671f0c3-9a18-4afa-a895-db4d4913e667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:27.232213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671f0c3-9a18-4afa-a895-db4d4913e667 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:27.232492 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671f0c3-9a18-4afa-a895-db4d4913e667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:27.233266 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671f0c3-9a18-4afa-a895-db4d4913e667 admin admin] PATH_INFO: `/v3/projects/5995cd8b1ae8468298d9288cefaf8794/users/eea675ae56114ec08ac972cfc26ae5d7/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:27.252746 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671f0c3-9a18-4afa-a895-db4d4913e667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5995cd8b1ae8468298d9288cefaf8794, user_id=eea675ae56114ec08ac972cfc26ae5d7, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:27.256024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671f0c3-9a18-4afa-a895-db4d4913e667 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:27.284256 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1212/2459] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:46:27 2022] PUT /identity/v3/projects/5995cd8b1ae8468298d9288cefaf8794/users/eea675ae56114ec08ac972cfc26ae5d7/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:27.297169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61c9ee-c2cd-48a4-b491-8f70728a445b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:27.297510 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61c9ee-c2cd-48a4-b491-8f70728a445b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:27.297895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61c9ee-c2cd-48a4-b491-8f70728a445b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:27.305054 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1248/2460] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:46:27.342486 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-de61c9ee-c2cd-48a4-b491-8f70728a445b None None] MFA Rules not processed for user `eea675ae56114ec08ac972cfc26ae5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:27.343839 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-de61c9ee-c2cd-48a4-b491-8f70728a445b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:27.381014 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:27.482027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1213/2461] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:27.497361 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f57475-9f57-40eb-bbfb-4fa8bcf11b3f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:27.500825 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b0f57475-9f57-40eb-bbfb-4fa8bcf11b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:27.616537 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f57475-9f57-40eb-bbfb-4fa8bcf11b3f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:27.701442 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d62562-a497-4b7d-b29e-c3e04a2a46dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12ce70a7c4f4396ab3fbb635dfc548b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:27.702152 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d62562-a497-4b7d-b29e-c3e04a2a46dc service glance] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:27.702474 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d62562-a497-4b7d-b29e-c3e04a2a46dc service glance] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:27.702894 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d62562-a497-4b7d-b29e-c3e04a2a46dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:27.716968 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d62562-a497-4b7d-b29e-c3e04a2a46dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:27.718461 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d62562-a497-4b7d-b29e-c3e04a2a46dc service glance] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:27.731632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1249/2462] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:29.064624 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61c9ee-c2cd-48a4-b491-8f70728a445b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:29.077417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-de61c9ee-c2cd-48a4-b491-8f70728a445b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:29.278176 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61c9ee-c2cd-48a4-b491-8f70728a445b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:29.290235 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5a341-3371-46dc-963c-c264958051d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:29.290874 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5a341-3371-46dc-963c-c264958051d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:29.291155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5a341-3371-46dc-963c-c264958051d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:29.291426 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5a341-3371-46dc-963c-c264958051d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:29.298392 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-83a5a341-3371-46dc-963c-c264958051d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:29.522112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5a341-3371-46dc-963c-c264958051d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:29.534176 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5a341-3371-46dc-963c-c264958051d5 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:29.603772 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1214/2463] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:37.726701 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=67 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:39.579177 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=67 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:49.516505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d62562-a497-4b7d-b29e-c3e04a2a46dc service glance] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:49.518178 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c8d62562-a497-4b7d-b29e-c3e04a2a46dc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:49.579242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d62562-a497-4b7d-b29e-c3e04a2a46dc service glance] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:49.583553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d812bc8-90b5-4ca8-ae91-a1fff464d506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:49.584164 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d812bc8-90b5-4ca8-ae91-a1fff464d506 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:49.584444 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d812bc8-90b5-4ca8-ae91-a1fff464d506 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:49.584741 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d812bc8-90b5-4ca8-ae91-a1fff464d506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:49.586606 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6d812bc8-90b5-4ca8-ae91-a1fff464d506 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:49.665956 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d812bc8-90b5-4ca8-ae91-a1fff464d506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:49.667866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d812bc8-90b5-4ca8-ae91-a1fff464d506 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:49.685277 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1250/2464] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:49.967233 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bc7bc-50e8-426f-af5d-00bd60481c5b None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:49.967696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bc7bc-50e8-426f-af5d-00bd60481c5b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:49.968097 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bc7bc-50e8-426f-af5d-00bd60481c5b None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:49.974791 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1215/2465] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 15 00:46:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:46:49.988568 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce873b-26b6-444a-8802-e488bc42283b None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:49.988867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce873b-26b6-444a-8802-e488bc42283b None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:49.989217 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce873b-26b6-444a-8802-e488bc42283b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:50.041543 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-53ce873b-26b6-444a-8802-e488bc42283b None None] MFA Rules not processed for user `bfcfcf8061f24231858b9b0205a8abaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:50.042776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-53ce873b-26b6-444a-8802-e488bc42283b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:50.123322 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1251/2466] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 15 00:46:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:50.140919 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bc7bc-50e8-426f-af5d-00bd60481c5b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:50.158298 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bc7bc-50e8-426f-af5d-00bd60481c5b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:50.163330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87a637-47c0-4043-ad62-bf9192ea1d2b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12ce70a7c4f4396ab3fbb635dfc548b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:50.164178 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87a637-47c0-4043-ad62-bf9192ea1d2b service glance] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:50.164664 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87a637-47c0-4043-ad62-bf9192ea1d2b service glance] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:50.165381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87a637-47c0-4043-ad62-bf9192ea1d2b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:50.186512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87a637-47c0-4043-ad62-bf9192ea1d2b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:50.188756 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87a637-47c0-4043-ad62-bf9192ea1d2b service glance] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:50.209319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1216/2467] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:50.317182 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d006031-30ca-44a6-a7b4-8f292fdc2701 None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:50.318332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d006031-30ca-44a6-a7b4-8f292fdc2701 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:50.318332 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d006031-30ca-44a6-a7b4-8f292fdc2701 None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:50.323118 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1252/2468] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 15 00:46:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:46:50.336066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a1bfd-e357-4831-8b0b-902bd7ad4c9f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:50.336066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a1bfd-e357-4831-8b0b-902bd7ad4c9f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:50.336066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a1bfd-e357-4831-8b0b-902bd7ad4c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:50.389609 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9c6a1bfd-e357-4831-8b0b-902bd7ad4c9f None None] MFA Rules not processed for user `50ec251be76543b4ad97442664db6858`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:50.391540 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9c6a1bfd-e357-4831-8b0b-902bd7ad4c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:50.400448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1217/2469] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 15 00:46:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:50.418129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d006031-30ca-44a6-a7b4-8f292fdc2701 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:50.434293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d006031-30ca-44a6-a7b4-8f292fdc2701 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:50.438102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddafb1-582c-416e-892c-50b1b7426677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:50.438830 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddafb1-582c-416e-892c-50b1b7426677 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:50.445777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddafb1-582c-416e-892c-50b1b7426677 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:50.446061 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddafb1-582c-416e-892c-50b1b7426677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:50.454491 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddafb1-582c-416e-892c-50b1b7426677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:50.460186 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddafb1-582c-416e-892c-50b1b7426677 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:50.469395 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1253/2470] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:50.651269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221280df-0003-4637-8fd4-8c9a60beaca7 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:50.651550 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221280df-0003-4637-8fd4-8c9a60beaca7 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:50.651821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221280df-0003-4637-8fd4-8c9a60beaca7 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:50.653191 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1218/2471] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 15 00:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:46:50.658478 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1761a-1b26-4ec0-8087-c24cd141b52f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:50.658956 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1761a-1b26-4ec0-8087-c24cd141b52f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:50.659105 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1761a-1b26-4ec0-8087-c24cd141b52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:50.679466 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-cfd1761a-1b26-4ec0-8087-c24cd141b52f None None] MFA Rules not processed for user `bfcfcf8061f24231858b9b0205a8abaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:50.680791 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cfd1761a-1b26-4ec0-8087-c24cd141b52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:50.690888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1254/2472] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 15 00:46:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:50.703152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221280df-0003-4637-8fd4-8c9a60beaca7 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:50.714554 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221280df-0003-4637-8fd4-8c9a60beaca7 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:50.719565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d57e9c-bdb4-4199-836e-0d4ff0ea652b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:50.720159 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d57e9c-bdb4-4199-836e-0d4ff0ea652b service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:50.720438 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d57e9c-bdb4-4199-836e-0d4ff0ea652b service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:50.720765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d57e9c-bdb4-4199-836e-0d4ff0ea652b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:50.732937 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d57e9c-bdb4-4199-836e-0d4ff0ea652b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:50.734418 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d57e9c-bdb4-4199-836e-0d4ff0ea652b service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:50.746496 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1219/2473] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:55.750634 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1761a-1b26-4ec0-8087-c24cd141b52f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:55.752101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cfd1761a-1b26-4ec0-8087-c24cd141b52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:55.779807 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:55.819054 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1761a-1b26-4ec0-8087-c24cd141b52f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:55.823669 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45830b68-471b-4abe-a14c-5af4d384bdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:55.824297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45830b68-471b-4abe-a14c-5af4d384bdbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:55.824596 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45830b68-471b-4abe-a14c-5af4d384bdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:55.824894 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45830b68-471b-4abe-a14c-5af4d384bdbf admin admin] PATH_INFO: `/v3/users/fa5d9f4ea4fa4dfcac8052e6fcb76f44` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:55.826088 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45830b68-471b-4abe-a14c-5af4d384bdbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa5d9f4ea4fa4dfcac8052e6fcb76f44)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:55.828029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45830b68-471b-4abe-a14c-5af4d384bdbf admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:55.874310 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-45830b68-471b-4abe-a14c-5af4d384bdbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa5d9f4ea4fa4dfcac8052e6fcb76f44'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:55.881954 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-45830b68-471b-4abe-a14c-5af4d384bdbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa5d9f4ea4fa4dfcac8052e6fcb76f44'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:55.882663 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-45830b68-471b-4abe-a14c-5af4d384bdbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa5d9f4ea4fa4dfcac8052e6fcb76f44'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:55.883290 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-45830b68-471b-4abe-a14c-5af4d384bdbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa5d9f4ea4fa4dfcac8052e6fcb76f44'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:55.890400 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-45830b68-471b-4abe-a14c-5af4d384bdbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa5d9f4ea4fa4dfcac8052e6fcb76f44'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:55.907219 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1255/2474] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:46:55 2022] DELETE /identity/v3/users/fa5d9f4ea4fa4dfcac8052e6fcb76f44 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:56.099359 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d57e9c-bdb4-4199-836e-0d4ff0ea652b service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:56.109719 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d57e9c-bdb4-4199-836e-0d4ff0ea652b service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:56.183318 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e38bb1-e718-465c-8485-92efa3213fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:56.184213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e38bb1-e718-465c-8485-92efa3213fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:56.184562 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e38bb1-e718-465c-8485-92efa3213fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:56.185012 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e38bb1-e718-465c-8485-92efa3213fb0 admin admin] PATH_INFO: `/v3/projects/e9977cfd5a004452b89d1286a803c45e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:56.186529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e38bb1-e718-465c-8485-92efa3213fb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9977cfd5a004452b89d1286a803c45e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:56.188731 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e38bb1-e718-465c-8485-92efa3213fb0 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:56.251620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-48e38bb1-e718-465c-8485-92efa3213fb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9977cfd5a004452b89d1286a803c45e', 'request_id': 'req-48e38bb1-e718-465c-8485-92efa3213fb0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:56.271321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-48e38bb1-e718-465c-8485-92efa3213fb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9977cfd5a004452b89d1286a803c45e', 'request_id': 'req-48e38bb1-e718-465c-8485-92efa3213fb0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:56.288222 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-48e38bb1-e718-465c-8485-92efa3213fb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9977cfd5a004452b89d1286a803c45e', 'request_id': 'req-48e38bb1-e718-465c-8485-92efa3213fb0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:56.306866 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-48e38bb1-e718-465c-8485-92efa3213fb0 admin admin] The token cache is being invalidate because project e9977cfd5a004452b89d1286a803c45e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:46:56.307199 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-48e38bb1-e718-465c-8485-92efa3213fb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:56.307998 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-48e38bb1-e718-465c-8485-92efa3213fb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:56.313948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1220/2475] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:46:56 2022] DELETE /identity/v3/projects/e9977cfd5a004452b89d1286a803c45e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:56.318230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45830b68-471b-4abe-a14c-5af4d384bdbf admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:56.320027 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-45830b68-471b-4abe-a14c-5af4d384bdbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:56.339041 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45830b68-471b-4abe-a14c-5af4d384bdbf admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:56.451106 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab11b1-6906-4383-8aff-836c8ca47d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:56.451766 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab11b1-6906-4383-8aff-836c8ca47d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:56.452051 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab11b1-6906-4383-8aff-836c8ca47d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:56.452336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab11b1-6906-4383-8aff-836c8ca47d14 admin admin] PATH_INFO: `/v3/users/7116156146354746bb78d13794315eaa` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:56.453556 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab11b1-6906-4383-8aff-836c8ca47d14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7116156146354746bb78d13794315eaa)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:56.455580 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab11b1-6906-4383-8aff-836c8ca47d14 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:56.531746 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:56.534096 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-61ab11b1-6906-4383-8aff-836c8ca47d14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7116156146354746bb78d13794315eaa'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:56.547419 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-61ab11b1-6906-4383-8aff-836c8ca47d14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7116156146354746bb78d13794315eaa'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:56.548454 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-61ab11b1-6906-4383-8aff-836c8ca47d14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7116156146354746bb78d13794315eaa'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:56.549534 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-61ab11b1-6906-4383-8aff-836c8ca47d14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7116156146354746bb78d13794315eaa'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:56.563168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-61ab11b1-6906-4383-8aff-836c8ca47d14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7116156146354746bb78d13794315eaa'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:56.602801 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1256/2476] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:46:56 2022] DELETE /identity/v3/users/7116156146354746bb78d13794315eaa => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:46:56.645329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e38bb1-e718-465c-8485-92efa3213fb0 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:56.646778 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-48e38bb1-e718-465c-8485-92efa3213fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:56.663368 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e38bb1-e718-465c-8485-92efa3213fb0 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:56.754240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:56.763594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309f920-505a-4785-a15d-e226c1ee6360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:56.764430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309f920-505a-4785-a15d-e226c1ee6360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:56.765012 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309f920-505a-4785-a15d-e226c1ee6360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:56.770735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309f920-505a-4785-a15d-e226c1ee6360 admin admin] PATH_INFO: `/v3/users/eea675ae56114ec08ac972cfc26ae5d7` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:56.772554 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309f920-505a-4785-a15d-e226c1ee6360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eea675ae56114ec08ac972cfc26ae5d7)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:56.775878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309f920-505a-4785-a15d-e226c1ee6360 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:56.840586 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8309f920-505a-4785-a15d-e226c1ee6360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eea675ae56114ec08ac972cfc26ae5d7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:56.851672 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8309f920-505a-4785-a15d-e226c1ee6360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eea675ae56114ec08ac972cfc26ae5d7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:56.853142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8309f920-505a-4785-a15d-e226c1ee6360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eea675ae56114ec08ac972cfc26ae5d7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:56.853778 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8309f920-505a-4785-a15d-e226c1ee6360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eea675ae56114ec08ac972cfc26ae5d7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:56.866020 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-8309f920-505a-4785-a15d-e226c1ee6360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eea675ae56114ec08ac972cfc26ae5d7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:56.897869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1221/2477] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:46:56 2022] DELETE /identity/v3/users/eea675ae56114ec08ac972cfc26ae5d7 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:56.902507 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b823a4-8566-47d7-bea6-2434ebc9a67a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:56.902965 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b823a4-8566-47d7-bea6-2434ebc9a67a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:56.903238 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b823a4-8566-47d7-bea6-2434ebc9a67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:56.929798 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-11b823a4-8566-47d7-bea6-2434ebc9a67a None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:56.931418 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-11b823a4-8566-47d7-bea6-2434ebc9a67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:57.014252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1257/2478] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:46:57.050000 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309f920-505a-4785-a15d-e226c1ee6360 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:57.052883 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8309f920-505a-4785-a15d-e226c1ee6360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:57.182820 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309f920-505a-4785-a15d-e226c1ee6360 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:57.187482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84412ad-1137-4f3e-b0e9-339d655f385d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:57.188206 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84412ad-1137-4f3e-b0e9-339d655f385d service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:57.189440 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84412ad-1137-4f3e-b0e9-339d655f385d service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:57.189984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84412ad-1137-4f3e-b0e9-339d655f385d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:57.201296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84412ad-1137-4f3e-b0e9-339d655f385d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:57.202909 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84412ad-1137-4f3e-b0e9-339d655f385d service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:57.213984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1222/2479] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:57.506078 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b823a4-8566-47d7-bea6-2434ebc9a67a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:57.506078 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-11b823a4-8566-47d7-bea6-2434ebc9a67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:57.530360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b823a4-8566-47d7-bea6-2434ebc9a67a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:57.542661 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb327fe-6c84-43bc-9ccd-28e8171ab54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:57.543236 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb327fe-6c84-43bc-9ccd-28e8171ab54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:57.543516 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb327fe-6c84-43bc-9ccd-28e8171ab54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:57.543790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb327fe-6c84-43bc-9ccd-28e8171ab54b admin admin] PATH_INFO: `/v3/projects/953af303e8b0451abf48d688e71ccb3b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:57.544935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb327fe-6c84-43bc-9ccd-28e8171ab54b admin admin] RBAC: Authorizing `identity:delete_project(project_id=953af303e8b0451abf48d688e71ccb3b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:57.547240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb327fe-6c84-43bc-9ccd-28e8171ab54b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:57.604044 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5bb327fe-6c84-43bc-9ccd-28e8171ab54b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '953af303e8b0451abf48d688e71ccb3b', 'request_id': 'req-5bb327fe-6c84-43bc-9ccd-28e8171ab54b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:57.613029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5bb327fe-6c84-43bc-9ccd-28e8171ab54b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '953af303e8b0451abf48d688e71ccb3b', 'request_id': 'req-5bb327fe-6c84-43bc-9ccd-28e8171ab54b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:57.631451 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5bb327fe-6c84-43bc-9ccd-28e8171ab54b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '953af303e8b0451abf48d688e71ccb3b', 'request_id': 'req-5bb327fe-6c84-43bc-9ccd-28e8171ab54b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:57.677997 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5bb327fe-6c84-43bc-9ccd-28e8171ab54b admin admin] The token cache is being invalidate because project 953af303e8b0451abf48d688e71ccb3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:46:57.678970 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5bb327fe-6c84-43bc-9ccd-28e8171ab54b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:57.694292 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5bb327fe-6c84-43bc-9ccd-28e8171ab54b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:57.697647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1258/2480] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:46:57 2022] DELETE /identity/v3/projects/953af303e8b0451abf48d688e71ccb3b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:57.701374 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be03a2d-06dc-4904-9c37-c2c18ec83ab4 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:57.701868 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be03a2d-06dc-4904-9c37-c2c18ec83ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:57.702320 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be03a2d-06dc-4904-9c37-c2c18ec83ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:57.748069 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3be03a2d-06dc-4904-9c37-c2c18ec83ab4 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:57.757413 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3be03a2d-06dc-4904-9c37-c2c18ec83ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:57.873598 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1223/2481] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:57.881654 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32f28f-b86e-4e92-96d1-c0edd37a1921 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:57.882169 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32f28f-b86e-4e92-96d1-c0edd37a1921 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:57.882596 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32f28f-b86e-4e92-96d1-c0edd37a1921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:57.931972 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-0b32f28f-b86e-4e92-96d1-c0edd37a1921 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:57.933224 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0b32f28f-b86e-4e92-96d1-c0edd37a1921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:57.941940 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1259/2482] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:57.946170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be03a2d-06dc-4904-9c37-c2c18ec83ab4 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:57.956938 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be03a2d-06dc-4904-9c37-c2c18ec83ab4 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:57.962784 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536025b8-7d89-485e-b342-c7d6002d24a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:57.963410 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536025b8-7d89-485e-b342-c7d6002d24a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:57.963688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536025b8-7d89-485e-b342-c7d6002d24a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:57.963959 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536025b8-7d89-485e-b342-c7d6002d24a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:57.964661 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536025b8-7d89-485e-b342-c7d6002d24a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:46:57.964979 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536025b8-7d89-485e-b342-c7d6002d24a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:57.966824 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536025b8-7d89-485e-b342-c7d6002d24a8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:57.979336 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1224/2483] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:46:57.984154 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32f28f-b86e-4e92-96d1-c0edd37a1921 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:57.997969 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32f28f-b86e-4e92-96d1-c0edd37a1921 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:58.005411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fab14d-7646-441d-a9fc-1b297a752c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:58.005411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fab14d-7646-441d-a9fc-1b297a752c31 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:58.005411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fab14d-7646-441d-a9fc-1b297a752c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:58.005411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fab14d-7646-441d-a9fc-1b297a752c31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:58.005733 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fab14d-7646-441d-a9fc-1b297a752c31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:58.006877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536025b8-7d89-485e-b342-c7d6002d24a8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:58.008090 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fab14d-7646-441d-a9fc-1b297a752c31 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:58.008656 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-536025b8-7d89-485e-b342-c7d6002d24a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:58.026521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536025b8-7d89-485e-b342-c7d6002d24a8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:58.031855 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae9dc4-a11d-447b-8476-2f3255b4b94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:58.032520 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae9dc4-a11d-447b-8476-2f3255b4b94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:58.032963 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae9dc4-a11d-447b-8476-2f3255b4b94e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:58.033550 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae9dc4-a11d-447b-8476-2f3255b4b94e admin admin] PATH_INFO: `/v3/projects/5995cd8b1ae8468298d9288cefaf8794` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:58.035239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae9dc4-a11d-447b-8476-2f3255b4b94e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5995cd8b1ae8468298d9288cefaf8794)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:58.037911 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae9dc4-a11d-447b-8476-2f3255b4b94e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:58.039330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:58.041135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1260/2484] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:46:57 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:46:58.045215 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fab14d-7646-441d-a9fc-1b297a752c31 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:58.067077 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:58.108320 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e2ae9dc4-a11d-447b-8476-2f3255b4b94e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5995cd8b1ae8468298d9288cefaf8794', 'request_id': 'req-e2ae9dc4-a11d-447b-8476-2f3255b4b94e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:58.118390 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e2ae9dc4-a11d-447b-8476-2f3255b4b94e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5995cd8b1ae8468298d9288cefaf8794', 'request_id': 'req-e2ae9dc4-a11d-447b-8476-2f3255b4b94e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:58.125127 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fab14d-7646-441d-a9fc-1b297a752c31 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:58.130122 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e2ae9dc4-a11d-447b-8476-2f3255b4b94e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5995cd8b1ae8468298d9288cefaf8794', 'request_id': 'req-e2ae9dc4-a11d-447b-8476-2f3255b4b94e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:58.158070 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e2ae9dc4-a11d-447b-8476-2f3255b4b94e admin admin] The token cache is being invalidate because project 5995cd8b1ae8468298d9288cefaf8794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:46:58.158367 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e2ae9dc4-a11d-447b-8476-2f3255b4b94e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:58.159614 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e2ae9dc4-a11d-447b-8476-2f3255b4b94e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:46:58.162547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1225/2485] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:46:58 2022] DELETE /identity/v3/projects/5995cd8b1ae8468298d9288cefaf8794 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:58.232665 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd25686-fa68-4ed5-94c6-845777548552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:58.233465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd25686-fa68-4ed5-94c6-845777548552 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:58.233810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd25686-fa68-4ed5-94c6-845777548552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:58.234155 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd25686-fa68-4ed5-94c6-845777548552 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:58.234927 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd25686-fa68-4ed5-94c6-845777548552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:58.237447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd25686-fa68-4ed5-94c6-845777548552 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:58.278177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1261/2486] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:46:58 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:46:58.294336 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae9dc4-a11d-447b-8476-2f3255b4b94e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:58.302809 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e2ae9dc4-a11d-447b-8476-2f3255b4b94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:58.333692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae9dc4-a11d-447b-8476-2f3255b4b94e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:58.356476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25bc4a-2d9c-467d-9eac-65a071df5deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:58.357803 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25bc4a-2d9c-467d-9eac-65a071df5deb admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:58.358601 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25bc4a-2d9c-467d-9eac-65a071df5deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:58.359091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25bc4a-2d9c-467d-9eac-65a071df5deb admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:58.359955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25bc4a-2d9c-467d-9eac-65a071df5deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:58.362437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25bc4a-2d9c-467d-9eac-65a071df5deb admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:58.384170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1226/2487] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:58.385955 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd25686-fa68-4ed5-94c6-845777548552 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:58.414880 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd25686-fa68-4ed5-94c6-845777548552 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:58.420590 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c48c6-aee9-48e8-a178-692fd7291ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:58.421142 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c48c6-aee9-48e8-a178-692fd7291ecc admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:58.421421 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c48c6-aee9-48e8-a178-692fd7291ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:58.421742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c48c6-aee9-48e8-a178-692fd7291ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:58.422444 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c48c6-aee9-48e8-a178-692fd7291ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:58.424047 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c48c6-aee9-48e8-a178-692fd7291ecc admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:58.436959 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1262/2488] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:46:58.446000 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25bc4a-2d9c-467d-9eac-65a071df5deb admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:58.460899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25bc4a-2d9c-467d-9eac-65a071df5deb admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:58.468206 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89b306-5ab2-411b-acd0-97eb6b8398b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:58.469889 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89b306-5ab2-411b-acd0-97eb6b8398b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:58.470157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89b306-5ab2-411b-acd0-97eb6b8398b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:58.470453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89b306-5ab2-411b-acd0-97eb6b8398b1 admin admin] PATH_INFO: `/v3/projects/c4f3bdea9ad746ef9c1a66a01737aedf/users/5b93219cbf794e48b9877e025003eaba/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:58.486930 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89b306-5ab2-411b-acd0-97eb6b8398b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f3bdea9ad746ef9c1a66a01737aedf, user_id=5b93219cbf794e48b9877e025003eaba, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:58.490179 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89b306-5ab2-411b-acd0-97eb6b8398b1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:58.520989 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02213b2-5dd0-443c-9b2d-e2a2569b3a88 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:58.521328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02213b2-5dd0-443c-9b2d-e2a2569b3a88 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:58.521592 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02213b2-5dd0-443c-9b2d-e2a2569b3a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:58.524522 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1227/2489] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:46:58 2022] PUT /identity/v3/projects/c4f3bdea9ad746ef9c1a66a01737aedf/users/5b93219cbf794e48b9877e025003eaba/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:46:58.573874 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-e02213b2-5dd0-443c-9b2d-e2a2569b3a88 None None] MFA Rules not processed for user `5b93219cbf794e48b9877e025003eaba`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:58.576156 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e02213b2-5dd0-443c-9b2d-e2a2569b3a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:58.661239 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1263/2490] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:46:58.672083 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89b306-5ab2-411b-acd0-97eb6b8398b1 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:46:58.673948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4c89b306-5ab2-411b-acd0-97eb6b8398b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:58.733940 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89b306-5ab2-411b-acd0-97eb6b8398b1 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:46:58.738066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286d516-8604-4b36-8a30-00bbda742fb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:46:58.738661 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286d516-8604-4b36-8a30-00bbda742fb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:58.738940 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286d516-8604-4b36-8a30-00bbda742fb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:58.739548 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286d516-8604-4b36-8a30-00bbda742fb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:58.749389 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286d516-8604-4b36-8a30-00bbda742fb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:46:58.750797 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286d516-8604-4b36-8a30-00bbda742fb7 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:46:58.760461 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1228/2491] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:46:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:46:59.463010 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f510123-b365-4b24-9c86-73a40f167aa3 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:46:59.463515 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f510123-b365-4b24-9c86-73a40f167aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:46:59.463702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f510123-b365-4b24-9c86-73a40f167aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:46:59.482446 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-3f510123-b365-4b24-9c86-73a40f167aa3 None None] MFA Rules not processed for user `1b397d9d45b3441eba444571ff8a185b`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:46:59.483637 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3f510123-b365-4b24-9c86-73a40f167aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:46:59.508512 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:46:59.551206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1264/2492] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:46:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:47:00.257680 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554612f-a478-47da-9053-7d24cb1b79f3 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:00.258901 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554612f-a478-47da-9053-7d24cb1b79f3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:00.259390 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554612f-a478-47da-9053-7d24cb1b79f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:00.314907 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-7554612f-a478-47da-9053-7d24cb1b79f3 None None] MFA Rules not processed for user `ed49a596f15542a29ce331bae4640274`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:00.316769 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7554612f-a478-47da-9053-7d24cb1b79f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:00.430426 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1229/2493] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 15 00:47:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:47:00.458351 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f510123-b365-4b24-9c86-73a40f167aa3 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:00.462782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3f510123-b365-4b24-9c86-73a40f167aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:00.578851 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f510123-b365-4b24-9c86-73a40f167aa3 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:00.584673 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc697f3-3fdc-44cb-b617-2fcf02c5bde6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb248b85aba45b39132d0f92ede0b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:00.585545 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc697f3-3fdc-44cb-b617-2fcf02c5bde6 service swift] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:00.585831 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc697f3-3fdc-44cb-b617-2fcf02c5bde6 service swift] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:00.586107 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc697f3-3fdc-44cb-b617-2fcf02c5bde6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:00.602707 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc697f3-3fdc-44cb-b617-2fcf02c5bde6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:00.604776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc697f3-3fdc-44cb-b617-2fcf02c5bde6 service swift] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:00.614056 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1265/2494] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 15 00:47:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 00:47:01.045433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672a9a7-9dd2-4be1-bf90-5d3b10ab696b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:01.045727 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672a9a7-9dd2-4be1-bf90-5d3b10ab696b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:01.046003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672a9a7-9dd2-4be1-bf90-5d3b10ab696b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:01.056520 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:01.077384 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0672a9a7-9dd2-4be1-bf90-5d3b10ab696b None None] MFA Rules not processed for user `ed49a596f15542a29ce331bae4640274`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:01.078602 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0672a9a7-9dd2-4be1-bf90-5d3b10ab696b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:01.089978 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1230/2495] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 15 00:47:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:47:01.112253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc697f3-3fdc-44cb-b617-2fcf02c5bde6 service swift] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:01.124849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc697f3-3fdc-44cb-b617-2fcf02c5bde6 service swift] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:01.130909 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc53a9b-00a6-4358-9394-72b2a48c0189 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb248b85aba45b39132d0f92ede0b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:01.131512 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc53a9b-00a6-4358-9394-72b2a48c0189 service swift] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:01.131966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc53a9b-00a6-4358-9394-72b2a48c0189 service swift] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:01.132405 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc53a9b-00a6-4358-9394-72b2a48c0189 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:01.143679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc53a9b-00a6-4358-9394-72b2a48c0189 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:01.145388 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc53a9b-00a6-4358-9394-72b2a48c0189 service swift] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:01.155169 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1266/2496] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 15 00:47:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 00:47:01.958443 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccfd67-220d-416f-8274-1a5484ec1bb1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:01.958912 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccfd67-220d-416f-8274-1a5484ec1bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:01.959006 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccfd67-220d-416f-8274-1a5484ec1bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:01.993752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-31ccfd67-220d-416f-8274-1a5484ec1bb1 None None] MFA Rules not processed for user `ed49a596f15542a29ce331bae4640274`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:01.995142 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-31ccfd67-220d-416f-8274-1a5484ec1bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:02.014224 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1231/2497] 10.222.0.52 () {58 vars in 967 bytes} [Thu Sep 15 00:47:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:47:02.033356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc53a9b-00a6-4358-9394-72b2a48c0189 service swift] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:02.050193 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc53a9b-00a6-4358-9394-72b2a48c0189 service swift] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:02.064014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f1cb2-5c65-4e97-bb47-7b1cb5c20460 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb248b85aba45b39132d0f92ede0b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:02.064671 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f1cb2-5c65-4e97-bb47-7b1cb5c20460 service swift] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:02.064955 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f1cb2-5c65-4e97-bb47-7b1cb5c20460 service swift] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:02.065268 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f1cb2-5c65-4e97-bb47-7b1cb5c20460 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:02.078941 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f1cb2-5c65-4e97-bb47-7b1cb5c20460 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:02.081812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f1cb2-5c65-4e97-bb47-7b1cb5c20460 service swift] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:02.098330 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1267/2498] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 15 00:47:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 00:47:02.507919 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a9979-598e-4748-b480-c059f9240533 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:02.513119 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a9979-598e-4748-b480-c059f9240533 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:02.513119 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a9979-598e-4748-b480-c059f9240533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:02.575459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f67a9979-598e-4748-b480-c059f9240533 None None] MFA Rules not processed for user `ed49a596f15542a29ce331bae4640274`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:02.577218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f67a9979-598e-4748-b480-c059f9240533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:02.602474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1232/2499] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 15 00:47:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:47:02.621147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f1cb2-5c65-4e97-bb47-7b1cb5c20460 service swift] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:02.635629 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f1cb2-5c65-4e97-bb47-7b1cb5c20460 service swift] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:02.642580 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39c57c-a454-4893-b6e0-972e2b5627dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb248b85aba45b39132d0f92ede0b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:02.643453 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39c57c-a454-4893-b6e0-972e2b5627dd service swift] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:02.643925 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39c57c-a454-4893-b6e0-972e2b5627dd service swift] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:02.644537 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39c57c-a454-4893-b6e0-972e2b5627dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:02.659721 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39c57c-a454-4893-b6e0-972e2b5627dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:02.662151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39c57c-a454-4893-b6e0-972e2b5627dd service swift] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:02.678602 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1268/2500] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 15 00:47:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 00:47:03.099912 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31453d9-9eee-4bdb-9e54-eb5838ac75a6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:03.101024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31453d9-9eee-4bdb-9e54-eb5838ac75a6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:03.101545 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31453d9-9eee-4bdb-9e54-eb5838ac75a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:03.139582 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b31453d9-9eee-4bdb-9e54-eb5838ac75a6 None None] MFA Rules not processed for user `ed49a596f15542a29ce331bae4640274`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:03.141177 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b31453d9-9eee-4bdb-9e54-eb5838ac75a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:03.150044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1233/2501] 10.222.0.52 () {58 vars in 967 bytes} [Thu Sep 15 00:47:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:47:03.168566 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39c57c-a454-4893-b6e0-972e2b5627dd service swift] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:03.191963 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39c57c-a454-4893-b6e0-972e2b5627dd service swift] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:03.197528 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f272d-e275-4ad0-aec8-cd8440b6c57a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb248b85aba45b39132d0f92ede0b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:03.198748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f272d-e275-4ad0-aec8-cd8440b6c57a service swift] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:03.199040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f272d-e275-4ad0-aec8-cd8440b6c57a service swift] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:03.199312 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f272d-e275-4ad0-aec8-cd8440b6c57a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:03.208477 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f272d-e275-4ad0-aec8-cd8440b6c57a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:03.210113 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f272d-e275-4ad0-aec8-cd8440b6c57a service swift] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:03.220057 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1269/2502] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 15 00:47:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 00:47:04.837540 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31453d9-9eee-4bdb-9e54-eb5838ac75a6 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:04.952879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31453d9-9eee-4bdb-9e54-eb5838ac75a6 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:04.957826 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226218a-d2ad-4d43-a609-2972f7760798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:04.958456 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226218a-d2ad-4d43-a609-2972f7760798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:04.958913 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226218a-d2ad-4d43-a609-2972f7760798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:04.959192 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226218a-d2ad-4d43-a609-2972f7760798 admin admin] PATH_INFO: `/v3/users/5b93219cbf794e48b9877e025003eaba` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:04.960411 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226218a-d2ad-4d43-a609-2972f7760798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b93219cbf794e48b9877e025003eaba)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:04.962456 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226218a-d2ad-4d43-a609-2972f7760798 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:05.019835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7226218a-d2ad-4d43-a609-2972f7760798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b93219cbf794e48b9877e025003eaba'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:05.028988 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7226218a-d2ad-4d43-a609-2972f7760798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b93219cbf794e48b9877e025003eaba'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:05.029704 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7226218a-d2ad-4d43-a609-2972f7760798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b93219cbf794e48b9877e025003eaba'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:05.030590 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7226218a-d2ad-4d43-a609-2972f7760798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b93219cbf794e48b9877e025003eaba'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:05.038743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7226218a-d2ad-4d43-a609-2972f7760798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b93219cbf794e48b9877e025003eaba'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:05.065010 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1234/2503] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:47:04 2022] DELETE /identity/v3/users/5b93219cbf794e48b9877e025003eaba => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:47:05.070766 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469a9cc-8778-4dc5-a544-ec1bf9d22e0f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:05.071329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469a9cc-8778-4dc5-a544-ec1bf9d22e0f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:05.071425 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469a9cc-8778-4dc5-a544-ec1bf9d22e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:05.099324 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-1469a9cc-8778-4dc5-a544-ec1bf9d22e0f None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:05.100856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1469a9cc-8778-4dc5-a544-ec1bf9d22e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:05.178672 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1270/2504] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:47:05.186174 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226218a-d2ad-4d43-a609-2972f7760798 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:05.187909 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-7226218a-d2ad-4d43-a609-2972f7760798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:05.269716 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226218a-d2ad-4d43-a609-2972f7760798 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:05.273867 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa0e63-4b62-41aa-a54c-20c99ab4e1ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:05.274551 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa0e63-4b62-41aa-a54c-20c99ab4e1ed service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:05.274903 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa0e63-4b62-41aa-a54c-20c99ab4e1ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:05.275234 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa0e63-4b62-41aa-a54c-20c99ab4e1ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:05.295381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa0e63-4b62-41aa-a54c-20c99ab4e1ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:05.296984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa0e63-4b62-41aa-a54c-20c99ab4e1ed service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:05.309344 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:05.309465 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1235/2505] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:47:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:47:05.622561 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469a9cc-8778-4dc5-a544-ec1bf9d22e0f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:05.624090 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1469a9cc-8778-4dc5-a544-ec1bf9d22e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:05.637377 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469a9cc-8778-4dc5-a544-ec1bf9d22e0f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:05.645946 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98785f4-24fc-4cab-9e50-f874515624bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:05.646892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98785f4-24fc-4cab-9e50-f874515624bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:05.647392 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98785f4-24fc-4cab-9e50-f874515624bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:05.647869 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98785f4-24fc-4cab-9e50-f874515624bc admin admin] PATH_INFO: `/v3/users/efa791ea39a940b29d1bb3a9815ba0ee` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:05.653927 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98785f4-24fc-4cab-9e50-f874515624bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=efa791ea39a940b29d1bb3a9815ba0ee)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:05.656378 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98785f4-24fc-4cab-9e50-f874515624bc admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:05.676183 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:05.776668 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f98785f4-24fc-4cab-9e50-f874515624bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efa791ea39a940b29d1bb3a9815ba0ee'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:05.793340 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f98785f4-24fc-4cab-9e50-f874515624bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efa791ea39a940b29d1bb3a9815ba0ee'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:05.794275 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f98785f4-24fc-4cab-9e50-f874515624bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efa791ea39a940b29d1bb3a9815ba0ee'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:05.795160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f98785f4-24fc-4cab-9e50-f874515624bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efa791ea39a940b29d1bb3a9815ba0ee'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:05.808747 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f98785f4-24fc-4cab-9e50-f874515624bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efa791ea39a940b29d1bb3a9815ba0ee'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:05.875430 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1271/2506] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:47:05 2022] DELETE /identity/v3/users/efa791ea39a940b29d1bb3a9815ba0ee => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:47:05.878419 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76e391-01b9-4b22-a694-a2fcc85a4eb0 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:05.879003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76e391-01b9-4b22-a694-a2fcc85a4eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:05.879003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76e391-01b9-4b22-a694-a2fcc85a4eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:05.915013 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9e76e391-01b9-4b22-a694-a2fcc85a4eb0 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:05.916244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9e76e391-01b9-4b22-a694-a2fcc85a4eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:05.968942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98785f4-24fc-4cab-9e50-f874515624bc admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:05.970754 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f98785f4-24fc-4cab-9e50-f874515624bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:06.069494 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1236/2507] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:47:06.080674 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76e391-01b9-4b22-a694-a2fcc85a4eb0 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:06.082785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9e76e391-01b9-4b22-a694-a2fcc85a4eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:06.096084 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98785f4-24fc-4cab-9e50-f874515624bc admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:06.103130 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c982818-a5a9-4993-99a5-96d1c7dbf724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:06.104658 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c982818-a5a9-4993-99a5-96d1c7dbf724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:06.105279 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c982818-a5a9-4993-99a5-96d1c7dbf724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:06.105777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c982818-a5a9-4993-99a5-96d1c7dbf724 admin admin] PATH_INFO: `/v3/projects/c4f3bdea9ad746ef9c1a66a01737aedf` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:06.107271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c982818-a5a9-4993-99a5-96d1c7dbf724 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f3bdea9ad746ef9c1a66a01737aedf)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:06.109862 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c982818-a5a9-4993-99a5-96d1c7dbf724 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:06.169073 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0c982818-a5a9-4993-99a5-96d1c7dbf724 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f3bdea9ad746ef9c1a66a01737aedf', 'request_id': 'req-0c982818-a5a9-4993-99a5-96d1c7dbf724'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:06.173540 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76e391-01b9-4b22-a694-a2fcc85a4eb0 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:06.176909 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0c982818-a5a9-4993-99a5-96d1c7dbf724 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f3bdea9ad746ef9c1a66a01737aedf', 'request_id': 'req-0c982818-a5a9-4993-99a5-96d1c7dbf724'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:06.197472 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0c982818-a5a9-4993-99a5-96d1c7dbf724 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f3bdea9ad746ef9c1a66a01737aedf', 'request_id': 'req-0c982818-a5a9-4993-99a5-96d1c7dbf724'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:06.220309 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0c982818-a5a9-4993-99a5-96d1c7dbf724 admin admin] The token cache is being invalidate because project c4f3bdea9ad746ef9c1a66a01737aedf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:47:06.221077 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0c982818-a5a9-4993-99a5-96d1c7dbf724 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:06.222251 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0c982818-a5a9-4993-99a5-96d1c7dbf724 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:06.223812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1272/2508] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:47:05 2022] DELETE /identity/v3/projects/c4f3bdea9ad746ef9c1a66a01737aedf => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:47:06.229681 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cb0d7-f9d7-43d0-b427-7bafadf65c56 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:06.229963 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cb0d7-f9d7-43d0-b427-7bafadf65c56 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:06.230235 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cb0d7-f9d7-43d0-b427-7bafadf65c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:06.256789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a44d7-e3b7-4919-89b6-2c994fb3e6d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:06.257532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a44d7-e3b7-4919-89b6-2c994fb3e6d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:06.257834 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a44d7-e3b7-4919-89b6-2c994fb3e6d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:06.258184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a44d7-e3b7-4919-89b6-2c994fb3e6d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:06.260049 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ac8a44d7-e3b7-4919-89b6-2c994fb3e6d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:06.281875 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-db2cb0d7-f9d7-43d0-b427-7bafadf65c56 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:06.284952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-db2cb0d7-f9d7-43d0-b427-7bafadf65c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:06.314714 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:06.385980 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a44d7-e3b7-4919-89b6-2c994fb3e6d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:06.395493 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1273/2509] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:47:06.395711 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a44d7-e3b7-4919-89b6-2c994fb3e6d7 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:06.397124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf6f05-d191-440d-a5e8-26adcf331726 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:06.397467 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf6f05-d191-440d-a5e8-26adcf331726 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:06.397813 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf6f05-d191-440d-a5e8-26adcf331726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:06.406420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1237/2510] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:47:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:47:06.426141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-6fbf6f05-d191-440d-a5e8-26adcf331726 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:06.427481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6fbf6f05-d191-440d-a5e8-26adcf331726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:06.437123 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1274/2511] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:47:06.440878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a44d7-e3b7-4919-89b6-2c994fb3e6d7 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:06.448890 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:06.452357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a44d7-e3b7-4919-89b6-2c994fb3e6d7 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:06.461311 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcd278-234f-4a0a-b960-4a38d64192cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:06.462039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcd278-234f-4a0a-b960-4a38d64192cb admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:06.462698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcd278-234f-4a0a-b960-4a38d64192cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:06.462698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcd278-234f-4a0a-b960-4a38d64192cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:06.463222 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcd278-234f-4a0a-b960-4a38d64192cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:47:06.463526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcd278-234f-4a0a-b960-4a38d64192cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:06.471255 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcd278-234f-4a0a-b960-4a38d64192cb admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:06.489549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1238/2512] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:47:06.493669 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf6f05-d191-440d-a5e8-26adcf331726 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:06.504097 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf6f05-d191-440d-a5e8-26adcf331726 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:06.509141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b231ffe-baaa-43ac-9ef1-83fa639d8095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:06.509881 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b231ffe-baaa-43ac-9ef1-83fa639d8095 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:06.510231 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b231ffe-baaa-43ac-9ef1-83fa639d8095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:06.510578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b231ffe-baaa-43ac-9ef1-83fa639d8095 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:06.511366 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b231ffe-baaa-43ac-9ef1-83fa639d8095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:06.513480 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b231ffe-baaa-43ac-9ef1-83fa639d8095 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:06.545212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1275/2513] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:47:06 2022] POST /identity/v3/projects => generated 397 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:47:06.549203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcd278-234f-4a0a-b960-4a38d64192cb admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:06.561747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcd278-234f-4a0a-b960-4a38d64192cb admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:06.650643 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3d347-28d4-470f-8186-15a83aeda511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:06.651491 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3d347-28d4-470f-8186-15a83aeda511 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:06.651983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3d347-28d4-470f-8186-15a83aeda511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:06.652308 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3d347-28d4-470f-8186-15a83aeda511 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:06.652944 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3d347-28d4-470f-8186-15a83aeda511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:06.655021 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3d347-28d4-470f-8186-15a83aeda511 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:06.680161 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b231ffe-baaa-43ac-9ef1-83fa639d8095 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:06.682307 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4b231ffe-baaa-43ac-9ef1-83fa639d8095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:06.701727 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1239/2514] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:47:06 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:47:06.710230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3d347-28d4-470f-8186-15a83aeda511 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:06.719691 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b231ffe-baaa-43ac-9ef1-83fa639d8095 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:06.733795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3d347-28d4-470f-8186-15a83aeda511 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:06.734492 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91125c-2fe2-4fe2-81df-e1b74ec1ac0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:06.735347 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91125c-2fe2-4fe2-81df-e1b74ec1ac0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:06.735951 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91125c-2fe2-4fe2-81df-e1b74ec1ac0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:06.736289 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91125c-2fe2-4fe2-81df-e1b74ec1ac0c admin admin] PATH_INFO: `/v3/projects/1f843d68aab0482facaf95ced317b692` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:06.739039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91125c-2fe2-4fe2-81df-e1b74ec1ac0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f843d68aab0482facaf95ced317b692)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:06.741148 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91125c-2fe2-4fe2-81df-e1b74ec1ac0c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:06.747759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e4228-8ecb-4b1a-96a5-a80e5cca5bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:06.748703 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e4228-8ecb-4b1a-96a5-a80e5cca5bbb admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:06.749102 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e4228-8ecb-4b1a-96a5-a80e5cca5bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:06.749451 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e4228-8ecb-4b1a-96a5-a80e5cca5bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:06.750165 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e4228-8ecb-4b1a-96a5-a80e5cca5bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:06.751978 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e4228-8ecb-4b1a-96a5-a80e5cca5bbb admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:06.784910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1240/2515] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:47:06.789124 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e4228-8ecb-4b1a-96a5-a80e5cca5bbb admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:06.845421 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7f91125c-2fe2-4fe2-81df-e1b74ec1ac0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f843d68aab0482facaf95ced317b692', 'request_id': 'req-7f91125c-2fe2-4fe2-81df-e1b74ec1ac0c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:06.850570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e4228-8ecb-4b1a-96a5-a80e5cca5bbb admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:06.853548 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7f91125c-2fe2-4fe2-81df-e1b74ec1ac0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f843d68aab0482facaf95ced317b692', 'request_id': 'req-7f91125c-2fe2-4fe2-81df-e1b74ec1ac0c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:06.867032 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7f91125c-2fe2-4fe2-81df-e1b74ec1ac0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f843d68aab0482facaf95ced317b692', 'request_id': 'req-7f91125c-2fe2-4fe2-81df-e1b74ec1ac0c'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:06.885576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7f91125c-2fe2-4fe2-81df-e1b74ec1ac0c admin admin] The token cache is being invalidate because project 1f843d68aab0482facaf95ced317b692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:47:06.886054 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7f91125c-2fe2-4fe2-81df-e1b74ec1ac0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:06.887044 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7f91125c-2fe2-4fe2-81df-e1b74ec1ac0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:06.892646 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1276/2516] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:47:06 2022] DELETE /identity/v3/projects/1f843d68aab0482facaf95ced317b692 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:47:06.894886 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0c74a-33d3-4b42-af4d-44b26fe9491a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:06.895205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0c74a-33d3-4b42-af4d-44b26fe9491a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:06.895745 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0c74a-33d3-4b42-af4d-44b26fe9491a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:06.924049 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-c5c0c74a-33d3-4b42-af4d-44b26fe9491a None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:06.926364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c5c0c74a-33d3-4b42-af4d-44b26fe9491a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:06.979895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9903794-2655-417a-8750-ce000fdf4249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:06.980518 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9903794-2655-417a-8750-ce000fdf4249 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:06.980795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9903794-2655-417a-8750-ce000fdf4249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:06.981068 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9903794-2655-417a-8750-ce000fdf4249 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:06.981750 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9903794-2655-417a-8750-ce000fdf4249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:06.983349 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9903794-2655-417a-8750-ce000fdf4249 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:07.024607 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1241/2517] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 00:47:07.029441 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9903794-2655-417a-8750-ce000fdf4249 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:07.037180 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c9903794-2655-417a-8750-ce000fdf4249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:07.061492 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1277/2518] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:47:07.068288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e8065-c73e-48ff-b1fd-eba1b9d4e7fa None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:07.068575 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e8065-c73e-48ff-b1fd-eba1b9d4e7fa None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:07.068846 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e8065-c73e-48ff-b1fd-eba1b9d4e7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:07.088317 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9903794-2655-417a-8750-ce000fdf4249 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:07.114428 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191b6f9-325d-4b7b-9a06-d82c37b6e1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:07.115173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191b6f9-325d-4b7b-9a06-d82c37b6e1bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:07.115371 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191b6f9-325d-4b7b-9a06-d82c37b6e1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:07.115637 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191b6f9-325d-4b7b-9a06-d82c37b6e1bf admin admin] PATH_INFO: `/v3/projects/793ea4b35e854d15ab205bfbbe496f17/users/3fc2139ebea849e2b44cab01f166ae14/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:07.139999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-3c0e8065-c73e-48ff-b1fd-eba1b9d4e7fa None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:07.146265 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3c0e8065-c73e-48ff-b1fd-eba1b9d4e7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:07.162008 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191b6f9-325d-4b7b-9a06-d82c37b6e1bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=793ea4b35e854d15ab205bfbbe496f17, user_id=3fc2139ebea849e2b44cab01f166ae14, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:07.167021 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1278/2519] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:47:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:47:07.168876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191b6f9-325d-4b7b-9a06-d82c37b6e1bf admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:07.185366 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e8065-c73e-48ff-b1fd-eba1b9d4e7fa None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:07.185366 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:07.188356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e8065-c73e-48ff-b1fd-eba1b9d4e7fa None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:07.209611 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1242/2520] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:47:07 2022] PUT /identity/v3/projects/793ea4b35e854d15ab205bfbbe496f17/users/3fc2139ebea849e2b44cab01f166ae14/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:47:07.216543 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce6235-ee2f-45a9-ac2f-a730d2e6dd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:07.220532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce6235-ee2f-45a9-ac2f-a730d2e6dd11 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:07.220951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d61af-2f8a-476d-b506-ec45a1796049 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:07.221125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce6235-ee2f-45a9-ac2f-a730d2e6dd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:07.221228 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d61af-2f8a-476d-b506-ec45a1796049 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:07.221335 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce6235-ee2f-45a9-ac2f-a730d2e6dd11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:07.221415 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d61af-2f8a-476d-b506-ec45a1796049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:07.221946 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce6235-ee2f-45a9-ac2f-a730d2e6dd11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:47:07.226064 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce6235-ee2f-45a9-ac2f-a730d2e6dd11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:07.228494 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce6235-ee2f-45a9-ac2f-a730d2e6dd11 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:07.260771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1279/2521] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:47:07.269196 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce6235-ee2f-45a9-ac2f-a730d2e6dd11 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:07.284315 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce6235-ee2f-45a9-ac2f-a730d2e6dd11 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:07.292263 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-617d61af-2f8a-476d-b506-ec45a1796049 None None] MFA Rules not processed for user `3fc2139ebea849e2b44cab01f166ae14`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:07.293635 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-617d61af-2f8a-476d-b506-ec45a1796049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:07.466863 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:07.475119 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a85a9-ac77-4a56-ad81-dab430ab1cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:07.476435 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a85a9-ac77-4a56-ad81-dab430ab1cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:07.477015 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a85a9-ac77-4a56-ad81-dab430ab1cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:07.477798 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a85a9-ac77-4a56-ad81-dab430ab1cb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:07.478604 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a85a9-ac77-4a56-ad81-dab430ab1cb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:07.480762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a85a9-ac77-4a56-ad81-dab430ab1cb8 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:07.526749 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1280/2522] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:47:07 2022] POST /identity/v3/projects => generated 391 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:47:07.527800 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a85a9-ac77-4a56-ad81-dab430ab1cb8 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:07.554607 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1243/2523] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:47:07 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:47:07.569797 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d61af-2f8a-476d-b506-ec45a1796049 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:07.571190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-617d61af-2f8a-476d-b506-ec45a1796049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:07.621636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a85a9-ac77-4a56-ad81-dab430ab1cb8 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:07.628198 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf3bdd-21e4-475b-9200-e562c10caf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:07.628572 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf3bdd-21e4-475b-9200-e562c10caf95 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:07.629007 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf3bdd-21e4-475b-9200-e562c10caf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:07.629355 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf3bdd-21e4-475b-9200-e562c10caf95 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:07.630223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf3bdd-21e4-475b-9200-e562c10caf95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:07.632783 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf3bdd-21e4-475b-9200-e562c10caf95 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:07.663604 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1281/2524] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:47:07 2022] POST /identity/v3/users => generated 296 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:47:07.668116 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf3bdd-21e4-475b-9200-e562c10caf95 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:07.671657 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d61af-2f8a-476d-b506-ec45a1796049 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:07.680820 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf3bdd-21e4-475b-9200-e562c10caf95 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:07.685690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cf84a-4b0f-4456-abf3-9f12d6a233fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:07.686300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cf84a-4b0f-4456-abf3-9f12d6a233fa admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:07.686581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cf84a-4b0f-4456-abf3-9f12d6a233fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:07.686855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cf84a-4b0f-4456-abf3-9f12d6a233fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:07.687498 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cf84a-4b0f-4456-abf3-9f12d6a233fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:07.689132 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cf84a-4b0f-4456-abf3-9f12d6a233fa admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:07.724168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1282/2525] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:47:07.728524 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cf84a-4b0f-4456-abf3-9f12d6a233fa admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:07.746787 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85c202-e8c8-4c41-8691-83687ec1cfb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:07.747050 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cf84a-4b0f-4456-abf3-9f12d6a233fa admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:07.748225 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85c202-e8c8-4c41-8691-83687ec1cfb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:07.748724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85c202-e8c8-4c41-8691-83687ec1cfb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:07.749232 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85c202-e8c8-4c41-8691-83687ec1cfb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:07.770733 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207efd7-3ea3-4893-bf08-f2ceb7ddb46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:07.771352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207efd7-3ea3-4893-bf08-f2ceb7ddb46a admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:07.771631 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207efd7-3ea3-4893-bf08-f2ceb7ddb46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:07.771900 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207efd7-3ea3-4893-bf08-f2ceb7ddb46a admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:07.772542 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207efd7-3ea3-4893-bf08-f2ceb7ddb46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:07.774151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207efd7-3ea3-4893-bf08-f2ceb7ddb46a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:07.785596 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1283/2526] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 00:47:07.789408 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207efd7-3ea3-4893-bf08-f2ceb7ddb46a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:07.800220 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207efd7-3ea3-4893-bf08-f2ceb7ddb46a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:07.807237 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d23f94-5cc3-4027-a07f-87e1ec8451a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:07.808257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d23f94-5cc3-4027-a07f-87e1ec8451a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:07.808615 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d23f94-5cc3-4027-a07f-87e1ec8451a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:07.809057 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d23f94-5cc3-4027-a07f-87e1ec8451a9 admin admin] PATH_INFO: `/v3/projects/9c2e8b040a69474992c03172983db76c/users/92cc414a1eae400d9157f56dd27bcd2c/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:07.822843 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85c202-e8c8-4c41-8691-83687ec1cfb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:07.827211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85c202-e8c8-4c41-8691-83687ec1cfb7 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:07.829193 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d23f94-5cc3-4027-a07f-87e1ec8451a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2e8b040a69474992c03172983db76c, user_id=92cc414a1eae400d9157f56dd27bcd2c, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:07.833342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d23f94-5cc3-4027-a07f-87e1ec8451a9 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:07.835616 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1244/2527] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:47:07 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:47:07.860092 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1284/2528] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:47:07 2022] PUT /identity/v3/projects/9c2e8b040a69474992c03172983db76c/users/92cc414a1eae400d9157f56dd27bcd2c/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:47:07.927756 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d80dcb-e1ab-46f7-aa09-e7bcf48df289 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:07.928066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d80dcb-e1ab-46f7-aa09-e7bcf48df289 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:07.928337 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d80dcb-e1ab-46f7-aa09-e7bcf48df289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:07.995032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-57d80dcb-e1ab-46f7-aa09-e7bcf48df289 None None] MFA Rules not processed for user `92cc414a1eae400d9157f56dd27bcd2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:07.996274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-57d80dcb-e1ab-46f7-aa09-e7bcf48df289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:08.034631 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:08.085350 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1245/2529] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:47:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:47:08.095158 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d23f94-5cc3-4027-a07f-87e1ec8451a9 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:08.121041 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:08.182355 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d23f94-5cc3-4027-a07f-87e1ec8451a9 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:08.185960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6168c-9607-495c-a234-5cbb3d74f0a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:08.186571 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6168c-9607-495c-a234-5cbb3d74f0a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:08.186854 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6168c-9607-495c-a234-5cbb3d74f0a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:08.187127 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6168c-9607-495c-a234-5cbb3d74f0a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:08.200856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6168c-9607-495c-a234-5cbb3d74f0a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:08.203430 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6168c-9607-495c-a234-5cbb3d74f0a0 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:08.216602 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1285/2530] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:47:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:47:11.124672 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d80dcb-e1ab-46f7-aa09-e7bcf48df289 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:11.130390 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-57d80dcb-e1ab-46f7-aa09-e7bcf48df289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:11.205010 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d80dcb-e1ab-46f7-aa09-e7bcf48df289 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:11.211211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e6ef4-1083-4b84-9ba2-c2088eb0943d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:11.211916 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e6ef4-1083-4b84-9ba2-c2088eb0943d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:11.212257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e6ef4-1083-4b84-9ba2-c2088eb0943d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:11.212591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e6ef4-1083-4b84-9ba2-c2088eb0943d admin admin] PATH_INFO: `/v3/users/b9f828d9035b40c08ed1a0dd4d71cae0` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:11.214485 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e6ef4-1083-4b84-9ba2-c2088eb0943d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9f828d9035b40c08ed1a0dd4d71cae0)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:11.216388 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e6ef4-1083-4b84-9ba2-c2088eb0943d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:11.297722 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-308e6ef4-1083-4b84-9ba2-c2088eb0943d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9f828d9035b40c08ed1a0dd4d71cae0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:11.306474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-308e6ef4-1083-4b84-9ba2-c2088eb0943d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9f828d9035b40c08ed1a0dd4d71cae0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:11.307083 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-308e6ef4-1083-4b84-9ba2-c2088eb0943d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9f828d9035b40c08ed1a0dd4d71cae0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:11.307802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-308e6ef4-1083-4b84-9ba2-c2088eb0943d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9f828d9035b40c08ed1a0dd4d71cae0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:11.316834 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-308e6ef4-1083-4b84-9ba2-c2088eb0943d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9f828d9035b40c08ed1a0dd4d71cae0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:11.338610 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1246/2531] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:47:11 2022] DELETE /identity/v3/users/b9f828d9035b40c08ed1a0dd4d71cae0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:47:11.343301 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7912be-3a42-444d-89c1-ad39d89f652e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:11.343832 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7912be-3a42-444d-89c1-ad39d89f652e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:11.344211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7912be-3a42-444d-89c1-ad39d89f652e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:11.363980 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2c7912be-3a42-444d-89c1-ad39d89f652e None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:11.365223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2c7912be-3a42-444d-89c1-ad39d89f652e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:11.424354 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1286/2532] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:47:11.434069 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e6ef4-1083-4b84-9ba2-c2088eb0943d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:11.435488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-308e6ef4-1083-4b84-9ba2-c2088eb0943d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:11.495441 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e6ef4-1083-4b84-9ba2-c2088eb0943d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:11.499085 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdba73-6da8-4680-94f3-bfa7a698026d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:11.499676 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdba73-6da8-4680-94f3-bfa7a698026d service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:11.499982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdba73-6da8-4680-94f3-bfa7a698026d service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:11.500251 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdba73-6da8-4680-94f3-bfa7a698026d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:11.506862 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:11.511231 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdba73-6da8-4680-94f3-bfa7a698026d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:11.512775 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdba73-6da8-4680-94f3-bfa7a698026d service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:11.523985 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1247/2533] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:47:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:47:11.858382 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7912be-3a42-444d-89c1-ad39d89f652e None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:11.859988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2c7912be-3a42-444d-89c1-ad39d89f652e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:11.874049 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7912be-3a42-444d-89c1-ad39d89f652e None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:11.879169 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925f0c9-6973-4cc7-905e-377b82330938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:11.880359 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925f0c9-6973-4cc7-905e-377b82330938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:11.880797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925f0c9-6973-4cc7-905e-377b82330938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:11.881072 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925f0c9-6973-4cc7-905e-377b82330938 admin admin] PATH_INFO: `/v3/projects/d59dffacd0744fe1a7f2b167cb2b9f4a` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:11.882214 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925f0c9-6973-4cc7-905e-377b82330938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d59dffacd0744fe1a7f2b167cb2b9f4a)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:11.884137 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925f0c9-6973-4cc7-905e-377b82330938 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:11.931545 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e925f0c9-6973-4cc7-905e-377b82330938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd59dffacd0744fe1a7f2b167cb2b9f4a', 'request_id': 'req-e925f0c9-6973-4cc7-905e-377b82330938'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:11.937492 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e925f0c9-6973-4cc7-905e-377b82330938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd59dffacd0744fe1a7f2b167cb2b9f4a', 'request_id': 'req-e925f0c9-6973-4cc7-905e-377b82330938'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:11.945403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e925f0c9-6973-4cc7-905e-377b82330938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd59dffacd0744fe1a7f2b167cb2b9f4a', 'request_id': 'req-e925f0c9-6973-4cc7-905e-377b82330938'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:11.957383 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e925f0c9-6973-4cc7-905e-377b82330938 admin admin] The token cache is being invalidate because project d59dffacd0744fe1a7f2b167cb2b9f4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:47:11.957678 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e925f0c9-6973-4cc7-905e-377b82330938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:11.958317 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-e925f0c9-6973-4cc7-905e-377b82330938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:11.960017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1287/2534] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:47:11 2022] DELETE /identity/v3/projects/d59dffacd0744fe1a7f2b167cb2b9f4a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:47:13.266519 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdba73-6da8-4680-94f3-bfa7a698026d service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:13.267993 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-03bdba73-6da8-4680-94f3-bfa7a698026d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:13.280740 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdba73-6da8-4680-94f3-bfa7a698026d service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:13.338368 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6013f0f-bf96-4cf8-8959-7a45e7c0e8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:13.339136 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6013f0f-bf96-4cf8-8959-7a45e7c0e8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:13.339253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6013f0f-bf96-4cf8-8959-7a45e7c0e8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:13.339522 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6013f0f-bf96-4cf8-8959-7a45e7c0e8c8 admin admin] PATH_INFO: `/v3/users/3fc2139ebea849e2b44cab01f166ae14` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:13.340660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6013f0f-bf96-4cf8-8959-7a45e7c0e8c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc2139ebea849e2b44cab01f166ae14)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:13.342624 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6013f0f-bf96-4cf8-8959-7a45e7c0e8c8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:13.391409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a6013f0f-bf96-4cf8-8959-7a45e7c0e8c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc2139ebea849e2b44cab01f166ae14'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:13.399358 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a6013f0f-bf96-4cf8-8959-7a45e7c0e8c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc2139ebea849e2b44cab01f166ae14'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:13.399996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a6013f0f-bf96-4cf8-8959-7a45e7c0e8c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc2139ebea849e2b44cab01f166ae14'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:13.400595 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a6013f0f-bf96-4cf8-8959-7a45e7c0e8c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc2139ebea849e2b44cab01f166ae14'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:13.409033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a6013f0f-bf96-4cf8-8959-7a45e7c0e8c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc2139ebea849e2b44cab01f166ae14'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:13.434354 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1248/2535] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:47:13 2022] DELETE /identity/v3/users/3fc2139ebea849e2b44cab01f166ae14 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:47:13.439009 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1450a-47c9-4ebb-b64a-2329c8fd17ad None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:13.439479 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1450a-47c9-4ebb-b64a-2329c8fd17ad None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:13.439590 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1450a-47c9-4ebb-b64a-2329c8fd17ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:13.459604 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-91b1450a-47c9-4ebb-b64a-2329c8fd17ad None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:13.460966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-91b1450a-47c9-4ebb-b64a-2329c8fd17ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:13.512700 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:13.538937 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1288/2536] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:47:13.555447 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6013f0f-bf96-4cf8-8959-7a45e7c0e8c8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:13.561639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a6013f0f-bf96-4cf8-8959-7a45e7c0e8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:13.637820 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6013f0f-bf96-4cf8-8959-7a45e7c0e8c8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:13.642685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbae19-7ee8-46b4-bf3f-faf05852dd3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:13.644143 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbae19-7ee8-46b4-bf3f-faf05852dd3e service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:13.644498 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbae19-7ee8-46b4-bf3f-faf05852dd3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:13.644835 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbae19-7ee8-46b4-bf3f-faf05852dd3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:13.665164 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbae19-7ee8-46b4-bf3f-faf05852dd3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:13.666631 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbae19-7ee8-46b4-bf3f-faf05852dd3e service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:13.686409 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1249/2537] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:47:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:47:14.176209 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1450a-47c9-4ebb-b64a-2329c8fd17ad None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:14.178183 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-91b1450a-47c9-4ebb-b64a-2329c8fd17ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:14.210008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1450a-47c9-4ebb-b64a-2329c8fd17ad None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:14.228710 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2c54d-5ef9-49bc-9bda-535043db6fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:14.229417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2c54d-5ef9-49bc-9bda-535043db6fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:14.229744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2c54d-5ef9-49bc-9bda-535043db6fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:14.230004 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2c54d-5ef9-49bc-9bda-535043db6fd8 admin admin] PATH_INFO: `/v3/projects/793ea4b35e854d15ab205bfbbe496f17` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:14.231515 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2c54d-5ef9-49bc-9bda-535043db6fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=793ea4b35e854d15ab205bfbbe496f17)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:14.233116 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2c54d-5ef9-49bc-9bda-535043db6fd8 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:14.299213 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bfa2c54d-5ef9-49bc-9bda-535043db6fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '793ea4b35e854d15ab205bfbbe496f17', 'request_id': 'req-bfa2c54d-5ef9-49bc-9bda-535043db6fd8'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:14.305514 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bfa2c54d-5ef9-49bc-9bda-535043db6fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '793ea4b35e854d15ab205bfbbe496f17', 'request_id': 'req-bfa2c54d-5ef9-49bc-9bda-535043db6fd8'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:14.317626 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bfa2c54d-5ef9-49bc-9bda-535043db6fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '793ea4b35e854d15ab205bfbbe496f17', 'request_id': 'req-bfa2c54d-5ef9-49bc-9bda-535043db6fd8'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:14.332168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bfa2c54d-5ef9-49bc-9bda-535043db6fd8 admin admin] The token cache is being invalidate because project 793ea4b35e854d15ab205bfbbe496f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:47:14.332741 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bfa2c54d-5ef9-49bc-9bda-535043db6fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:14.333899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bfa2c54d-5ef9-49bc-9bda-535043db6fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:14.336290 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1289/2538] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:47:14 2022] DELETE /identity/v3/projects/793ea4b35e854d15ab205bfbbe496f17 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:47:19.066354 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbae19-7ee8-46b4-bf3f-faf05852dd3e service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:19.067878 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b2fbae19-7ee8-46b4-bf3f-faf05852dd3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:19.080886 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbae19-7ee8-46b4-bf3f-faf05852dd3e service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:19.092384 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:19.140144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89096f29-7c05-4bac-bf91-8478fe1d79ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:19.140868 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89096f29-7c05-4bac-bf91-8478fe1d79ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:19.141207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89096f29-7c05-4bac-bf91-8478fe1d79ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:19.141610 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89096f29-7c05-4bac-bf91-8478fe1d79ce admin admin] PATH_INFO: `/v3/users/92cc414a1eae400d9157f56dd27bcd2c` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:19.143156 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89096f29-7c05-4bac-bf91-8478fe1d79ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=92cc414a1eae400d9157f56dd27bcd2c)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:19.145403 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89096f29-7c05-4bac-bf91-8478fe1d79ce admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:19.192635 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-89096f29-7c05-4bac-bf91-8478fe1d79ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92cc414a1eae400d9157f56dd27bcd2c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:19.200109 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-89096f29-7c05-4bac-bf91-8478fe1d79ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92cc414a1eae400d9157f56dd27bcd2c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:19.200897 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-89096f29-7c05-4bac-bf91-8478fe1d79ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92cc414a1eae400d9157f56dd27bcd2c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:19.201602 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-89096f29-7c05-4bac-bf91-8478fe1d79ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92cc414a1eae400d9157f56dd27bcd2c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:19.208461 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-89096f29-7c05-4bac-bf91-8478fe1d79ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92cc414a1eae400d9157f56dd27bcd2c'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:19.225510 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1250/2539] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:47:19 2022] DELETE /identity/v3/users/92cc414a1eae400d9157f56dd27bcd2c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:47:19.230070 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c452adb-f998-4a98-b257-038d7306a60c None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:19.230573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c452adb-f998-4a98-b257-038d7306a60c None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:19.230684 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c452adb-f998-4a98-b257-038d7306a60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:19.250164 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-4c452adb-f998-4a98-b257-038d7306a60c None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:19.251371 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4c452adb-f998-4a98-b257-038d7306a60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:19.309335 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1290/2540] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:47:19.319632 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89096f29-7c05-4bac-bf91-8478fe1d79ce admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:19.321168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-89096f29-7c05-4bac-bf91-8478fe1d79ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:19.377709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89096f29-7c05-4bac-bf91-8478fe1d79ce admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:19.381256 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603b9c2-de64-40f1-872c-4bfd2f8477fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:19.381843 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603b9c2-de64-40f1-872c-4bfd2f8477fd service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:19.382119 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603b9c2-de64-40f1-872c-4bfd2f8477fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:19.382385 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603b9c2-de64-40f1-872c-4bfd2f8477fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:19.391618 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603b9c2-de64-40f1-872c-4bfd2f8477fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:19.393042 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603b9c2-de64-40f1-872c-4bfd2f8477fd service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:19.402358 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1251/2541] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:47:19.705761 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c452adb-f998-4a98-b257-038d7306a60c None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:19.707616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4c452adb-f998-4a98-b257-038d7306a60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:19.722427 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c452adb-f998-4a98-b257-038d7306a60c None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:19.728117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de38052-814b-4601-bd6c-bc2e0d021bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:19.728791 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de38052-814b-4601-bd6c-bc2e0d021bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:19.729048 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de38052-814b-4601-bd6c-bc2e0d021bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:19.729384 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de38052-814b-4601-bd6c-bc2e0d021bff admin admin] PATH_INFO: `/v3/projects/9c2e8b040a69474992c03172983db76c` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:19.730638 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de38052-814b-4601-bd6c-bc2e0d021bff admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c2e8b040a69474992c03172983db76c)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:19.732698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de38052-814b-4601-bd6c-bc2e0d021bff admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:19.737626 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef801d-ab86-41b5-97a3-6455ead564c3 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:19.738004 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef801d-ab86-41b5-97a3-6455ead564c3 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:19.738282 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef801d-ab86-41b5-97a3-6455ead564c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:19.760073 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d0ef801d-ab86-41b5-97a3-6455ead564c3 None None] MFA Rules not processed for user `ed49a596f15542a29ce331bae4640274`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:19.761329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d0ef801d-ab86-41b5-97a3-6455ead564c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:19.788109 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4de38052-814b-4601-bd6c-bc2e0d021bff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c2e8b040a69474992c03172983db76c', 'request_id': 'req-4de38052-814b-4601-bd6c-bc2e0d021bff'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:19.796210 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4de38052-814b-4601-bd6c-bc2e0d021bff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c2e8b040a69474992c03172983db76c', 'request_id': 'req-4de38052-814b-4601-bd6c-bc2e0d021bff'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:19.802062 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:19.809459 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4de38052-814b-4601-bd6c-bc2e0d021bff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c2e8b040a69474992c03172983db76c', 'request_id': 'req-4de38052-814b-4601-bd6c-bc2e0d021bff'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:19.810716 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:19.823973 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4de38052-814b-4601-bd6c-bc2e0d021bff admin admin] The token cache is being invalidate because project 9c2e8b040a69474992c03172983db76c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:47:19.824502 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4de38052-814b-4601-bd6c-bc2e0d021bff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:19.825225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-4de38052-814b-4601-bd6c-bc2e0d021bff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:19.826768 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1291/2542] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:47:19 2022] DELETE /identity/v3/projects/9c2e8b040a69474992c03172983db76c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:47:19.829515 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1252/2543] 10.222.0.52 () {58 vars in 967 bytes} [Thu Sep 15 00:47:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:47:19.843956 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de38052-814b-4601-bd6c-bc2e0d021bff admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:19.846202 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-4de38052-814b-4601-bd6c-bc2e0d021bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:19.923495 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de38052-814b-4601-bd6c-bc2e0d021bff admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:19.928717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca58ac5-e08b-42fd-88de-ceefee79ae47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb248b85aba45b39132d0f92ede0b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:19.929404 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca58ac5-e08b-42fd-88de-ceefee79ae47 service swift] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:19.929680 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca58ac5-e08b-42fd-88de-ceefee79ae47 service swift] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:19.929951 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca58ac5-e08b-42fd-88de-ceefee79ae47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:19.994331 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca58ac5-e08b-42fd-88de-ceefee79ae47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:19.995924 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca58ac5-e08b-42fd-88de-ceefee79ae47 service swift] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:20.005392 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1292/2544] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 15 00:47:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 00:47:29.698124 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe578ca-5056-4a21-964e-0de976029691 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:29.698627 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe578ca-5056-4a21-964e-0de976029691 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:29.698748 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe578ca-5056-4a21-964e-0de976029691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:29.718598 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9fe578ca-5056-4a21-964e-0de976029691 None None] MFA Rules not processed for user `ed49a596f15542a29ce331bae4640274`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:29.719799 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9fe578ca-5056-4a21-964e-0de976029691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:29.727703 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1253/2545] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 15 00:47:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:47:29.739631 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca58ac5-e08b-42fd-88de-ceefee79ae47 service swift] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:29.750201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca58ac5-e08b-42fd-88de-ceefee79ae47 service swift] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:29.755307 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b48596-1fe5-464a-881b-2c101ed2633e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb248b85aba45b39132d0f92ede0b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:29.755906 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b48596-1fe5-464a-881b-2c101ed2633e service swift] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:29.756186 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b48596-1fe5-464a-881b-2c101ed2633e service swift] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:29.756455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b48596-1fe5-464a-881b-2c101ed2633e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:29.765431 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b48596-1fe5-464a-881b-2c101ed2633e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:29.766999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b48596-1fe5-464a-881b-2c101ed2633e service swift] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:29.775986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1293/2546] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 15 00:47:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 00:47:39.713444 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=11 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:39.773005 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=63 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:46.372140 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c503e0c-4a1d-409d-bf98-e525df12f9ed None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:46.372614 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c503e0c-4a1d-409d-bf98-e525df12f9ed None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:46.372712 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c503e0c-4a1d-409d-bf98-e525df12f9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:46.392365 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-9c503e0c-4a1d-409d-bf98-e525df12f9ed None None] MFA Rules not processed for user `ed49a596f15542a29ce331bae4640274`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:46.393577 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9c503e0c-4a1d-409d-bf98-e525df12f9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:46.400626 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1254/2547] 10.222.0.52 () {58 vars in 967 bytes} [Thu Sep 15 00:47:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:47:46.413970 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b48596-1fe5-464a-881b-2c101ed2633e service swift] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:46.424964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b48596-1fe5-464a-881b-2c101ed2633e service swift] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:46.429970 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e45181-b503-4ce7-8c68-c73769f5ecb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb248b85aba45b39132d0f92ede0b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:46.430567 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e45181-b503-4ce7-8c68-c73769f5ecb2 service swift] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:46.430846 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e45181-b503-4ce7-8c68-c73769f5ecb2 service swift] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:46.431114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e45181-b503-4ce7-8c68-c73769f5ecb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:46.439402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e45181-b503-4ce7-8c68-c73769f5ecb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:46.441104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e45181-b503-4ce7-8c68-c73769f5ecb2 service swift] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:46.449550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1294/2548] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 15 00:47:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 00:47:48.504689 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c503e0c-4a1d-409d-bf98-e525df12f9ed None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:48.506754 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9c503e0c-4a1d-409d-bf98-e525df12f9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:48.585430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c503e0c-4a1d-409d-bf98-e525df12f9ed None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:48.590038 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df8ec8-3db0-48b6-b125-75ff3c1466c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:48.590689 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df8ec8-3db0-48b6-b125-75ff3c1466c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:48.591076 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df8ec8-3db0-48b6-b125-75ff3c1466c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:48.591353 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df8ec8-3db0-48b6-b125-75ff3c1466c6 admin admin] PATH_INFO: `/v3/users/1b397d9d45b3441eba444571ff8a185b` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:48.592739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df8ec8-3db0-48b6-b125-75ff3c1466c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b397d9d45b3441eba444571ff8a185b)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:48.594710 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df8ec8-3db0-48b6-b125-75ff3c1466c6 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:48.643030 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-74df8ec8-3db0-48b6-b125-75ff3c1466c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b397d9d45b3441eba444571ff8a185b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:48.654293 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-74df8ec8-3db0-48b6-b125-75ff3c1466c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b397d9d45b3441eba444571ff8a185b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:48.654946 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-74df8ec8-3db0-48b6-b125-75ff3c1466c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b397d9d45b3441eba444571ff8a185b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:48.655549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-74df8ec8-3db0-48b6-b125-75ff3c1466c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b397d9d45b3441eba444571ff8a185b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:48.663384 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-74df8ec8-3db0-48b6-b125-75ff3c1466c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b397d9d45b3441eba444571ff8a185b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:48.680795 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1255/2549] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:47:48 2022] DELETE /identity/v3/users/1b397d9d45b3441eba444571ff8a185b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:47:48.858172 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e45181-b503-4ce7-8c68-c73769f5ecb2 service swift] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:48.874046 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e45181-b503-4ce7-8c68-c73769f5ecb2 service swift] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:48.937464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab981ec-cf80-458c-a55a-2b27f6af8496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:48.938093 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab981ec-cf80-458c-a55a-2b27f6af8496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:48.938375 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab981ec-cf80-458c-a55a-2b27f6af8496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:48.938652 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab981ec-cf80-458c-a55a-2b27f6af8496 admin admin] PATH_INFO: `/v3/projects/1127e397662046898895d2e14d6c02e6` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:48.940299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab981ec-cf80-458c-a55a-2b27f6af8496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1127e397662046898895d2e14d6c02e6)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:48.942234 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab981ec-cf80-458c-a55a-2b27f6af8496 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:48.987612 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fab981ec-cf80-458c-a55a-2b27f6af8496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1127e397662046898895d2e14d6c02e6', 'request_id': 'req-fab981ec-cf80-458c-a55a-2b27f6af8496'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:48.992908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fab981ec-cf80-458c-a55a-2b27f6af8496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1127e397662046898895d2e14d6c02e6', 'request_id': 'req-fab981ec-cf80-458c-a55a-2b27f6af8496'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:49.000071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fab981ec-cf80-458c-a55a-2b27f6af8496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1127e397662046898895d2e14d6c02e6', 'request_id': 'req-fab981ec-cf80-458c-a55a-2b27f6af8496'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:49.011242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fab981ec-cf80-458c-a55a-2b27f6af8496 admin admin] The token cache is being invalidate because project 1127e397662046898895d2e14d6c02e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:47:49.011537 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fab981ec-cf80-458c-a55a-2b27f6af8496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:49.012146 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-fab981ec-cf80-458c-a55a-2b27f6af8496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:47:49.013629 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1295/2550] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:47:48 2022] DELETE /identity/v3/projects/1127e397662046898895d2e14d6c02e6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:47:49.020001 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bd26e-4a8e-447e-a006-2b6396b8a817 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:49.020308 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bd26e-4a8e-447e-a006-2b6396b8a817 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:49.020612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bd26e-4a8e-447e-a006-2b6396b8a817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:49.039684 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3e8bd26e-4a8e-447e-a006-2b6396b8a817 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:49.040887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3e8bd26e-4a8e-447e-a006-2b6396b8a817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:49.099120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1256/2551] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:47:49.106586 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead9243-d453-4040-93f9-187ad69af091 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:49.106892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead9243-d453-4040-93f9-187ad69af091 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:49.107161 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead9243-d453-4040-93f9-187ad69af091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:49.127645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-9ead9243-d453-4040-93f9-187ad69af091 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:49.128822 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9ead9243-d453-4040-93f9-187ad69af091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:49.136816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1296/2552] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:47:49.141161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bd26e-4a8e-447e-a006-2b6396b8a817 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:49.152230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bd26e-4a8e-447e-a006-2b6396b8a817 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:49.156914 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1442c95-3a8c-459f-9a0d-8f16c9196201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:49.157564 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1442c95-3a8c-459f-9a0d-8f16c9196201 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:49.157845 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1442c95-3a8c-459f-9a0d-8f16c9196201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:49.158117 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1442c95-3a8c-459f-9a0d-8f16c9196201 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:49.158768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1442c95-3a8c-459f-9a0d-8f16c9196201 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:47:49.159069 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1442c95-3a8c-459f-9a0d-8f16c9196201 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:49.160674 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1442c95-3a8c-459f-9a0d-8f16c9196201 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:49.169686 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:49.177320 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1257/2553] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:47:49.178713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead9243-d453-4040-93f9-187ad69af091 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:49.188124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead9243-d453-4040-93f9-187ad69af091 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:49.193462 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03716fa6-784a-4f71-a74b-a879d0700531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:49.194071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03716fa6-784a-4f71-a74b-a879d0700531 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:49.194353 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03716fa6-784a-4f71-a74b-a879d0700531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:49.194626 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03716fa6-784a-4f71-a74b-a879d0700531 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:49.195260 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03716fa6-784a-4f71-a74b-a879d0700531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:49.197237 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03716fa6-784a-4f71-a74b-a879d0700531 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:49.224957 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1297/2554] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:47:49 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:47:49.229181 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1442c95-3a8c-459f-9a0d-8f16c9196201 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:49.239968 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1442c95-3a8c-459f-9a0d-8f16c9196201 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:49.305367 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0eb918-950f-4c53-a354-d3447e084413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:49.305987 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0eb918-950f-4c53-a354-d3447e084413 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:49.306273 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0eb918-950f-4c53-a354-d3447e084413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:49.306552 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0eb918-950f-4c53-a354-d3447e084413 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:49.307349 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0eb918-950f-4c53-a354-d3447e084413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:49.309332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0eb918-950f-4c53-a354-d3447e084413 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:49.330802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1258/2555] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:47:49 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:47:49.334893 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03716fa6-784a-4f71-a74b-a879d0700531 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:49.345750 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03716fa6-784a-4f71-a74b-a879d0700531 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:49.350436 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35d138-ba55-403b-a8d9-2748e8a95a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:49.350987 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35d138-ba55-403b-a8d9-2748e8a95a04 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:49.351254 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35d138-ba55-403b-a8d9-2748e8a95a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:49.351529 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35d138-ba55-403b-a8d9-2748e8a95a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:49.352172 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35d138-ba55-403b-a8d9-2748e8a95a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:49.353795 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35d138-ba55-403b-a8d9-2748e8a95a04 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:49.364081 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1298/2556] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 00:47:49.367909 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0eb918-950f-4c53-a354-d3447e084413 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:49.378408 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0eb918-950f-4c53-a354-d3447e084413 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:49.383004 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f2305-9796-46a4-a815-59bc0011e302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:49.383591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f2305-9796-46a4-a815-59bc0011e302 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:49.383875 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f2305-9796-46a4-a815-59bc0011e302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:49.384150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f2305-9796-46a4-a815-59bc0011e302 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:49.384827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f2305-9796-46a4-a815-59bc0011e302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:49.386549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f2305-9796-46a4-a815-59bc0011e302 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:49.396982 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1259/2557] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:47:49.401034 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35d138-ba55-403b-a8d9-2748e8a95a04 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:49.411600 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35d138-ba55-403b-a8d9-2748e8a95a04 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:49.416246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1963127-ad59-4f9b-94a4-e7ec3ed079c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:49.416886 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1963127-ad59-4f9b-94a4-e7ec3ed079c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:49.417198 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1963127-ad59-4f9b-94a4-e7ec3ed079c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:49.417474 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1963127-ad59-4f9b-94a4-e7ec3ed079c9 admin admin] PATH_INFO: `/v3/projects/de324a0e58ee4b3188ddcb225583edad/users/3d956590832e4873bd967b9c9deda38e/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:49.432429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1963127-ad59-4f9b-94a4-e7ec3ed079c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de324a0e58ee4b3188ddcb225583edad, user_id=3d956590832e4873bd967b9c9deda38e, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:49.435101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1963127-ad59-4f9b-94a4-e7ec3ed079c9 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:49.454119 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1299/2558] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:47:49 2022] PUT /identity/v3/projects/de324a0e58ee4b3188ddcb225583edad/users/3d956590832e4873bd967b9c9deda38e/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:47:49.514662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3f31f-e068-46e7-bd1f-06d2ebb6f371 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:49.515197 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3f31f-e068-46e7-bd1f-06d2ebb6f371 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:49.515197 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3f31f-e068-46e7-bd1f-06d2ebb6f371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:49.542827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e4c3f31f-e068-46e7-bd1f-06d2ebb6f371 None None] MFA Rules not processed for user `3d956590832e4873bd967b9c9deda38e`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:49.544038 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e4c3f31f-e068-46e7-bd1f-06d2ebb6f371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:49.609118 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1260/2559] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:47:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:47:49.622493 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1963127-ad59-4f9b-94a4-e7ec3ed079c9 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:49.627142 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e1963127-ad59-4f9b-94a4-e7ec3ed079c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:49.641630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:47:49.685290 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1963127-ad59-4f9b-94a4-e7ec3ed079c9 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:49.689187 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797b384-2855-4e6b-8005-4d12e5338646 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12ce70a7c4f4396ab3fbb635dfc548b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:49.689765 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797b384-2855-4e6b-8005-4d12e5338646 service glance] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:49.690040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797b384-2855-4e6b-8005-4d12e5338646 service glance] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:49.690308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797b384-2855-4e6b-8005-4d12e5338646 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:49.698737 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797b384-2855-4e6b-8005-4d12e5338646 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:49.700154 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797b384-2855-4e6b-8005-4d12e5338646 service glance] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:49.708936 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1300/2560] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:47:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:47:54.501511 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec420ef-6aaa-4eea-961e-50b0586b7dd1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:54.501977 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec420ef-6aaa-4eea-961e-50b0586b7dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:54.502072 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec420ef-6aaa-4eea-961e-50b0586b7dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:54.521498 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-aec420ef-6aaa-4eea-961e-50b0586b7dd1 None None] MFA Rules not processed for user `8361506717694758bd7759273ff892d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:47:54.522709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-aec420ef-6aaa-4eea-961e-50b0586b7dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:54.576502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1261/2561] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:47:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:47:55.711512 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797b384-2855-4e6b-8005-4d12e5338646 service glance] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:47:55.712937 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a797b384-2855-4e6b-8005-4d12e5338646 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:55.783968 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797b384-2855-4e6b-8005-4d12e5338646 service glance] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:47:55.788984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0f1b4-555e-4517-a309-5af2af424fed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed987b44d934ac7b2dc64c0aab28099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:47:55.789621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0f1b4-555e-4517-a309-5af2af424fed service placement] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:47:55.789916 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0f1b4-555e-4517-a309-5af2af424fed service placement] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:47:55.790175 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0f1b4-555e-4517-a309-5af2af424fed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:47:55.791896 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cac0f1b4-555e-4517-a309-5af2af424fed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:47:55.803712 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0f1b4-555e-4517-a309-5af2af424fed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:47:55.805308 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0f1b4-555e-4517-a309-5af2af424fed service placement] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:47:55.816530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1301/2562] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:47:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:48:04.570369 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:48:05.810978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=52 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:48:13.538707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec420ef-6aaa-4eea-961e-50b0586b7dd1 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:13.602859 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec420ef-6aaa-4eea-961e-50b0586b7dd1 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:13.604637 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61ef72-2766-4be8-b29e-729369df7b21 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:13.605148 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61ef72-2766-4be8-b29e-729369df7b21 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:13.605430 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61ef72-2766-4be8-b29e-729369df7b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:13.607777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cceeb0-baff-444a-aa26-7ebc93434237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:13.608468 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cceeb0-baff-444a-aa26-7ebc93434237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:13.608814 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cceeb0-baff-444a-aa26-7ebc93434237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:13.609119 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cceeb0-baff-444a-aa26-7ebc93434237 admin admin] PATH_INFO: `/v3/users/3d956590832e4873bd967b9c9deda38e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:13.611103 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cceeb0-baff-444a-aa26-7ebc93434237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d956590832e4873bd967b9c9deda38e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:13.613272 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cceeb0-baff-444a-aa26-7ebc93434237 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:13.624781 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8e61ef72-2766-4be8-b29e-729369df7b21 None None] MFA Rules not processed for user `888bda8e3665469cafd6739ae3423bab`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:48:13.626150 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8e61ef72-2766-4be8-b29e-729369df7b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:48:13.661434 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-88cceeb0-baff-444a-aa26-7ebc93434237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d956590832e4873bd967b9c9deda38e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:13.668877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-88cceeb0-baff-444a-aa26-7ebc93434237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d956590832e4873bd967b9c9deda38e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:13.669599 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-88cceeb0-baff-444a-aa26-7ebc93434237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d956590832e4873bd967b9c9deda38e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:13.670451 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-88cceeb0-baff-444a-aa26-7ebc93434237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d956590832e4873bd967b9c9deda38e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:13.678128 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-88cceeb0-baff-444a-aa26-7ebc93434237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d956590832e4873bd967b9c9deda38e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:13.684253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1302/2563] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:48:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:48:13.696024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1262/2564] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:48:13 2022] DELETE /identity/v3/users/3d956590832e4873bd967b9c9deda38e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:48:13.700352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e4976-fdb2-452a-87a1-da134a5715b0 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:13.700619 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e4976-fdb2-452a-87a1-da134a5715b0 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:13.700891 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e4976-fdb2-452a-87a1-da134a5715b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:13.721160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-247e4976-fdb2-452a-87a1-da134a5715b0 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:48:13.722411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-247e4976-fdb2-452a-87a1-da134a5715b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:48:13.783608 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1303/2565] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:48:13.793447 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cceeb0-baff-444a-aa26-7ebc93434237 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:13.795033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-88cceeb0-baff-444a-aa26-7ebc93434237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:48:13.854756 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cceeb0-baff-444a-aa26-7ebc93434237 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:13.858310 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976bac1-a797-42bf-b052-fb80fe9f8665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:13.858946 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976bac1-a797-42bf-b052-fb80fe9f8665 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:13.859224 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976bac1-a797-42bf-b052-fb80fe9f8665 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:13.859495 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976bac1-a797-42bf-b052-fb80fe9f8665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:13.868557 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976bac1-a797-42bf-b052-fb80fe9f8665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:13.870027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976bac1-a797-42bf-b052-fb80fe9f8665 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:13.879477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1263/2566] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:48:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:48:14.158909 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e4976-fdb2-452a-87a1-da134a5715b0 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:14.160345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-247e4976-fdb2-452a-87a1-da134a5715b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:48:14.174666 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e4976-fdb2-452a-87a1-da134a5715b0 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:14.184158 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36c74c-c057-466e-8feb-17abfb1804ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:14.184764 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36c74c-c057-466e-8feb-17abfb1804ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:14.185382 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36c74c-c057-466e-8feb-17abfb1804ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:14.185382 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36c74c-c057-466e-8feb-17abfb1804ce admin admin] PATH_INFO: `/v3/projects/de324a0e58ee4b3188ddcb225583edad` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:14.186473 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36c74c-c057-466e-8feb-17abfb1804ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=de324a0e58ee4b3188ddcb225583edad)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:14.188881 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36c74c-c057-466e-8feb-17abfb1804ce admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:14.238322 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3f36c74c-c057-466e-8feb-17abfb1804ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de324a0e58ee4b3188ddcb225583edad', 'request_id': 'req-3f36c74c-c057-466e-8feb-17abfb1804ce'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:14.244141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3f36c74c-c057-466e-8feb-17abfb1804ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de324a0e58ee4b3188ddcb225583edad', 'request_id': 'req-3f36c74c-c057-466e-8feb-17abfb1804ce'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:14.251399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3f36c74c-c057-466e-8feb-17abfb1804ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de324a0e58ee4b3188ddcb225583edad', 'request_id': 'req-3f36c74c-c057-466e-8feb-17abfb1804ce'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:14.263025 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3f36c74c-c057-466e-8feb-17abfb1804ce admin admin] The token cache is being invalidate because project de324a0e58ee4b3188ddcb225583edad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:48:14.263317 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3f36c74c-c057-466e-8feb-17abfb1804ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:14.263952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-3f36c74c-c057-466e-8feb-17abfb1804ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:14.265640 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1304/2567] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:48:14 2022] DELETE /identity/v3/projects/de324a0e58ee4b3188ddcb225583edad => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:48:14.271157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264524e3-dcd9-43cb-a01e-05b27758d92e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:14.271468 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264524e3-dcd9-43cb-a01e-05b27758d92e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:14.271747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264524e3-dcd9-43cb-a01e-05b27758d92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:14.299019 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-264524e3-dcd9-43cb-a01e-05b27758d92e None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:48:14.299019 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-264524e3-dcd9-43cb-a01e-05b27758d92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:48:14.318767 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:48:14.375126 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1264/2568] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:48:14.383058 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df675d-31ab-4709-bb77-6317631ea34f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:14.383338 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df675d-31ab-4709-bb77-6317631ea34f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:14.383608 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df675d-31ab-4709-bb77-6317631ea34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:14.403738 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-46df675d-31ab-4709-bb77-6317631ea34f None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:48:14.404929 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-46df675d-31ab-4709-bb77-6317631ea34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:48:14.413444 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1305/2569] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:48:14.417957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264524e3-dcd9-43cb-a01e-05b27758d92e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:14.432119 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264524e3-dcd9-43cb-a01e-05b27758d92e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:14.436965 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db265a-08b8-4527-abb2-b156e0649be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:14.437599 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db265a-08b8-4527-abb2-b156e0649be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:14.437882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db265a-08b8-4527-abb2-b156e0649be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:14.438183 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db265a-08b8-4527-abb2-b156e0649be8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:14.438841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db265a-08b8-4527-abb2-b156e0649be8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:48:14.439147 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db265a-08b8-4527-abb2-b156e0649be8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:14.440852 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db265a-08b8-4527-abb2-b156e0649be8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:14.457736 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1265/2570] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 00:48:14.459147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df675d-31ab-4709-bb77-6317631ea34f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:14.479890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df675d-31ab-4709-bb77-6317631ea34f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:14.485717 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657afb7-6b85-4999-bffc-a0b0650ef634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:14.486388 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657afb7-6b85-4999-bffc-a0b0650ef634 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:14.486763 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657afb7-6b85-4999-bffc-a0b0650ef634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:14.487097 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657afb7-6b85-4999-bffc-a0b0650ef634 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:14.487794 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657afb7-6b85-4999-bffc-a0b0650ef634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:14.489864 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657afb7-6b85-4999-bffc-a0b0650ef634 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:14.512166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:48:14.524667 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1306/2571] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:48:14 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:48:14.526060 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db265a-08b8-4527-abb2-b156e0649be8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:14.536668 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db265a-08b8-4527-abb2-b156e0649be8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:14.600830 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ece5aa-0048-4144-b7fa-040f54cd7a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:14.601560 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ece5aa-0048-4144-b7fa-040f54cd7a71 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:14.601763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ece5aa-0048-4144-b7fa-040f54cd7a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:14.602033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ece5aa-0048-4144-b7fa-040f54cd7a71 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:14.602793 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ece5aa-0048-4144-b7fa-040f54cd7a71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:14.604923 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ece5aa-0048-4144-b7fa-040f54cd7a71 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:14.629545 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1266/2572] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:48:14 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:48:14.630845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657afb7-6b85-4999-bffc-a0b0650ef634 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:14.642226 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657afb7-6b85-4999-bffc-a0b0650ef634 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:14.646993 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c1834-0c35-4f14-9792-43ed61ab8c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:14.647478 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c1834-0c35-4f14-9792-43ed61ab8c31 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:14.647760 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c1834-0c35-4f14-9792-43ed61ab8c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:14.648031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c1834-0c35-4f14-9792-43ed61ab8c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:14.648680 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c1834-0c35-4f14-9792-43ed61ab8c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:14.650299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c1834-0c35-4f14-9792-43ed61ab8c31 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:14.660782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1307/2573] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:48:14.665010 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ece5aa-0048-4144-b7fa-040f54cd7a71 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:14.674955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ece5aa-0048-4144-b7fa-040f54cd7a71 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:14.679721 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c92dfa-13d8-4c7f-9229-1c30010dacc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:14.680359 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c92dfa-13d8-4c7f-9229-1c30010dacc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:14.680618 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c92dfa-13d8-4c7f-9229-1c30010dacc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:14.680892 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c92dfa-13d8-4c7f-9229-1c30010dacc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:14.681634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c92dfa-13d8-4c7f-9229-1c30010dacc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:14.683237 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c92dfa-13d8-4c7f-9229-1c30010dacc9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:14.693948 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1267/2574] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 00:48:14.698070 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c1834-0c35-4f14-9792-43ed61ab8c31 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:14.708680 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c1834-0c35-4f14-9792-43ed61ab8c31 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:14.713734 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a12f34-62d1-427d-889b-02e0fe337bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:14.714380 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a12f34-62d1-427d-889b-02e0fe337bde admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:14.714656 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a12f34-62d1-427d-889b-02e0fe337bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:14.714925 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a12f34-62d1-427d-889b-02e0fe337bde admin admin] PATH_INFO: `/v3/projects/50a3467e9a50404491b9abfde2a30c88/users/ece66d4bf29245019f292bd1860ed439/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:14.730211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a12f34-62d1-427d-889b-02e0fe337bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a3467e9a50404491b9abfde2a30c88, user_id=ece66d4bf29245019f292bd1860ed439, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:14.732847 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a12f34-62d1-427d-889b-02e0fe337bde admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:14.745259 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1308/2575] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:48:14 2022] PUT /identity/v3/projects/50a3467e9a50404491b9abfde2a30c88/users/ece66d4bf29245019f292bd1860ed439/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:48:14.756775 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84dca36-e616-486f-b0be-267b519469d1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:14.757182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84dca36-e616-486f-b0be-267b519469d1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:14.757583 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84dca36-e616-486f-b0be-267b519469d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:14.785884 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b84dca36-e616-486f-b0be-267b519469d1 None None] MFA Rules not processed for user `ece66d4bf29245019f292bd1860ed439`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:48:14.787112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b84dca36-e616-486f-b0be-267b519469d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:48:14.851885 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1268/2576] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:48:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:48:14.863280 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a12f34-62d1-427d-889b-02e0fe337bde admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:14.864973 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c7a12f34-62d1-427d-889b-02e0fe337bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:48:14.921555 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a12f34-62d1-427d-889b-02e0fe337bde admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:14.925223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4496ca-b393-4c23-9731-402b0cd66197 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:14.925834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4496ca-b393-4c23-9731-402b0cd66197 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:14.926116 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4496ca-b393-4c23-9731-402b0cd66197 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:14.926386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4496ca-b393-4c23-9731-402b0cd66197 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:14.935619 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4496ca-b393-4c23-9731-402b0cd66197 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:14.937029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4496ca-b393-4c23-9731-402b0cd66197 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:14.946551 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1309/2577] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:48:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:48:14.973489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84dca36-e616-486f-b0be-267b519469d1 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:14.994349 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:48:15.052044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84dca36-e616-486f-b0be-267b519469d1 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:15.052044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8a562-69e1-40bc-a391-ad88f57823a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:15.052044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8a562-69e1-40bc-a391-ad88f57823a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:15.052044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8a562-69e1-40bc-a391-ad88f57823a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:15.052564 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8a562-69e1-40bc-a391-ad88f57823a4 admin admin] PATH_INFO: `/v3/users/ece66d4bf29245019f292bd1860ed439` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:15.053461 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8a562-69e1-40bc-a391-ad88f57823a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ece66d4bf29245019f292bd1860ed439)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:15.055588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8a562-69e1-40bc-a391-ad88f57823a4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:15.103550 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2ab8a562-69e1-40bc-a391-ad88f57823a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ece66d4bf29245019f292bd1860ed439'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:15.112345 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2ab8a562-69e1-40bc-a391-ad88f57823a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ece66d4bf29245019f292bd1860ed439'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:15.112844 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2ab8a562-69e1-40bc-a391-ad88f57823a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ece66d4bf29245019f292bd1860ed439'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:15.113604 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2ab8a562-69e1-40bc-a391-ad88f57823a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ece66d4bf29245019f292bd1860ed439'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:15.121056 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-2ab8a562-69e1-40bc-a391-ad88f57823a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ece66d4bf29245019f292bd1860ed439'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:15.139565 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1269/2578] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:48:14 2022] DELETE /identity/v3/users/ece66d4bf29245019f292bd1860ed439 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:48:15.144655 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395eaf5f-1431-4ee7-a5c6-4062e6f45cb1 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:15.144948 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395eaf5f-1431-4ee7-a5c6-4062e6f45cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:15.145503 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395eaf5f-1431-4ee7-a5c6-4062e6f45cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:15.164874 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-395eaf5f-1431-4ee7-a5c6-4062e6f45cb1 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:48:15.166218 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-395eaf5f-1431-4ee7-a5c6-4062e6f45cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:48:15.225549 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1310/2579] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:48:15.235805 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8a562-69e1-40bc-a391-ad88f57823a4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:15.237255 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2ab8a562-69e1-40bc-a391-ad88f57823a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:48:15.293149 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8a562-69e1-40bc-a391-ad88f57823a4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:15.296704 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8e8b8-c448-42ad-8ebc-73cc3becbf38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:15.297351 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8e8b8-c448-42ad-8ebc-73cc3becbf38 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:15.297628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8e8b8-c448-42ad-8ebc-73cc3becbf38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:15.297902 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8e8b8-c448-42ad-8ebc-73cc3becbf38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:15.306672 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8e8b8-c448-42ad-8ebc-73cc3becbf38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:15.308104 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8e8b8-c448-42ad-8ebc-73cc3becbf38 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:15.317437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1270/2580] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:48:15.598238 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395eaf5f-1431-4ee7-a5c6-4062e6f45cb1 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:15.598238 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-395eaf5f-1431-4ee7-a5c6-4062e6f45cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:48:15.611368 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395eaf5f-1431-4ee7-a5c6-4062e6f45cb1 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:15.617510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282246a1-3540-48bc-ba80-f3b6c7de7c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:15.618323 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282246a1-3540-48bc-ba80-f3b6c7de7c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:15.618688 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282246a1-3540-48bc-ba80-f3b6c7de7c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:15.619032 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282246a1-3540-48bc-ba80-f3b6c7de7c01 admin admin] PATH_INFO: `/v3/projects/50a3467e9a50404491b9abfde2a30c88` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:15.620594 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282246a1-3540-48bc-ba80-f3b6c7de7c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50a3467e9a50404491b9abfde2a30c88)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:15.622667 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282246a1-3540-48bc-ba80-f3b6c7de7c01 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:15.676103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-282246a1-3540-48bc-ba80-f3b6c7de7c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50a3467e9a50404491b9abfde2a30c88', 'request_id': 'req-282246a1-3540-48bc-ba80-f3b6c7de7c01'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:15.690786 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-282246a1-3540-48bc-ba80-f3b6c7de7c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50a3467e9a50404491b9abfde2a30c88', 'request_id': 'req-282246a1-3540-48bc-ba80-f3b6c7de7c01'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:15.695253 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:48:15.701975 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-282246a1-3540-48bc-ba80-f3b6c7de7c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50a3467e9a50404491b9abfde2a30c88', 'request_id': 'req-282246a1-3540-48bc-ba80-f3b6c7de7c01'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:15.722133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-282246a1-3540-48bc-ba80-f3b6c7de7c01 admin admin] The token cache is being invalidate because project 50a3467e9a50404491b9abfde2a30c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:48:15.722428 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-282246a1-3540-48bc-ba80-f3b6c7de7c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:15.723124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-282246a1-3540-48bc-ba80-f3b6c7de7c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:15.737207 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1311/2581] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:48:15 2022] DELETE /identity/v3/projects/50a3467e9a50404491b9abfde2a30c88 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:48:25.313249 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:48:25.719046 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:48:48.616807 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48673ae-cea5-437e-98da-963d0738fa8f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:48.617292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48673ae-cea5-437e-98da-963d0738fa8f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:48.617393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48673ae-cea5-437e-98da-963d0738fa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:48.636259 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b48673ae-cea5-437e-98da-963d0738fa8f None None] MFA Rules not processed for user `ed49a596f15542a29ce331bae4640274`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:48:48.637486 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b48673ae-cea5-437e-98da-963d0738fa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:48:48.691955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1271/2582] 10.222.0.52 () {58 vars in 967 bytes} [Thu Sep 15 00:48:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:48:48.738387 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282246a1-3540-48bc-ba80-f3b6c7de7c01 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:48.739829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-282246a1-3540-48bc-ba80-f3b6c7de7c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:48:48.807835 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282246a1-3540-48bc-ba80-f3b6c7de7c01 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:48.813313 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ace92-af8a-4b45-b008-5ffceddcd624 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb248b85aba45b39132d0f92ede0b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:48.813919 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ace92-af8a-4b45-b008-5ffceddcd624 service swift] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:48.814202 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ace92-af8a-4b45-b008-5ffceddcd624 service swift] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:48.814478 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ace92-af8a-4b45-b008-5ffceddcd624 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:48.822473 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ace92-af8a-4b45-b008-5ffceddcd624 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:48.824052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ace92-af8a-4b45-b008-5ffceddcd624 service swift] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:48.832671 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1312/2583] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 15 00:48:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 00:48:55.554160 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48673ae-cea5-437e-98da-963d0738fa8f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:55.555786 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b48673ae-cea5-437e-98da-963d0738fa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:48:55.656420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48673ae-cea5-437e-98da-963d0738fa8f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:55.662184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcf678-f35f-4a5e-b0d3-756733ef77e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:55.662987 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcf678-f35f-4a5e-b0d3-756733ef77e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:55.663335 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcf678-f35f-4a5e-b0d3-756733ef77e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:55.663679 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcf678-f35f-4a5e-b0d3-756733ef77e7 admin admin] PATH_INFO: `/v3/users/14047d34c71345f49bcd4d4bf7bca89a` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:55.665537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fcf678-f35f-4a5e-b0d3-756733ef77e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14047d34c71345f49bcd4d4bf7bca89a)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:55.667836 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fcf678-f35f-4a5e-b0d3-756733ef77e7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:55.726240 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a7fcf678-f35f-4a5e-b0d3-756733ef77e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14047d34c71345f49bcd4d4bf7bca89a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:55.733861 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a7fcf678-f35f-4a5e-b0d3-756733ef77e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14047d34c71345f49bcd4d4bf7bca89a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:55.734549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a7fcf678-f35f-4a5e-b0d3-756733ef77e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14047d34c71345f49bcd4d4bf7bca89a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:55.735248 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a7fcf678-f35f-4a5e-b0d3-756733ef77e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14047d34c71345f49bcd4d4bf7bca89a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:55.742983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a7fcf678-f35f-4a5e-b0d3-756733ef77e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14047d34c71345f49bcd4d4bf7bca89a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:55.775056 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1272/2584] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:48:55 2022] DELETE /identity/v3/users/14047d34c71345f49bcd4d4bf7bca89a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:48:55.946916 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ace92-af8a-4b45-b008-5ffceddcd624 service swift] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:55.962816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ace92-af8a-4b45-b008-5ffceddcd624 service swift] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:56.024598 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb170be6-ee63-4102-8328-69ac827feacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:56.025177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb170be6-ee63-4102-8328-69ac827feacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:56.025463 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb170be6-ee63-4102-8328-69ac827feacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:56.025738 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb170be6-ee63-4102-8328-69ac827feacb admin admin] PATH_INFO: `/v3/projects/7da18274b60449aaa85d0705a641e32c` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:56.026863 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb170be6-ee63-4102-8328-69ac827feacb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7da18274b60449aaa85d0705a641e32c)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:56.028792 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb170be6-ee63-4102-8328-69ac827feacb admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:56.075619 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-cb170be6-ee63-4102-8328-69ac827feacb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7da18274b60449aaa85d0705a641e32c', 'request_id': 'req-cb170be6-ee63-4102-8328-69ac827feacb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:56.081201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-cb170be6-ee63-4102-8328-69ac827feacb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7da18274b60449aaa85d0705a641e32c', 'request_id': 'req-cb170be6-ee63-4102-8328-69ac827feacb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:56.088624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-cb170be6-ee63-4102-8328-69ac827feacb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7da18274b60449aaa85d0705a641e32c', 'request_id': 'req-cb170be6-ee63-4102-8328-69ac827feacb'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:56.100636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-cb170be6-ee63-4102-8328-69ac827feacb admin admin] The token cache is being invalidate because project 7da18274b60449aaa85d0705a641e32c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:48:56.100923 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-cb170be6-ee63-4102-8328-69ac827feacb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:56.101609 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-cb170be6-ee63-4102-8328-69ac827feacb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:56.103081 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1313/2585] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:48:55 2022] DELETE /identity/v3/projects/7da18274b60449aaa85d0705a641e32c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:48:56.107379 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcf678-f35f-4a5e-b0d3-756733ef77e7 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:56.108860 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a7fcf678-f35f-4a5e-b0d3-756733ef77e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:48:56.122327 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcf678-f35f-4a5e-b0d3-756733ef77e7 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:56.142854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:48:56.181756 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc74e3-b1da-494f-b56a-38c8db129dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:56.182315 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc74e3-b1da-494f-b56a-38c8db129dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:56.182590 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc74e3-b1da-494f-b56a-38c8db129dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:56.182861 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc74e3-b1da-494f-b56a-38c8db129dc9 admin admin] PATH_INFO: `/v3/users/febd0a0016fc46888437ac2f5002e879` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:56.183973 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc74e3-b1da-494f-b56a-38c8db129dc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=febd0a0016fc46888437ac2f5002e879)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:56.186456 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc74e3-b1da-494f-b56a-38c8db129dc9 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:56.231374 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-73bc74e3-b1da-494f-b56a-38c8db129dc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'febd0a0016fc46888437ac2f5002e879'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:56.238415 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-73bc74e3-b1da-494f-b56a-38c8db129dc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'febd0a0016fc46888437ac2f5002e879'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:56.239015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-73bc74e3-b1da-494f-b56a-38c8db129dc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'febd0a0016fc46888437ac2f5002e879'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:56.239606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-73bc74e3-b1da-494f-b56a-38c8db129dc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'febd0a0016fc46888437ac2f5002e879'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:56.246599 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-73bc74e3-b1da-494f-b56a-38c8db129dc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'febd0a0016fc46888437ac2f5002e879'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:56.264416 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1273/2586] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:48:56 2022] DELETE /identity/v3/users/febd0a0016fc46888437ac2f5002e879 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:48:56.442099 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb170be6-ee63-4102-8328-69ac827feacb admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:56.443759 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cb170be6-ee63-4102-8328-69ac827feacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:48:56.457239 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb170be6-ee63-4102-8328-69ac827feacb admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:56.475341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:48:56.518040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854004e-10c0-42d3-b769-75cdcf923799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:56.518726 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854004e-10c0-42d3-b769-75cdcf923799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:56.518955 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854004e-10c0-42d3-b769-75cdcf923799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:56.519234 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854004e-10c0-42d3-b769-75cdcf923799 admin admin] PATH_INFO: `/v3/projects/95538596db804a8aaae388ad10c11df6` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:56.520384 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854004e-10c0-42d3-b769-75cdcf923799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95538596db804a8aaae388ad10c11df6)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:56.522322 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854004e-10c0-42d3-b769-75cdcf923799 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:56.575921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a854004e-10c0-42d3-b769-75cdcf923799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95538596db804a8aaae388ad10c11df6', 'request_id': 'req-a854004e-10c0-42d3-b769-75cdcf923799'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:56.581354 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a854004e-10c0-42d3-b769-75cdcf923799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95538596db804a8aaae388ad10c11df6', 'request_id': 'req-a854004e-10c0-42d3-b769-75cdcf923799'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:56.588726 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a854004e-10c0-42d3-b769-75cdcf923799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95538596db804a8aaae388ad10c11df6', 'request_id': 'req-a854004e-10c0-42d3-b769-75cdcf923799'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:56.600011 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a854004e-10c0-42d3-b769-75cdcf923799 admin admin] The token cache is being invalidate because project 95538596db804a8aaae388ad10c11df6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:48:56.600301 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a854004e-10c0-42d3-b769-75cdcf923799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:56.600926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a854004e-10c0-42d3-b769-75cdcf923799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:48:56.602462 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1314/2587] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:48:56 2022] DELETE /identity/v3/projects/95538596db804a8aaae388ad10c11df6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:48:56.607842 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea525827-5ca1-4a66-84a3-4abb247bdd61 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:56.608298 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea525827-5ca1-4a66-84a3-4abb247bdd61 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:56.608411 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea525827-5ca1-4a66-84a3-4abb247bdd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:56.628217 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ea525827-5ca1-4a66-84a3-4abb247bdd61 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:48:56.629457 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ea525827-5ca1-4a66-84a3-4abb247bdd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:48:56.686842 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1274/2588] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:48:56.695587 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd272a53-5b8b-46c8-aea8-9a4de22abdb3 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:56.695875 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd272a53-5b8b-46c8-aea8-9a4de22abdb3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:56.696149 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd272a53-5b8b-46c8-aea8-9a4de22abdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:56.716878 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-dd272a53-5b8b-46c8-aea8-9a4de22abdb3 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:48:56.718232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-dd272a53-5b8b-46c8-aea8-9a4de22abdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:48:56.726298 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1315/2589] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:48:56.730255 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea525827-5ca1-4a66-84a3-4abb247bdd61 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:56.740309 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea525827-5ca1-4a66-84a3-4abb247bdd61 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:56.744919 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfb75a-c470-4cbe-9e35-2ac4e4e67b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:56.745532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfb75a-c470-4cbe-9e35-2ac4e4e67b4b admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:56.745807 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfb75a-c470-4cbe-9e35-2ac4e4e67b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:56.746074 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfb75a-c470-4cbe-9e35-2ac4e4e67b4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:56.746707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dfb75a-c470-4cbe-9e35-2ac4e4e67b4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:48:56.747003 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dfb75a-c470-4cbe-9e35-2ac4e4e67b4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:56.749170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dfb75a-c470-4cbe-9e35-2ac4e4e67b4b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:56.760272 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1275/2590] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:48:56.764552 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd272a53-5b8b-46c8-aea8-9a4de22abdb3 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:56.773890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd272a53-5b8b-46c8-aea8-9a4de22abdb3 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:56.778504 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ff833-4625-49df-9e3e-8001b377fc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:56.779090 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ff833-4625-49df-9e3e-8001b377fc97 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:56.779365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ff833-4625-49df-9e3e-8001b377fc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:56.779632 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ff833-4625-49df-9e3e-8001b377fc97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:56.780263 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ff833-4625-49df-9e3e-8001b377fc97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:56.782175 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ff833-4625-49df-9e3e-8001b377fc97 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:56.809340 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1316/2591] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:48:56 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:48:56.813457 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfb75a-c470-4cbe-9e35-2ac4e4e67b4b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:56.825337 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfb75a-c470-4cbe-9e35-2ac4e4e67b4b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:56.856256 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:48:56.886021 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e644b-b19c-486b-a1f4-6399a8b3400b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:56.886620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e644b-b19c-486b-a1f4-6399a8b3400b admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:56.886895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e644b-b19c-486b-a1f4-6399a8b3400b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:56.887163 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e644b-b19c-486b-a1f4-6399a8b3400b admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:56.887791 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e644b-b19c-486b-a1f4-6399a8b3400b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:56.889843 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e644b-b19c-486b-a1f4-6399a8b3400b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:56.912775 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1276/2592] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:48:56 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:48:56.916614 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ff833-4625-49df-9e3e-8001b377fc97 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:56.926900 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ff833-4625-49df-9e3e-8001b377fc97 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:56.931591 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da977ba1-5469-4d79-be9c-1338b754e7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:56.932182 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da977ba1-5469-4d79-be9c-1338b754e7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:56.932454 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da977ba1-5469-4d79-be9c-1338b754e7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:56.932722 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da977ba1-5469-4d79-be9c-1338b754e7d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:56.933396 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da977ba1-5469-4d79-be9c-1338b754e7d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:56.934969 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da977ba1-5469-4d79-be9c-1338b754e7d6 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:56.945653 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1317/2593] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:48:56.949654 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e644b-b19c-486b-a1f4-6399a8b3400b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:56.959665 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e644b-b19c-486b-a1f4-6399a8b3400b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:56.964529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1c3cb-91f0-422a-85fc-88e6c3c1d302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:56.965151 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1c3cb-91f0-422a-85fc-88e6c3c1d302 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:56.965445 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1c3cb-91f0-422a-85fc-88e6c3c1d302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:56.965700 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1c3cb-91f0-422a-85fc-88e6c3c1d302 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:56.966870 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1c3cb-91f0-422a-85fc-88e6c3c1d302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:56.968453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1c3cb-91f0-422a-85fc-88e6c3c1d302 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:56.982710 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1277/2594] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 00:48:56.983151 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da977ba1-5469-4d79-be9c-1338b754e7d6 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:56.993646 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da977ba1-5469-4d79-be9c-1338b754e7d6 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:56.999257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ff7ba-3318-4705-b3c3-66791fae46c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:56.999908 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ff7ba-3318-4705-b3c3-66791fae46c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:57.000238 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ff7ba-3318-4705-b3c3-66791fae46c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:57.000509 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ff7ba-3318-4705-b3c3-66791fae46c4 admin admin] PATH_INFO: `/v3/projects/26ff69265c1a4321a92190aa1f9f986f/users/d5025975a88f43b6abbd88051539efac/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:57.015379 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ff7ba-3318-4705-b3c3-66791fae46c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ff69265c1a4321a92190aa1f9f986f, user_id=d5025975a88f43b6abbd88051539efac, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:57.018098 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ff7ba-3318-4705-b3c3-66791fae46c4 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:57.032201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1318/2595] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:48:56 2022] PUT /identity/v3/projects/26ff69265c1a4321a92190aa1f9f986f/users/d5025975a88f43b6abbd88051539efac/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:48:57.037415 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480840d4-2bfd-4977-add9-a20af70ba4cc None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:57.037733 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480840d4-2bfd-4977-add9-a20af70ba4cc None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:57.038020 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480840d4-2bfd-4977-add9-a20af70ba4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:57.057025 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-480840d4-2bfd-4977-add9-a20af70ba4cc None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:48:57.058248 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-480840d4-2bfd-4977-add9-a20af70ba4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:48:57.115324 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1278/2596] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:48:57.125381 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ff7ba-3318-4705-b3c3-66791fae46c4 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:48:57.127072 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-074ff7ba-3318-4705-b3c3-66791fae46c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:48:57.179646 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:48:57.185969 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ff7ba-3318-4705-b3c3-66791fae46c4 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:48:57.190167 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222073b-50a8-45c2-b3ce-4ef3ee61cfde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:48:57.190760 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222073b-50a8-45c2-b3ce-4ef3ee61cfde service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:48:57.191036 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222073b-50a8-45c2-b3ce-4ef3ee61cfde service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:48:57.191305 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222073b-50a8-45c2-b3ce-4ef3ee61cfde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:48:57.200011 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222073b-50a8-45c2-b3ce-4ef3ee61cfde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:48:57.202059 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222073b-50a8-45c2-b3ce-4ef3ee61cfde service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:48:57.211558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1319/2597] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:48:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:49:01.551672 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a3137-fd4c-45a3-9af0-012130912f92 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:01.552137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a3137-fd4c-45a3-9af0-012130912f92 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:01.552876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a3137-fd4c-45a3-9af0-012130912f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:01.591481 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-928a3137-fd4c-45a3-9af0-012130912f92 None None] MFA Rules not processed for user `d5025975a88f43b6abbd88051539efac`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:49:01.592684 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-928a3137-fd4c-45a3-9af0-012130912f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:49:01.666363 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1279/2598] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:49:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:49:01.672054 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222073b-50a8-45c2-b3ce-4ef3ee61cfde service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:49:01.692017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222073b-50a8-45c2-b3ce-4ef3ee61cfde service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:49:01.705605 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971aead-f7ff-4a46-85cc-617c64a63ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:49:01.706316 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971aead-f7ff-4a46-85cc-617c64a63ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:01.706667 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971aead-f7ff-4a46-85cc-617c64a63ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:01.707020 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971aead-f7ff-4a46-85cc-617c64a63ad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:01.707771 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971aead-f7ff-4a46-85cc-617c64a63ad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:49:01.709821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971aead-f7ff-4a46-85cc-617c64a63ad7 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:49:01.746358 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1320/2599] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:49:01 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:49:01.750613 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a3137-fd4c-45a3-9af0-012130912f92 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:49:01.762301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a3137-fd4c-45a3-9af0-012130912f92 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:49:01.807229 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:01.828419 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94116d-9306-41f8-b509-b3ac9d5b1b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:49:01.829033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94116d-9306-41f8-b509-b3ac9d5b1b9d admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:01.829350 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94116d-9306-41f8-b509-b3ac9d5b1b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:01.829628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94116d-9306-41f8-b509-b3ac9d5b1b9d admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:01.830273 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94116d-9306-41f8-b509-b3ac9d5b1b9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:49:01.832243 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94116d-9306-41f8-b509-b3ac9d5b1b9d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:49:01.857586 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1280/2600] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:49:01 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:49:01.861565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971aead-f7ff-4a46-85cc-617c64a63ad7 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:49:01.873427 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971aead-f7ff-4a46-85cc-617c64a63ad7 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:49:01.878479 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0285c7-6d02-40f0-a3b6-54d8a66214d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:49:01.879181 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0285c7-6d02-40f0-a3b6-54d8a66214d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:01.879468 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0285c7-6d02-40f0-a3b6-54d8a66214d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:01.879742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0285c7-6d02-40f0-a3b6-54d8a66214d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:01.880396 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0285c7-6d02-40f0-a3b6-54d8a66214d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:49:01.882062 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0285c7-6d02-40f0-a3b6-54d8a66214d7 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:49:01.893525 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1321/2601] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:49:01.897738 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94116d-9306-41f8-b509-b3ac9d5b1b9d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:49:01.908502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94116d-9306-41f8-b509-b3ac9d5b1b9d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:49:01.914955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfa906-e484-4f6e-918e-5e684e190d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:49:01.915698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfa906-e484-4f6e-918e-5e684e190d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:01.916052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfa906-e484-4f6e-918e-5e684e190d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:01.916392 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfa906-e484-4f6e-918e-5e684e190d8c admin admin] PATH_INFO: `/v3/projects/367ac0aab2184757bc740f66a50f453b/users/21fc60b88f7940318fa0fd217664c594/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:01.936233 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfa906-e484-4f6e-918e-5e684e190d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=367ac0aab2184757bc740f66a50f453b, user_id=21fc60b88f7940318fa0fd217664c594, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:49:01.940512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bfa906-e484-4f6e-918e-5e684e190d8c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:49:01.954706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1281/2602] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:49:01 2022] PUT /identity/v3/projects/367ac0aab2184757bc740f66a50f453b/users/21fc60b88f7940318fa0fd217664c594/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:49:01.958805 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0285c7-6d02-40f0-a3b6-54d8a66214d7 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:49:01.973120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0285c7-6d02-40f0-a3b6-54d8a66214d7 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:49:02.036589 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fb6a8-ea2e-4288-b06b-ecf1096844db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:49:02.037264 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fb6a8-ea2e-4288-b06b-ecf1096844db admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:02.037551 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fb6a8-ea2e-4288-b06b-ecf1096844db admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:02.037825 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fb6a8-ea2e-4288-b06b-ecf1096844db admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:02.038486 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750fb6a8-ea2e-4288-b06b-ecf1096844db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:49:02.040077 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750fb6a8-ea2e-4288-b06b-ecf1096844db admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:49:02.053131 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1322/2603] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:49:02.055459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfa906-e484-4f6e-918e-5e684e190d8c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:49:02.073839 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfa906-e484-4f6e-918e-5e684e190d8c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:49:02.083643 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336fb15-b959-49df-ba58-f52205327e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:49:02.084321 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336fb15-b959-49df-ba58-f52205327e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:02.084601 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336fb15-b959-49df-ba58-f52205327e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:02.084879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336fb15-b959-49df-ba58-f52205327e30 admin admin] PATH_INFO: `/v3/projects/367ac0aab2184757bc740f66a50f453b/users/21fc60b88f7940318fa0fd217664c594/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:02.087219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336fb15-b959-49df-ba58-f52205327e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=367ac0aab2184757bc740f66a50f453b, user_id=21fc60b88f7940318fa0fd217664c594, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:49:02.090346 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336fb15-b959-49df-ba58-f52205327e30 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:49:02.108827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1282/2604] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:49:02 2022] PUT /identity/v3/projects/367ac0aab2184757bc740f66a50f453b/users/21fc60b88f7940318fa0fd217664c594/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:49:06.598102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba6a57-ee36-4153-b3ae-061381b34b5e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:06.598590 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba6a57-ee36-4153-b3ae-061381b34b5e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:06.598798 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba6a57-ee36-4153-b3ae-061381b34b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:06.627338 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-f0ba6a57-ee36-4153-b3ae-061381b34b5e None None] MFA Rules not processed for user `21fc60b88f7940318fa0fd217664c594`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:49:06.628581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f0ba6a57-ee36-4153-b3ae-061381b34b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:49:06.697170 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1323/2605] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:49:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:49:06.711646 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336fb15-b959-49df-ba58-f52205327e30 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:49:06.713560 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b336fb15-b959-49df-ba58-f52205327e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:49:06.798392 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336fb15-b959-49df-ba58-f52205327e30 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:49:06.803841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25fc6b-a56c-4dab-a875-0e40bdd5309f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:49:06.804438 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25fc6b-a56c-4dab-a875-0e40bdd5309f service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:06.804711 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25fc6b-a56c-4dab-a875-0e40bdd5309f service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:06.804979 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25fc6b-a56c-4dab-a875-0e40bdd5309f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:06.868724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25fc6b-a56c-4dab-a875-0e40bdd5309f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:49:06.870375 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25fc6b-a56c-4dab-a875-0e40bdd5309f service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:49:06.880700 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1283/2606] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:49:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:49:07.957982 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f336ed-dd73-4eb6-8cd1-c705020a813a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:07.958448 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f336ed-dd73-4eb6-8cd1-c705020a813a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:07.958549 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f336ed-dd73-4eb6-8cd1-c705020a813a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:07.977519 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-93f336ed-dd73-4eb6-8cd1-c705020a813a None None] MFA Rules not processed for user `d5025975a88f43b6abbd88051539efac`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:49:07.978617 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-93f336ed-dd73-4eb6-8cd1-c705020a813a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:49:07.986370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1324/2607] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:49:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:49:12.092488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e42dc-a8ea-40bd-b9d9-17d3ccff94b1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:12.093034 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e42dc-a8ea-40bd-b9d9-17d3ccff94b1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:12.093034 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e42dc-a8ea-40bd-b9d9-17d3ccff94b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:12.112332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-eb6e42dc-a8ea-40bd-b9d9-17d3ccff94b1 None None] MFA Rules not processed for user `8361506717694758bd7759273ff892d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:49:12.113576 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-eb6e42dc-a8ea-40bd-b9d9-17d3ccff94b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:49:12.139827 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:12.175958 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1284/2608] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:49:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:49:17.972185 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=85,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:22.168200 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=12 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:24.496643 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b488a-4ec1-467d-8e41-b31a5271e00e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:24.497177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b488a-4ec1-467d-8e41-b31a5271e00e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:24.497338 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b488a-4ec1-467d-8e41-b31a5271e00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:24.525073 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-5a2b488a-4ec1-467d-8e41-b31a5271e00e None None] MFA Rules not processed for user `ed49a596f15542a29ce331bae4640274`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:49:24.526650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5a2b488a-4ec1-467d-8e41-b31a5271e00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:49:24.603003 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1325/2609] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 15 00:49:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:49:24.618022 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e42dc-a8ea-40bd-b9d9-17d3ccff94b1 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:49:24.619869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-eb6e42dc-a8ea-40bd-b9d9-17d3ccff94b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:49:24.690112 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e42dc-a8ea-40bd-b9d9-17d3ccff94b1 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:49:24.695115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e315f68-4676-495e-adb3-304638d3938c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb248b85aba45b39132d0f92ede0b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:49:24.695724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e315f68-4676-495e-adb3-304638d3938c service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:24.696008 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e315f68-4676-495e-adb3-304638d3938c service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:24.696279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e315f68-4676-495e-adb3-304638d3938c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:24.705119 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e315f68-4676-495e-adb3-304638d3938c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:49:24.706656 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e315f68-4676-495e-adb3-304638d3938c service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:49:24.715143 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1285/2610] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 15 00:49:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 00:49:33.940345 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b488a-4ec1-467d-8e41-b31a5271e00e None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:49:33.941760 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5a2b488a-4ec1-467d-8e41-b31a5271e00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:49:33.964098 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e315f68-4676-495e-adb3-304638d3938c service swift] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:49:34.000300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b488a-4ec1-467d-8e41-b31a5271e00e None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:49:34.004158 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86f20e-0523-40a9-9b42-26160e6ab107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:49:34.005223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86f20e-0523-40a9-9b42-26160e6ab107 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:34.005626 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86f20e-0523-40a9-9b42-26160e6ab107 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:34.005909 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86f20e-0523-40a9-9b42-26160e6ab107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:34.007821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8e86f20e-0523-40a9-9b42-26160e6ab107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:49:34.021655 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e315f68-4676-495e-adb3-304638d3938c service swift] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:49:34.021945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86f20e-0523-40a9-9b42-26160e6ab107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:49:34.023344 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86f20e-0523-40a9-9b42-26160e6ab107 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:49:34.025732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07731a7-6d4c-481d-b43d-bc9f7bf2027b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:49:34.026411 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07731a7-6d4c-481d-b43d-bc9f7bf2027b service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:34.026733 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07731a7-6d4c-481d-b43d-bc9f7bf2027b service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:34.027309 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07731a7-6d4c-481d-b43d-bc9f7bf2027b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:34.029396 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f07731a7-6d4c-481d-b43d-bc9f7bf2027b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:49:34.034659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1326/2611] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:49:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:49:34.045323 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07731a7-6d4c-481d-b43d-bc9f7bf2027b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:49:34.047704 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07731a7-6d4c-481d-b43d-bc9f7bf2027b service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:49:34.061625 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1286/2612] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:49:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:49:34.371542 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86f20e-0523-40a9-9b42-26160e6ab107 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:49:34.380633 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86f20e-0523-40a9-9b42-26160e6ab107 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:49:34.384279 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f53de-62b1-421a-b888-4ab313d94158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:49:34.384869 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f53de-62b1-421a-b888-4ab313d94158 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:34.385185 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f53de-62b1-421a-b888-4ab313d94158 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:34.385461 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f53de-62b1-421a-b888-4ab313d94158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:34.394950 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f53de-62b1-421a-b888-4ab313d94158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:49:34.396309 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f53de-62b1-421a-b888-4ab313d94158 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:49:34.405608 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1327/2613] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:49:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:49:38.659764 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e54b6-ae03-4629-b209-819f29c7ec20 None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:38.660394 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e54b6-ae03-4629-b209-819f29c7ec20 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:38.660394 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e54b6-ae03-4629-b209-819f29c7ec20 None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:38.661839 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1287/2614] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 15 00:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:49:38.667461 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973f34d-372d-444a-8876-1150d4c94290 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:38.667935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973f34d-372d-444a-8876-1150d4c94290 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:38.668046 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973f34d-372d-444a-8876-1150d4c94290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:38.689493 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-d973f34d-372d-444a-8876-1150d4c94290 None None] MFA Rules not processed for user `bfcfcf8061f24231858b9b0205a8abaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:49:38.690697 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d973f34d-372d-444a-8876-1150d4c94290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:49:38.700885 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1328/2615] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 15 00:49:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:49:38.713820 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e54b6-ae03-4629-b209-819f29c7ec20 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:49:38.715797 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-866e54b6-ae03-4629-b209-819f29c7ec20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:49:38.776058 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e54b6-ae03-4629-b209-819f29c7ec20 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:49:38.779696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb5af4-8f21-4eb6-b092-2d0cad134284 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12ce70a7c4f4396ab3fbb635dfc548b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:49:38.780293 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb5af4-8f21-4eb6-b092-2d0cad134284 service glance] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:38.781159 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb5af4-8f21-4eb6-b092-2d0cad134284 service glance] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:38.781437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb5af4-8f21-4eb6-b092-2d0cad134284 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:38.792435 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb5af4-8f21-4eb6-b092-2d0cad134284 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:49:38.793926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb5af4-8f21-4eb6-b092-2d0cad134284 service glance] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:49:38.810269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1288/2616] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:49:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:49:38.876984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f277a-d676-49b8-8f9a-d244e061912a None None] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:38.877299 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f277a-d676-49b8-8f9a-d244e061912a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:38.877595 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f277a-d676-49b8-8f9a-d244e061912a None None] PATH_INFO: `/` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:38.878930 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1329/2617] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 15 00:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:49:38.883695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200a747-63ec-4d85-a9b7-2d990408da27 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:38.883976 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200a747-63ec-4d85-a9b7-2d990408da27 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:38.884247 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200a747-63ec-4d85-a9b7-2d990408da27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:38.903594 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b200a747-63ec-4d85-a9b7-2d990408da27 None None] MFA Rules not processed for user `50ec251be76543b4ad97442664db6858`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:49:38.904790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b200a747-63ec-4d85-a9b7-2d990408da27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:49:38.911769 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1289/2618] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 15 00:49:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:49:38.923790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f277a-d676-49b8-8f9a-d244e061912a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:49:38.934553 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f277a-d676-49b8-8f9a-d244e061912a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:49:38.938065 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033d8bc-b8d2-4ed4-a3d0-62e99d60b9fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:49:38.938648 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033d8bc-b8d2-4ed4-a3d0-62e99d60b9fc service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:38.938923 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033d8bc-b8d2-4ed4-a3d0-62e99d60b9fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:38.939188 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033d8bc-b8d2-4ed4-a3d0-62e99d60b9fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:38.946020 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033d8bc-b8d2-4ed4-a3d0-62e99d60b9fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:49:38.947415 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033d8bc-b8d2-4ed4-a3d0-62e99d60b9fc service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:49:38.954884 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1330/2619] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:49:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:49:39.036069 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0dd9e-3423-4c4f-91cc-8e070b9f032b None None] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:39.036363 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0dd9e-3423-4c4f-91cc-8e070b9f032b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:39.036642 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0dd9e-3423-4c4f-91cc-8e070b9f032b None None] PATH_INFO: `/` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:39.039799 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1290/2620] 10.222.0.52 () {54 vars in 921 bytes} [Thu Sep 15 00:49:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 00:49:39.045156 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32776642-b658-43cf-9398-0ae00f83dfe9 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:39.045473 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32776642-b658-43cf-9398-0ae00f83dfe9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:39.045746 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32776642-b658-43cf-9398-0ae00f83dfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:39.065693 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-32776642-b658-43cf-9398-0ae00f83dfe9 None None] MFA Rules not processed for user `bfcfcf8061f24231858b9b0205a8abaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:49:39.066895 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-32776642-b658-43cf-9398-0ae00f83dfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:49:39.076241 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1331/2621] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Sep 15 00:49:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:49:39.086489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0dd9e-3423-4c4f-91cc-8e070b9f032b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:49:39.098842 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0dd9e-3423-4c4f-91cc-8e070b9f032b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:49:39.102420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863afe56-01b2-438a-89c1-15278a65ab92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:49:39.103006 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863afe56-01b2-438a-89c1-15278a65ab92 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:39.103289 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863afe56-01b2-438a-89c1-15278a65ab92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:39.103560 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863afe56-01b2-438a-89c1-15278a65ab92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:39.114134 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863afe56-01b2-438a-89c1-15278a65ab92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:49:39.115556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863afe56-01b2-438a-89c1-15278a65ab92 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:49:39.126261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1291/2622] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:49:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:49:41.614048 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0f589-1e62-43a2-a834-ad8d82949191 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:41.614524 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0f589-1e62-43a2-a834-ad8d82949191 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:41.614627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0f589-1e62-43a2-a834-ad8d82949191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:41.633603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8ef0f589-1e62-43a2-a834-ad8d82949191 None None] MFA Rules not processed for user `ed49a596f15542a29ce331bae4640274`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:49:41.634801 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8ef0f589-1e62-43a2-a834-ad8d82949191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:49:41.642365 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1332/2623] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Sep 15 00:49:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:49:41.654261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863afe56-01b2-438a-89c1-15278a65ab92 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:49:41.665877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863afe56-01b2-438a-89c1-15278a65ab92 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:49:41.670731 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af84972-8540-492b-96e2-8c2250524c5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb248b85aba45b39132d0f92ede0b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:49:41.671309 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af84972-8540-492b-96e2-8c2250524c5d service swift] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:41.671588 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af84972-8540-492b-96e2-8c2250524c5d service swift] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:41.671857 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af84972-8540-492b-96e2-8c2250524c5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:41.679624 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af84972-8540-492b-96e2-8c2250524c5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:49:41.681649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af84972-8540-492b-96e2-8c2250524c5d service swift] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:49:41.689569 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1292/2624] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 15 00:49:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 00:49:43.378703 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0f589-1e62-43a2-a834-ad8d82949191 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:49:43.392452 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0f589-1e62-43a2-a834-ad8d82949191 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:49:43.398039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ee6e6-11ac-49de-937a-b7ba12409901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:49:43.398649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ee6e6-11ac-49de-937a-b7ba12409901 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:43.398925 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ee6e6-11ac-49de-937a-b7ba12409901 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:43.399193 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ee6e6-11ac-49de-937a-b7ba12409901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:43.400923 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6b1ee6e6-11ac-49de-937a-b7ba12409901 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:49:43.468030 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ee6e6-11ac-49de-937a-b7ba12409901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:49:43.470276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ee6e6-11ac-49de-937a-b7ba12409901 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:49:43.475397 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:43.481603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1333/2625] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:49:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:49:51.686304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:49:59.219276 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af84972-8540-492b-96e2-8c2250524c5d service swift] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:49:59.236612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af84972-8540-492b-96e2-8c2250524c5d service swift] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:49:59.240598 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7867d7-eab8-488f-8f62-7de9b8fb9bc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:49:59.241252 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7867d7-eab8-488f-8f62-7de9b8fb9bc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:49:59.241572 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7867d7-eab8-488f-8f62-7de9b8fb9bc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:49:59.241797 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7867d7-eab8-488f-8f62-7de9b8fb9bc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:49:59.243694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4c7867d7-eab8-488f-8f62-7de9b8fb9bc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:49:59.254379 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7867d7-eab8-488f-8f62-7de9b8fb9bc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:49:59.255995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7867d7-eab8-488f-8f62-7de9b8fb9bc7 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:49:59.265200 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1293/2626] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:49:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:50:00.382211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ee6e6-11ac-49de-937a-b7ba12409901 service nova] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:00.396830 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ee6e6-11ac-49de-937a-b7ba12409901 service nova] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:00.417192 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ca641-733c-4911-8192-8d284e5628e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:00.417845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ca641-733c-4911-8192-8d284e5628e3 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:00.418124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ca641-733c-4911-8192-8d284e5628e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:00.418432 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ca641-733c-4911-8192-8d284e5628e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:00.421222 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cc1ca641-733c-4911-8192-8d284e5628e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:00.436287 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ca641-733c-4911-8192-8d284e5628e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:00.437934 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ca641-733c-4911-8192-8d284e5628e3 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:00.450497 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1334/2627] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:50:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:50:00.810155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3ff43-9d34-413b-902b-668c534f57b5 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:00.810646 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3ff43-9d34-413b-902b-668c534f57b5 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:00.810999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3ff43-9d34-413b-902b-668c534f57b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:00.832173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b1b3ff43-9d34-413b-902b-668c534f57b5 None None] MFA Rules not processed for user `ed49a596f15542a29ce331bae4640274`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:00.833412 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b1b3ff43-9d34-413b-902b-668c534f57b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:00.840851 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1294/2628] 10.222.0.52 () {58 vars in 967 bytes} [Thu Sep 15 00:50:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:00.863790 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ca641-733c-4911-8192-8d284e5628e3 service nova] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:00.875196 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ca641-733c-4911-8192-8d284e5628e3 service nova] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:00.880607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bc823-2b58-424d-9f26-a7fcc359567e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb248b85aba45b39132d0f92ede0b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:00.881256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bc823-2b58-424d-9f26-a7fcc359567e service swift] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:00.881543 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bc823-2b58-424d-9f26-a7fcc359567e service swift] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:00.881819 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bc823-2b58-424d-9f26-a7fcc359567e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:00.890196 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bc823-2b58-424d-9f26-a7fcc359567e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:00.892229 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bc823-2b58-424d-9f26-a7fcc359567e service swift] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:00.900278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1335/2629] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Sep 15 00:50:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 00:50:10.826574 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=9 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:10.896961 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=12 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:18.172178 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3ff43-9d34-413b-902b-668c534f57b5 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:18.173770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b1b3ff43-9d34-413b-902b-668c534f57b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:18.244587 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bc823-2b58-424d-9f26-a7fcc359567e service swift] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:18.246826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-630bc823-2b58-424d-9f26-a7fcc359567e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:18.258622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3ff43-9d34-413b-902b-668c534f57b5 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:18.265178 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cdda9-e746-459a-9d2a-cf8b8faaabcb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed987b44d934ac7b2dc64c0aab28099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:18.265858 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cdda9-e746-459a-9d2a-cf8b8faaabcb service placement] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:18.266205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cdda9-e746-459a-9d2a-cf8b8faaabcb service placement] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:18.266484 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cdda9-e746-459a-9d2a-cf8b8faaabcb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:18.268432 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-882cdda9-e746-459a-9d2a-cf8b8faaabcb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:18.281397 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cdda9-e746-459a-9d2a-cf8b8faaabcb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:18.283182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cdda9-e746-459a-9d2a-cf8b8faaabcb service placement] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:18.294168 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1295/2630] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:50:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:50:18.347204 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bc823-2b58-424d-9f26-a7fcc359567e service swift] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:18.351832 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a06e4-291b-410f-8ceb-528a143d24dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:18.352488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a06e4-291b-410f-8ceb-528a143d24dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:18.352766 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a06e4-291b-410f-8ceb-528a143d24dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:18.353033 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a06e4-291b-410f-8ceb-528a143d24dd admin admin] PATH_INFO: `/v3/users/8361506717694758bd7759273ff892d4` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:18.354222 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a06e4-291b-410f-8ceb-528a143d24dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8361506717694758bd7759273ff892d4)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:18.356226 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a06e4-291b-410f-8ceb-528a143d24dd admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:18.404162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c31a06e4-291b-410f-8ceb-528a143d24dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8361506717694758bd7759273ff892d4'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:18.411764 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c31a06e4-291b-410f-8ceb-528a143d24dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8361506717694758bd7759273ff892d4'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:18.412303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c31a06e4-291b-410f-8ceb-528a143d24dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8361506717694758bd7759273ff892d4'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:18.412890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c31a06e4-291b-410f-8ceb-528a143d24dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8361506717694758bd7759273ff892d4'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:18.419932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c31a06e4-291b-410f-8ceb-528a143d24dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8361506717694758bd7759273ff892d4'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:18.437713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1336/2631] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:50:18 2022] DELETE /identity/v3/users/8361506717694758bd7759273ff892d4 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:18.612048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cdda9-e746-459a-9d2a-cf8b8faaabcb service placement] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:18.622695 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cdda9-e746-459a-9d2a-cf8b8faaabcb service placement] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:18.681433 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fbf3c-4ac9-4b60-a105-7abd5ea260bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:18.681981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fbf3c-4ac9-4b60-a105-7abd5ea260bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:18.682261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fbf3c-4ac9-4b60-a105-7abd5ea260bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:18.682531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fbf3c-4ac9-4b60-a105-7abd5ea260bd admin admin] PATH_INFO: `/v3/projects/139dc22c82ee4c0988c41a98232e69eb` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:18.683643 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fbf3c-4ac9-4b60-a105-7abd5ea260bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=139dc22c82ee4c0988c41a98232e69eb)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:18.685589 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fbf3c-4ac9-4b60-a105-7abd5ea260bd admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:18.729466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d81fbf3c-4ac9-4b60-a105-7abd5ea260bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '139dc22c82ee4c0988c41a98232e69eb', 'request_id': 'req-d81fbf3c-4ac9-4b60-a105-7abd5ea260bd'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:18.737059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d81fbf3c-4ac9-4b60-a105-7abd5ea260bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '139dc22c82ee4c0988c41a98232e69eb', 'request_id': 'req-d81fbf3c-4ac9-4b60-a105-7abd5ea260bd'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:18.742540 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d81fbf3c-4ac9-4b60-a105-7abd5ea260bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '139dc22c82ee4c0988c41a98232e69eb', 'request_id': 'req-d81fbf3c-4ac9-4b60-a105-7abd5ea260bd'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:18.753239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d81fbf3c-4ac9-4b60-a105-7abd5ea260bd admin admin] The token cache is being invalidate because project 139dc22c82ee4c0988c41a98232e69eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:50:18.753522 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d81fbf3c-4ac9-4b60-a105-7abd5ea260bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:18.754137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d81fbf3c-4ac9-4b60-a105-7abd5ea260bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:18.755611 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1296/2632] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:50:18 2022] DELETE /identity/v3/projects/139dc22c82ee4c0988c41a98232e69eb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:18.760526 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012e79b-ab95-4136-bf11-b2afefd804f3 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:18.760904 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012e79b-ab95-4136-bf11-b2afefd804f3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:18.761242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012e79b-ab95-4136-bf11-b2afefd804f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:18.781784 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8012e79b-ab95-4136-bf11-b2afefd804f3 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:18.782972 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8012e79b-ab95-4136-bf11-b2afefd804f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:18.840408 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1337/2633] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:18.848791 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7df0a8-4639-4224-9b32-6d5325810092 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:18.849072 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7df0a8-4639-4224-9b32-6d5325810092 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:18.849361 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7df0a8-4639-4224-9b32-6d5325810092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:18.868255 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-4d7df0a8-4639-4224-9b32-6d5325810092 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:18.869468 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4d7df0a8-4639-4224-9b32-6d5325810092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:18.877166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1297/2634] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:18.881055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012e79b-ab95-4136-bf11-b2afefd804f3 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:18.891236 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012e79b-ab95-4136-bf11-b2afefd804f3 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:18.895979 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efa6d8-db8b-4142-85be-672be64b436a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:18.896584 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efa6d8-db8b-4142-85be-672be64b436a admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:18.896862 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efa6d8-db8b-4142-85be-672be64b436a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:18.897166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efa6d8-db8b-4142-85be-672be64b436a admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:18.897813 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efa6d8-db8b-4142-85be-672be64b436a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:50:18.898119 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efa6d8-db8b-4142-85be-672be64b436a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:18.899695 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efa6d8-db8b-4142-85be-672be64b436a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:18.913610 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1338/2635] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:50:18.917903 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7df0a8-4639-4224-9b32-6d5325810092 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:18.927062 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7df0a8-4639-4224-9b32-6d5325810092 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:18.931737 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16c8dd-2716-45ed-abfe-cd3c84d1dca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:18.932266 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16c8dd-2716-45ed-abfe-cd3c84d1dca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:18.932541 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16c8dd-2716-45ed-abfe-cd3c84d1dca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:18.932814 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16c8dd-2716-45ed-abfe-cd3c84d1dca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:18.933476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16c8dd-2716-45ed-abfe-cd3c84d1dca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:18.935378 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16c8dd-2716-45ed-abfe-cd3c84d1dca4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:18.946283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:18.963846 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1298/2636] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:50:18 2022] POST /identity/v3/projects => generated 357 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:50:18.967900 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efa6d8-db8b-4142-85be-672be64b436a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:18.978437 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efa6d8-db8b-4142-85be-672be64b436a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:18.981957 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:19.035680 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e72b6d-ca5e-4bd5-9a4a-d1ec52281ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:19.036281 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e72b6d-ca5e-4bd5-9a4a-d1ec52281ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:19.036563 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e72b6d-ca5e-4bd5-9a4a-d1ec52281ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:19.036836 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e72b6d-ca5e-4bd5-9a4a-d1ec52281ee7 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:19.037503 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e72b6d-ca5e-4bd5-9a4a-d1ec52281ee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:19.039421 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e72b6d-ca5e-4bd5-9a4a-d1ec52281ee7 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:19.059165 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1339/2637] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:50:18 2022] POST /identity/v3/users => generated 279 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:50:19.063361 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16c8dd-2716-45ed-abfe-cd3c84d1dca4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:19.073561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16c8dd-2716-45ed-abfe-cd3c84d1dca4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:19.078633 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f2097-be67-4515-be42-64f65585a551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:19.079218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f2097-be67-4515-be42-64f65585a551 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:19.079496 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f2097-be67-4515-be42-64f65585a551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:19.079765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f2097-be67-4515-be42-64f65585a551 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:19.080399 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f2097-be67-4515-be42-64f65585a551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:19.082062 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f2097-be67-4515-be42-64f65585a551 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:19.091998 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1299/2638] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:50:19.096396 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e72b6d-ca5e-4bd5-9a4a-d1ec52281ee7 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:19.106092 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e72b6d-ca5e-4bd5-9a4a-d1ec52281ee7 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:19.110626 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6caae-ac0a-4d43-b5ba-5fa20851641b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:19.111204 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6caae-ac0a-4d43-b5ba-5fa20851641b admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:19.111481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6caae-ac0a-4d43-b5ba-5fa20851641b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:19.111752 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6caae-ac0a-4d43-b5ba-5fa20851641b admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:19.112381 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6caae-ac0a-4d43-b5ba-5fa20851641b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:19.113976 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6caae-ac0a-4d43-b5ba-5fa20851641b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:19.124125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1340/2639] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:50:19.127995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f2097-be67-4515-be42-64f65585a551 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:19.137829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f2097-be67-4515-be42-64f65585a551 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:19.143038 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f07058-3819-47f9-a1a5-b0dfab644707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:19.143668 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f07058-3819-47f9-a1a5-b0dfab644707 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:19.143946 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f07058-3819-47f9-a1a5-b0dfab644707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:19.144212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f07058-3819-47f9-a1a5-b0dfab644707 admin admin] PATH_INFO: `/v3/projects/69b0569b828e4258ab99b38ebf2027a3/users/e27f982effaf448f9e6284b66a59ddfc/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:19.159435 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f07058-3819-47f9-a1a5-b0dfab644707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b0569b828e4258ab99b38ebf2027a3, user_id=e27f982effaf448f9e6284b66a59ddfc, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:19.162123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f07058-3819-47f9-a1a5-b0dfab644707 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:19.174962 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1300/2640] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:50:19 2022] PUT /identity/v3/projects/69b0569b828e4258ab99b38ebf2027a3/users/e27f982effaf448f9e6284b66a59ddfc/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:50:19.186201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38882451-982a-44ca-b1d8-25d403471f75 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:19.186425 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38882451-982a-44ca-b1d8-25d403471f75 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:19.186699 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38882451-982a-44ca-b1d8-25d403471f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:19.215264 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-38882451-982a-44ca-b1d8-25d403471f75 None None] MFA Rules not processed for user `e27f982effaf448f9e6284b66a59ddfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:19.216625 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-38882451-982a-44ca-b1d8-25d403471f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:19.280255 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1341/2641] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:19.284788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f07058-3819-47f9-a1a5-b0dfab644707 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:19.346080 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f07058-3819-47f9-a1a5-b0dfab644707 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:19.350686 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7aa1a6-8f5b-4742-80ec-9194c233c44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:19.351278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7aa1a6-8f5b-4742-80ec-9194c233c44a admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:19.351554 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7aa1a6-8f5b-4742-80ec-9194c233c44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:19.351820 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7aa1a6-8f5b-4742-80ec-9194c233c44a admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:19.352439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7aa1a6-8f5b-4742-80ec-9194c233c44a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:19.354355 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7aa1a6-8f5b-4742-80ec-9194c233c44a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:19.380231 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1301/2642] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:50:19 2022] POST /identity/v3/projects => generated 357 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:50:19.384352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38882451-982a-44ca-b1d8-25d403471f75 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:19.396199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38882451-982a-44ca-b1d8-25d403471f75 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:19.450431 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b6c06-1202-4c61-a335-c499842f37fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:19.450957 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b6c06-1202-4c61-a335-c499842f37fd admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:19.451232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b6c06-1202-4c61-a335-c499842f37fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:19.451507 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b6c06-1202-4c61-a335-c499842f37fd admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:19.452128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b6c06-1202-4c61-a335-c499842f37fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:19.454643 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b6c06-1202-4c61-a335-c499842f37fd admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:19.475257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1342/2643] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:50:19 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:50:19.479169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7aa1a6-8f5b-4742-80ec-9194c233c44a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:19.489336 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7aa1a6-8f5b-4742-80ec-9194c233c44a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:19.493888 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73311c-defe-4170-82b6-4c2d6fbea3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:19.494476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73311c-defe-4170-82b6-4c2d6fbea3be admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:19.494761 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73311c-defe-4170-82b6-4c2d6fbea3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:19.495040 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73311c-defe-4170-82b6-4c2d6fbea3be admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:19.495672 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73311c-defe-4170-82b6-4c2d6fbea3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:19.497295 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73311c-defe-4170-82b6-4c2d6fbea3be admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:19.508029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1302/2644] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:50:19.511914 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b6c06-1202-4c61-a335-c499842f37fd admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:19.518704 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:19.522751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b6c06-1202-4c61-a335-c499842f37fd admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:19.528115 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058eab3a-e619-4d81-9bd9-959cc4b33739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:19.528780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058eab3a-e619-4d81-9bd9-959cc4b33739 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:19.529103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058eab3a-e619-4d81-9bd9-959cc4b33739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:19.529393 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058eab3a-e619-4d81-9bd9-959cc4b33739 admin admin] PATH_INFO: `/v3/projects/777b19ad46274440bd44eec53428a497/users/fcd0a9ec33384c7eaa041f4923ab055d/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:19.543750 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058eab3a-e619-4d81-9bd9-959cc4b33739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=777b19ad46274440bd44eec53428a497, user_id=fcd0a9ec33384c7eaa041f4923ab055d, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:19.546443 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058eab3a-e619-4d81-9bd9-959cc4b33739 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:19.561146 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1343/2645] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:50:19 2022] PUT /identity/v3/projects/777b19ad46274440bd44eec53428a497/users/fcd0a9ec33384c7eaa041f4923ab055d/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:50:19.565569 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73311c-defe-4170-82b6-4c2d6fbea3be admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:19.575772 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73311c-defe-4170-82b6-4c2d6fbea3be admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:19.636030 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e3759-5396-469d-9b98-1bdfa95dc060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:19.636630 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e3759-5396-469d-9b98-1bdfa95dc060 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:19.636904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e3759-5396-469d-9b98-1bdfa95dc060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:19.637203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e3759-5396-469d-9b98-1bdfa95dc060 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:19.637838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e3759-5396-469d-9b98-1bdfa95dc060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:19.639464 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e3759-5396-469d-9b98-1bdfa95dc060 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:19.649366 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1303/2646] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:50:19.653609 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058eab3a-e619-4d81-9bd9-959cc4b33739 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:19.665843 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058eab3a-e619-4d81-9bd9-959cc4b33739 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:19.674017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524ef13-6a97-443e-9336-3643c7ea874d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:19.675063 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524ef13-6a97-443e-9336-3643c7ea874d admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:19.675063 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524ef13-6a97-443e-9336-3643c7ea874d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:19.675462 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524ef13-6a97-443e-9336-3643c7ea874d admin admin] PATH_INFO: `/v3/projects/777b19ad46274440bd44eec53428a497/users/fcd0a9ec33384c7eaa041f4923ab055d/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:19.677239 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524ef13-6a97-443e-9336-3643c7ea874d admin admin] RBAC: Authorizing `identity:create_grant(project_id=777b19ad46274440bd44eec53428a497, user_id=fcd0a9ec33384c7eaa041f4923ab055d, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:19.680475 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524ef13-6a97-443e-9336-3643c7ea874d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:19.691228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1344/2647] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:50:19 2022] PUT /identity/v3/projects/777b19ad46274440bd44eec53428a497/users/fcd0a9ec33384c7eaa041f4923ab055d/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:19.701475 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea499b36-b2a1-4c52-9cab-9827627e2770 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:19.701710 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea499b36-b2a1-4c52-9cab-9827627e2770 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:19.701988 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea499b36-b2a1-4c52-9cab-9827627e2770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:19.729798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ea499b36-b2a1-4c52-9cab-9827627e2770 None None] MFA Rules not processed for user `fcd0a9ec33384c7eaa041f4923ab055d`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:19.730999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ea499b36-b2a1-4c52-9cab-9827627e2770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:19.744163 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:19.800233 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1304/2648] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:19 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:19.811390 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524ef13-6a97-443e-9336-3643c7ea874d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:19.813723 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1524ef13-6a97-443e-9336-3643c7ea874d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:19.870388 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524ef13-6a97-443e-9336-3643c7ea874d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:19.873978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed7ce7-3046-420d-8f79-0ebe8445283f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:19.874565 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed7ce7-3046-420d-8f79-0ebe8445283f service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:19.875381 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed7ce7-3046-420d-8f79-0ebe8445283f service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:19.875647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed7ce7-3046-420d-8f79-0ebe8445283f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:19.884521 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed7ce7-3046-420d-8f79-0ebe8445283f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:19.885953 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed7ce7-3046-420d-8f79-0ebe8445283f service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:19.895164 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1345/2649] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:50:19 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:50:19.974084 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea499b36-b2a1-4c52-9cab-9827627e2770 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:19.983538 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea499b36-b2a1-4c52-9cab-9827627e2770 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:19.987673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2b304-1aee-4941-9efc-e8817abdb32a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:19.988257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2b304-1aee-4941-9efc-e8817abdb32a service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:19.988533 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2b304-1aee-4941-9efc-e8817abdb32a service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:19.988801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2b304-1aee-4941-9efc-e8817abdb32a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:20.043682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2b304-1aee-4941-9efc-e8817abdb32a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:20.045289 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2b304-1aee-4941-9efc-e8817abdb32a service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:20.054413 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1305/2650] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:50:19 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:50:29.891055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=39,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:30.050441 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=50 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:34.831484 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed7ce7-3046-420d-8f79-0ebe8445283f service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:34.893593 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed7ce7-3046-420d-8f79-0ebe8445283f service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:34.898012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56929e-f80f-4109-8fd8-9c8820fe795b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:34.898633 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56929e-f80f-4109-8fd8-9c8820fe795b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:34.898914 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56929e-f80f-4109-8fd8-9c8820fe795b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:34.899189 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56929e-f80f-4109-8fd8-9c8820fe795b admin admin] PATH_INFO: `/v3/users/e27f982effaf448f9e6284b66a59ddfc` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:34.900303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56929e-f80f-4109-8fd8-9c8820fe795b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e27f982effaf448f9e6284b66a59ddfc)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:34.902246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56929e-f80f-4109-8fd8-9c8820fe795b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:34.947053 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2a56929e-f80f-4109-8fd8-9c8820fe795b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e27f982effaf448f9e6284b66a59ddfc'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:34.954349 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2a56929e-f80f-4109-8fd8-9c8820fe795b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e27f982effaf448f9e6284b66a59ddfc'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:34.954958 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2a56929e-f80f-4109-8fd8-9c8820fe795b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e27f982effaf448f9e6284b66a59ddfc'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:34.955577 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2a56929e-f80f-4109-8fd8-9c8820fe795b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e27f982effaf448f9e6284b66a59ddfc'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:34.965248 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2a56929e-f80f-4109-8fd8-9c8820fe795b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e27f982effaf448f9e6284b66a59ddfc'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:34.982449 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1346/2651] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:50:34 2022] DELETE /identity/v3/users/e27f982effaf448f9e6284b66a59ddfc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:34.987465 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d786d-2a0b-4484-9412-e79144aa6c62 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:34.987932 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d786d-2a0b-4484-9412-e79144aa6c62 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:34.988039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d786d-2a0b-4484-9412-e79144aa6c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:35.008281 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-237d786d-2a0b-4484-9412-e79144aa6c62 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:35.009521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-237d786d-2a0b-4484-9412-e79144aa6c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:35.066595 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1306/2652] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:35.076239 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56929e-f80f-4109-8fd8-9c8820fe795b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:35.077697 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2a56929e-f80f-4109-8fd8-9c8820fe795b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:35.134077 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56929e-f80f-4109-8fd8-9c8820fe795b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:35.137702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3bff0-b40d-41ee-8734-d3aa8a518ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:35.138292 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3bff0-b40d-41ee-8734-d3aa8a518ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:35.138569 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3bff0-b40d-41ee-8734-d3aa8a518ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:35.138840 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3bff0-b40d-41ee-8734-d3aa8a518ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:35.147714 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3bff0-b40d-41ee-8734-d3aa8a518ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:35.149049 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3bff0-b40d-41ee-8734-d3aa8a518ba2 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:35.158328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1347/2653] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:50:35.424802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d786d-2a0b-4484-9412-e79144aa6c62 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:35.426316 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-237d786d-2a0b-4484-9412-e79144aa6c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:35.438821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d786d-2a0b-4484-9412-e79144aa6c62 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:35.443704 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564ccc6-2ad7-4483-95eb-e499b328890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:35.444343 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564ccc6-2ad7-4483-95eb-e499b328890d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:35.444629 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564ccc6-2ad7-4483-95eb-e499b328890d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:35.444904 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564ccc6-2ad7-4483-95eb-e499b328890d admin admin] PATH_INFO: `/v3/projects/69b0569b828e4258ab99b38ebf2027a3` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:35.447208 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564ccc6-2ad7-4483-95eb-e499b328890d admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b0569b828e4258ab99b38ebf2027a3)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:35.449244 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564ccc6-2ad7-4483-95eb-e499b328890d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:35.506189 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6564ccc6-2ad7-4483-95eb-e499b328890d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b0569b828e4258ab99b38ebf2027a3', 'request_id': 'req-6564ccc6-2ad7-4483-95eb-e499b328890d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:35.513971 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6564ccc6-2ad7-4483-95eb-e499b328890d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b0569b828e4258ab99b38ebf2027a3', 'request_id': 'req-6564ccc6-2ad7-4483-95eb-e499b328890d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:35.519755 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6564ccc6-2ad7-4483-95eb-e499b328890d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b0569b828e4258ab99b38ebf2027a3', 'request_id': 'req-6564ccc6-2ad7-4483-95eb-e499b328890d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:35.530721 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6564ccc6-2ad7-4483-95eb-e499b328890d admin admin] The token cache is being invalidate because project 69b0569b828e4258ab99b38ebf2027a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:50:35.531001 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6564ccc6-2ad7-4483-95eb-e499b328890d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:35.532166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6564ccc6-2ad7-4483-95eb-e499b328890d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:35.533672 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1307/2654] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:50:35 2022] DELETE /identity/v3/projects/69b0569b828e4258ab99b38ebf2027a3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:35.537793 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3bff0-b40d-41ee-8734-d3aa8a518ba2 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:35.547938 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3bff0-b40d-41ee-8734-d3aa8a518ba2 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:35.565932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:35.606022 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bab882-af36-4bc0-9f4a-a79257d911f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:35.606649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bab882-af36-4bc0-9f4a-a79257d911f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:35.606932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bab882-af36-4bc0-9f4a-a79257d911f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:35.607209 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bab882-af36-4bc0-9f4a-a79257d911f1 admin admin] PATH_INFO: `/v3/users/fcd0a9ec33384c7eaa041f4923ab055d` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:35.608330 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bab882-af36-4bc0-9f4a-a79257d911f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcd0a9ec33384c7eaa041f4923ab055d)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:35.610979 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bab882-af36-4bc0-9f4a-a79257d911f1 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:35.658062 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-60bab882-af36-4bc0-9f4a-a79257d911f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcd0a9ec33384c7eaa041f4923ab055d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:35.670768 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-60bab882-af36-4bc0-9f4a-a79257d911f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcd0a9ec33384c7eaa041f4923ab055d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:35.671593 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-60bab882-af36-4bc0-9f4a-a79257d911f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcd0a9ec33384c7eaa041f4923ab055d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:35.672821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-60bab882-af36-4bc0-9f4a-a79257d911f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcd0a9ec33384c7eaa041f4923ab055d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:35.680246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-60bab882-af36-4bc0-9f4a-a79257d911f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcd0a9ec33384c7eaa041f4923ab055d'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:35.698775 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1348/2655] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:50:35 2022] DELETE /identity/v3/users/fcd0a9ec33384c7eaa041f4923ab055d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:36.249998 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564ccc6-2ad7-4483-95eb-e499b328890d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:36.251641 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6564ccc6-2ad7-4483-95eb-e499b328890d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:36.267161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564ccc6-2ad7-4483-95eb-e499b328890d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:36.325570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7a58c-a926-4aa4-9278-723cdb131919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:36.326206 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7a58c-a926-4aa4-9278-723cdb131919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:36.326483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7a58c-a926-4aa4-9278-723cdb131919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:36.326756 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7a58c-a926-4aa4-9278-723cdb131919 admin admin] PATH_INFO: `/v3/projects/777b19ad46274440bd44eec53428a497` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:36.327884 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7a58c-a926-4aa4-9278-723cdb131919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=777b19ad46274440bd44eec53428a497)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:36.329900 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7a58c-a926-4aa4-9278-723cdb131919 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:36.361666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:36.379137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-21b7a58c-a926-4aa4-9278-723cdb131919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '777b19ad46274440bd44eec53428a497', 'request_id': 'req-21b7a58c-a926-4aa4-9278-723cdb131919'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:36.385742 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-21b7a58c-a926-4aa4-9278-723cdb131919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '777b19ad46274440bd44eec53428a497', 'request_id': 'req-21b7a58c-a926-4aa4-9278-723cdb131919'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:36.391389 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-21b7a58c-a926-4aa4-9278-723cdb131919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '777b19ad46274440bd44eec53428a497', 'request_id': 'req-21b7a58c-a926-4aa4-9278-723cdb131919'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:36.402398 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-21b7a58c-a926-4aa4-9278-723cdb131919 admin admin] The token cache is being invalidate because project 777b19ad46274440bd44eec53428a497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:50:36.402666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-21b7a58c-a926-4aa4-9278-723cdb131919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:36.403330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-21b7a58c-a926-4aa4-9278-723cdb131919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:36.404838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1308/2656] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:50:36 2022] DELETE /identity/v3/projects/777b19ad46274440bd44eec53428a497 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:36.410224 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8ae95-6c63-4fc1-85b1-991e412af54f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:36.410847 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8ae95-6c63-4fc1-85b1-991e412af54f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:36.410847 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8ae95-6c63-4fc1-85b1-991e412af54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:36.430839 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-10c8ae95-6c63-4fc1-85b1-991e412af54f None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:36.432077 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-10c8ae95-6c63-4fc1-85b1-991e412af54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:36.492298 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1349/2657] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:36.503223 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3dd06-023f-47f6-b21a-27d79acf512c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:36.503506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3dd06-023f-47f6-b21a-27d79acf512c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:36.503779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3dd06-023f-47f6-b21a-27d79acf512c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:36.524798 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1ac3dd06-023f-47f6-b21a-27d79acf512c None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:36.526034 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1ac3dd06-023f-47f6-b21a-27d79acf512c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:36.534542 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1309/2658] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:36.539438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8ae95-6c63-4fc1-85b1-991e412af54f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:36.551229 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8ae95-6c63-4fc1-85b1-991e412af54f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:36.555833 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8ed33-bf51-4869-bac5-72b5e6825e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:36.556430 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8ed33-bf51-4869-bac5-72b5e6825e2d admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:36.556710 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8ed33-bf51-4869-bac5-72b5e6825e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:36.556980 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8ed33-bf51-4869-bac5-72b5e6825e2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:36.557650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8ed33-bf51-4869-bac5-72b5e6825e2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:50:36.557955 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8ed33-bf51-4869-bac5-72b5e6825e2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:36.559537 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8ed33-bf51-4869-bac5-72b5e6825e2d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:36.573194 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1350/2659] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:50:36.577521 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3dd06-023f-47f6-b21a-27d79acf512c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:36.587477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3dd06-023f-47f6-b21a-27d79acf512c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:36.592115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca0832-94e7-436d-933e-c514bb6fba5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:36.592699 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca0832-94e7-436d-933e-c514bb6fba5d admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:36.592972 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca0832-94e7-436d-933e-c514bb6fba5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:36.593274 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca0832-94e7-436d-933e-c514bb6fba5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:36.593931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca0832-94e7-436d-933e-c514bb6fba5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:36.596320 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca0832-94e7-436d-933e-c514bb6fba5d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:36.624083 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1310/2660] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:50:36 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:50:36.628254 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8ed33-bf51-4869-bac5-72b5e6825e2d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:36.638196 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8ed33-bf51-4869-bac5-72b5e6825e2d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:36.666597 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:36.700421 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e4271-01b6-4e7d-b27b-37aec30baf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:36.701053 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e4271-01b6-4e7d-b27b-37aec30baf9a admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:36.701364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e4271-01b6-4e7d-b27b-37aec30baf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:36.701638 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e4271-01b6-4e7d-b27b-37aec30baf9a admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:36.702283 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e4271-01b6-4e7d-b27b-37aec30baf9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:36.704733 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e4271-01b6-4e7d-b27b-37aec30baf9a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:36.726264 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1351/2661] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:50:36 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:50:36.730341 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca0832-94e7-436d-933e-c514bb6fba5d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:36.740369 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca0832-94e7-436d-933e-c514bb6fba5d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:36.744941 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825d261-9926-451f-a7a7-51162c3994da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:36.745497 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825d261-9926-451f-a7a7-51162c3994da admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:36.745774 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825d261-9926-451f-a7a7-51162c3994da admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:36.746043 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825d261-9926-451f-a7a7-51162c3994da admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:36.746675 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825d261-9926-451f-a7a7-51162c3994da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:36.748256 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825d261-9926-451f-a7a7-51162c3994da admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:36.758036 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1311/2662] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:50:36.761877 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e4271-01b6-4e7d-b27b-37aec30baf9a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:36.772287 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e4271-01b6-4e7d-b27b-37aec30baf9a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:36.776912 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16899dc2-165e-47d1-ad88-6abf795c6977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:36.777540 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16899dc2-165e-47d1-ad88-6abf795c6977 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:36.777825 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16899dc2-165e-47d1-ad88-6abf795c6977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:36.778100 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16899dc2-165e-47d1-ad88-6abf795c6977 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:36.778740 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16899dc2-165e-47d1-ad88-6abf795c6977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:36.780764 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16899dc2-165e-47d1-ad88-6abf795c6977 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:36.792082 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1352/2663] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:50:36.796150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825d261-9926-451f-a7a7-51162c3994da admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:36.806139 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825d261-9926-451f-a7a7-51162c3994da admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:36.810723 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940149d2-aa1c-48ac-8de3-39640d51aa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:36.811360 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940149d2-aa1c-48ac-8de3-39640d51aa80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:36.811640 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940149d2-aa1c-48ac-8de3-39640d51aa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:36.811915 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940149d2-aa1c-48ac-8de3-39640d51aa80 admin admin] PATH_INFO: `/v3/projects/d0e1f570eedd4c66aff76366fb3e2ede/users/58fa94c9d91e4ed78d80b2b740b88410/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:36.826542 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940149d2-aa1c-48ac-8de3-39640d51aa80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0e1f570eedd4c66aff76366fb3e2ede, user_id=58fa94c9d91e4ed78d80b2b740b88410, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:36.829806 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940149d2-aa1c-48ac-8de3-39640d51aa80 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:36.842538 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1312/2664] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:50:36 2022] PUT /identity/v3/projects/d0e1f570eedd4c66aff76366fb3e2ede/users/58fa94c9d91e4ed78d80b2b740b88410/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:36.852937 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dce904-7884-403c-9f1b-a803fb12f26a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:36.853266 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dce904-7884-403c-9f1b-a803fb12f26a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:36.853543 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dce904-7884-403c-9f1b-a803fb12f26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:36.883611 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-33dce904-7884-403c-9f1b-a803fb12f26a None None] MFA Rules not processed for user `58fa94c9d91e4ed78d80b2b740b88410`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:36.884806 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-33dce904-7884-403c-9f1b-a803fb12f26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:36.946276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1353/2665] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:36.950803 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940149d2-aa1c-48ac-8de3-39640d51aa80 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:37.011965 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940149d2-aa1c-48ac-8de3-39640d51aa80 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:37.017105 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9b38e-d8e9-47aa-86b4-5cebd50e9b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:37.017709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9b38e-d8e9-47aa-86b4-5cebd50e9b82 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:37.017987 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9b38e-d8e9-47aa-86b4-5cebd50e9b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:37.018259 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9b38e-d8e9-47aa-86b4-5cebd50e9b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:37.018881 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9b38e-d8e9-47aa-86b4-5cebd50e9b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:37.020781 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9b38e-d8e9-47aa-86b4-5cebd50e9b82 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:37.047022 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1313/2666] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:50:36 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:50:37.051183 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dce904-7884-403c-9f1b-a803fb12f26a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:37.061611 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dce904-7884-403c-9f1b-a803fb12f26a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:37.117855 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223d7b0-6d12-4bfb-9320-3e80bb030dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:37.118454 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223d7b0-6d12-4bfb-9320-3e80bb030dae admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:37.118735 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223d7b0-6d12-4bfb-9320-3e80bb030dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:37.119012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223d7b0-6d12-4bfb-9320-3e80bb030dae admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:37.119639 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223d7b0-6d12-4bfb-9320-3e80bb030dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:37.121582 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223d7b0-6d12-4bfb-9320-3e80bb030dae admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:37.143097 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1354/2667] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:50:37 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:50:37.147121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9b38e-d8e9-47aa-86b4-5cebd50e9b82 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:37.157442 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9b38e-d8e9-47aa-86b4-5cebd50e9b82 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:37.161873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77a5fd-b44d-4074-9bd3-59961f63907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:37.162460 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77a5fd-b44d-4074-9bd3-59961f63907f admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:37.162739 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77a5fd-b44d-4074-9bd3-59961f63907f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:37.163004 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77a5fd-b44d-4074-9bd3-59961f63907f admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:37.163629 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77a5fd-b44d-4074-9bd3-59961f63907f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:37.165271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77a5fd-b44d-4074-9bd3-59961f63907f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:37.175570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1314/2668] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:50:37.179526 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223d7b0-6d12-4bfb-9320-3e80bb030dae admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:37.189689 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223d7b0-6d12-4bfb-9320-3e80bb030dae admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:37.194490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69d417-094d-479e-8297-3061bd225cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:37.195139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69d417-094d-479e-8297-3061bd225cff admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:37.195423 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69d417-094d-479e-8297-3061bd225cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:37.195699 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69d417-094d-479e-8297-3061bd225cff admin admin] PATH_INFO: `/v3/projects/2d0518c7365a45798dbd557f0f262228/users/51e3e5742a404b7d913f7c31e867324e/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:37.211897 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69d417-094d-479e-8297-3061bd225cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d0518c7365a45798dbd557f0f262228, user_id=51e3e5742a404b7d913f7c31e867324e, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:37.214619 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69d417-094d-479e-8297-3061bd225cff admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:37.227346 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1355/2669] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:50:37 2022] PUT /identity/v3/projects/2d0518c7365a45798dbd557f0f262228/users/51e3e5742a404b7d913f7c31e867324e/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:50:37.231446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77a5fd-b44d-4074-9bd3-59961f63907f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:37.242074 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77a5fd-b44d-4074-9bd3-59961f63907f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:37.262736 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:37.300950 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5ae21-aff4-479f-8fc0-bea687ddc37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:37.301587 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5ae21-aff4-479f-8fc0-bea687ddc37c admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:37.301864 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5ae21-aff4-479f-8fc0-bea687ddc37c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:37.302137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5ae21-aff4-479f-8fc0-bea687ddc37c admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:37.302772 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5ae21-aff4-479f-8fc0-bea687ddc37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:37.304361 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5ae21-aff4-479f-8fc0-bea687ddc37c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:37.315211 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1315/2670] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 00:50:37.319321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69d417-094d-479e-8297-3061bd225cff admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:37.324714 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:37.330498 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69d417-094d-479e-8297-3061bd225cff admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:37.336998 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb896a81-34cd-4395-b320-c9fcd0d6daed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:37.337693 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb896a81-34cd-4395-b320-c9fcd0d6daed admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:37.337978 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb896a81-34cd-4395-b320-c9fcd0d6daed admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:37.338251 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb896a81-34cd-4395-b320-c9fcd0d6daed admin admin] PATH_INFO: `/v3/projects/2d0518c7365a45798dbd557f0f262228/users/51e3e5742a404b7d913f7c31e867324e/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:37.340321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb896a81-34cd-4395-b320-c9fcd0d6daed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d0518c7365a45798dbd557f0f262228, user_id=51e3e5742a404b7d913f7c31e867324e, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:37.342998 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb896a81-34cd-4395-b320-c9fcd0d6daed admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:37.353829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1356/2671] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:50:37 2022] PUT /identity/v3/projects/2d0518c7365a45798dbd557f0f262228/users/51e3e5742a404b7d913f7c31e867324e/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:37.364721 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f9660-a5ce-4d32-bc96-ecebfddae6ad None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:37.365006 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f9660-a5ce-4d32-bc96-ecebfddae6ad None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:37.365305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f9660-a5ce-4d32-bc96-ecebfddae6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:37.394921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-716f9660-a5ce-4d32-bc96-ecebfddae6ad None None] MFA Rules not processed for user `51e3e5742a404b7d913f7c31e867324e`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:37.396138 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-716f9660-a5ce-4d32-bc96-ecebfddae6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:37.467971 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1316/2672] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:37.478804 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb896a81-34cd-4395-b320-c9fcd0d6daed admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:37.480653 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-bb896a81-34cd-4395-b320-c9fcd0d6daed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:37.542152 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb896a81-34cd-4395-b320-c9fcd0d6daed admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:37.545690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ae20c-a27d-4abb-9eef-c5ffbd586f2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:37.546292 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ae20c-a27d-4abb-9eef-c5ffbd586f2f service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:37.546567 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ae20c-a27d-4abb-9eef-c5ffbd586f2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:37.546833 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ae20c-a27d-4abb-9eef-c5ffbd586f2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:37.557281 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ae20c-a27d-4abb-9eef-c5ffbd586f2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:37.558697 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ae20c-a27d-4abb-9eef-c5ffbd586f2f service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:37.569080 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1357/2673] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:50:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:50:39.035389 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f9660-a5ce-4d32-bc96-ecebfddae6ad None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:39.102913 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f9660-a5ce-4d32-bc96-ecebfddae6ad None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:39.107501 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce1a2d-91cf-4b7b-989e-ef731c66bd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:39.108377 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce1a2d-91cf-4b7b-989e-ef731c66bd34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:39.108713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce1a2d-91cf-4b7b-989e-ef731c66bd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:39.109055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce1a2d-91cf-4b7b-989e-ef731c66bd34 admin admin] PATH_INFO: `/v3/users/58fa94c9d91e4ed78d80b2b740b88410` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:39.110947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce1a2d-91cf-4b7b-989e-ef731c66bd34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58fa94c9d91e4ed78d80b2b740b88410)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:39.112966 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce1a2d-91cf-4b7b-989e-ef731c66bd34 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:39.171567 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e0ce1a2d-91cf-4b7b-989e-ef731c66bd34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58fa94c9d91e4ed78d80b2b740b88410'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:39.174310 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:39.181623 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e0ce1a2d-91cf-4b7b-989e-ef731c66bd34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58fa94c9d91e4ed78d80b2b740b88410'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:39.182507 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e0ce1a2d-91cf-4b7b-989e-ef731c66bd34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58fa94c9d91e4ed78d80b2b740b88410'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:39.183177 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e0ce1a2d-91cf-4b7b-989e-ef731c66bd34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58fa94c9d91e4ed78d80b2b740b88410'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:39.191106 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-e0ce1a2d-91cf-4b7b-989e-ef731c66bd34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58fa94c9d91e4ed78d80b2b740b88410'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:39.209079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1317/2674] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:50:39 2022] DELETE /identity/v3/users/58fa94c9d91e4ed78d80b2b740b88410 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:39.214024 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0594df-8fd6-407b-b9af-04f618c5f317 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:39.214521 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0594df-8fd6-407b-b9af-04f618c5f317 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:39.214607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0594df-8fd6-407b-b9af-04f618c5f317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:39.235419 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2b0594df-8fd6-407b-b9af-04f618c5f317 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:39.236630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2b0594df-8fd6-407b-b9af-04f618c5f317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:39.297593 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1358/2675] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:39.308083 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce1a2d-91cf-4b7b-989e-ef731c66bd34 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:39.309545 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e0ce1a2d-91cf-4b7b-989e-ef731c66bd34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:39.375033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce1a2d-91cf-4b7b-989e-ef731c66bd34 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:39.378673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19bf60-88fa-45c7-a437-1ee8d04fc6c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:39.379301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19bf60-88fa-45c7-a437-1ee8d04fc6c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:39.379576 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19bf60-88fa-45c7-a437-1ee8d04fc6c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:39.379843 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19bf60-88fa-45c7-a437-1ee8d04fc6c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:39.389019 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19bf60-88fa-45c7-a437-1ee8d04fc6c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:39.390482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19bf60-88fa-45c7-a437-1ee8d04fc6c7 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:39.399885 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1318/2676] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:50:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:50:39.694950 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0594df-8fd6-407b-b9af-04f618c5f317 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:39.696545 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2b0594df-8fd6-407b-b9af-04f618c5f317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:39.709276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0594df-8fd6-407b-b9af-04f618c5f317 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:39.714277 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1340e4b-b732-49a4-bb16-35fdc40d20e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:39.715045 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1340e4b-b732-49a4-bb16-35fdc40d20e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:39.715394 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1340e4b-b732-49a4-bb16-35fdc40d20e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:39.716733 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1340e4b-b732-49a4-bb16-35fdc40d20e5 admin admin] PATH_INFO: `/v3/projects/d0e1f570eedd4c66aff76366fb3e2ede` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:39.718376 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1340e4b-b732-49a4-bb16-35fdc40d20e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0e1f570eedd4c66aff76366fb3e2ede)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:39.721198 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1340e4b-b732-49a4-bb16-35fdc40d20e5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:39.773867 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f1340e4b-b732-49a4-bb16-35fdc40d20e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0e1f570eedd4c66aff76366fb3e2ede', 'request_id': 'req-f1340e4b-b732-49a4-bb16-35fdc40d20e5'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:39.779515 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f1340e4b-b732-49a4-bb16-35fdc40d20e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0e1f570eedd4c66aff76366fb3e2ede', 'request_id': 'req-f1340e4b-b732-49a4-bb16-35fdc40d20e5'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:39.787700 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f1340e4b-b732-49a4-bb16-35fdc40d20e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0e1f570eedd4c66aff76366fb3e2ede', 'request_id': 'req-f1340e4b-b732-49a4-bb16-35fdc40d20e5'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:39.799507 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f1340e4b-b732-49a4-bb16-35fdc40d20e5 admin admin] The token cache is being invalidate because project d0e1f570eedd4c66aff76366fb3e2ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:50:39.799796 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f1340e4b-b732-49a4-bb16-35fdc40d20e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:39.800430 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f1340e4b-b732-49a4-bb16-35fdc40d20e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:39.801954 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1359/2677] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:50:39 2022] DELETE /identity/v3/projects/d0e1f570eedd4c66aff76366fb3e2ede => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:39.805916 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19bf60-88fa-45c7-a437-1ee8d04fc6c7 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:39.817626 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19bf60-88fa-45c7-a437-1ee8d04fc6c7 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:39.880337 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fefda0-3c03-47ec-b55f-456187c3df17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:39.880961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fefda0-3c03-47ec-b55f-456187c3df17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:39.881268 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fefda0-3c03-47ec-b55f-456187c3df17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:39.881539 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fefda0-3c03-47ec-b55f-456187c3df17 admin admin] PATH_INFO: `/v3/users/51e3e5742a404b7d913f7c31e867324e` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:39.882648 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fefda0-3c03-47ec-b55f-456187c3df17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51e3e5742a404b7d913f7c31e867324e)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:39.884570 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fefda0-3c03-47ec-b55f-456187c3df17 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:39.932222 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-52fefda0-3c03-47ec-b55f-456187c3df17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51e3e5742a404b7d913f7c31e867324e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:39.940547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-52fefda0-3c03-47ec-b55f-456187c3df17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51e3e5742a404b7d913f7c31e867324e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:39.941188 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-52fefda0-3c03-47ec-b55f-456187c3df17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51e3e5742a404b7d913f7c31e867324e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:39.941784 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-52fefda0-3c03-47ec-b55f-456187c3df17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51e3e5742a404b7d913f7c31e867324e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:39.948957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-52fefda0-3c03-47ec-b55f-456187c3df17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51e3e5742a404b7d913f7c31e867324e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:39.955306 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:39.970281 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1319/2678] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:50:39 2022] DELETE /identity/v3/users/51e3e5742a404b7d913f7c31e867324e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:40.414040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1340e4b-b732-49a4-bb16-35fdc40d20e5 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:40.415561 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f1340e4b-b732-49a4-bb16-35fdc40d20e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:40.447622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1340e4b-b732-49a4-bb16-35fdc40d20e5 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:40.465243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:40.517076 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7ec21-892a-4883-9fb8-e74a06b4411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:40.517620 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7ec21-892a-4883-9fb8-e74a06b4411b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:40.517895 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7ec21-892a-4883-9fb8-e74a06b4411b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:40.518165 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7ec21-892a-4883-9fb8-e74a06b4411b admin admin] PATH_INFO: `/v3/projects/2d0518c7365a45798dbd557f0f262228` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:40.519314 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7ec21-892a-4883-9fb8-e74a06b4411b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d0518c7365a45798dbd557f0f262228)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:40.521243 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7ec21-892a-4883-9fb8-e74a06b4411b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:40.573422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0eb7ec21-892a-4883-9fb8-e74a06b4411b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d0518c7365a45798dbd557f0f262228', 'request_id': 'req-0eb7ec21-892a-4883-9fb8-e74a06b4411b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:40.579398 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0eb7ec21-892a-4883-9fb8-e74a06b4411b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d0518c7365a45798dbd557f0f262228', 'request_id': 'req-0eb7ec21-892a-4883-9fb8-e74a06b4411b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:40.586473 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0eb7ec21-892a-4883-9fb8-e74a06b4411b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d0518c7365a45798dbd557f0f262228', 'request_id': 'req-0eb7ec21-892a-4883-9fb8-e74a06b4411b'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:40.597827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0eb7ec21-892a-4883-9fb8-e74a06b4411b admin admin] The token cache is being invalidate because project 2d0518c7365a45798dbd557f0f262228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:50:40.598116 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0eb7ec21-892a-4883-9fb8-e74a06b4411b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:40.598739 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0eb7ec21-892a-4883-9fb8-e74a06b4411b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:40.600203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1360/2679] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:50:40 2022] DELETE /identity/v3/projects/2d0518c7365a45798dbd557f0f262228 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:40.605071 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406eb4d-9fe2-4b10-abaf-6fc957b642ed None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:40.605545 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406eb4d-9fe2-4b10-abaf-6fc957b642ed None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:40.605656 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406eb4d-9fe2-4b10-abaf-6fc957b642ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:40.624694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-2406eb4d-9fe2-4b10-abaf-6fc957b642ed None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:40.626468 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2406eb4d-9fe2-4b10-abaf-6fc957b642ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:40.687141 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1320/2680] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:40.696369 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d69c3f-5b2b-40b8-9a6f-08bcb72d2ad9 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:40.696597 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d69c3f-5b2b-40b8-9a6f-08bcb72d2ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:40.696872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d69c3f-5b2b-40b8-9a6f-08bcb72d2ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:40.717304 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-22d69c3f-5b2b-40b8-9a6f-08bcb72d2ad9 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:40.718514 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-22d69c3f-5b2b-40b8-9a6f-08bcb72d2ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:40.726530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1361/2681] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:40.730683 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406eb4d-9fe2-4b10-abaf-6fc957b642ed None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:40.740261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406eb4d-9fe2-4b10-abaf-6fc957b642ed None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:40.745110 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6936a-0753-4937-91a2-fe68d3ef4081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:40.745740 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6936a-0753-4937-91a2-fe68d3ef4081 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:40.745998 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6936a-0753-4937-91a2-fe68d3ef4081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:40.746269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6936a-0753-4937-91a2-fe68d3ef4081 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:40.746914 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6936a-0753-4937-91a2-fe68d3ef4081 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:50:40.747214 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6936a-0753-4937-91a2-fe68d3ef4081 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:40.749289 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6936a-0753-4937-91a2-fe68d3ef4081 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:40.763030 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1321/2682] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:50:40.768586 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d69c3f-5b2b-40b8-9a6f-08bcb72d2ad9 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:40.777862 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d69c3f-5b2b-40b8-9a6f-08bcb72d2ad9 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:40.782636 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09401d93-7196-4454-b7d5-4075ad9dd4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:40.783230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09401d93-7196-4454-b7d5-4075ad9dd4fd admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:40.783559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09401d93-7196-4454-b7d5-4075ad9dd4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:40.783880 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09401d93-7196-4454-b7d5-4075ad9dd4fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:40.784512 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09401d93-7196-4454-b7d5-4075ad9dd4fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:40.786446 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09401d93-7196-4454-b7d5-4075ad9dd4fd admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:40.813487 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1362/2683] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:50:40 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:50:40.817611 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6936a-0753-4937-91a2-fe68d3ef4081 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:40.827334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6936a-0753-4937-91a2-fe68d3ef4081 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:40.882698 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94069d-2766-4cc6-8829-9e4319f75b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:40.883406 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94069d-2766-4cc6-8829-9e4319f75b17 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:40.883717 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94069d-2766-4cc6-8829-9e4319f75b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:40.884016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94069d-2766-4cc6-8829-9e4319f75b17 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:40.884648 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94069d-2766-4cc6-8829-9e4319f75b17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:40.886632 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94069d-2766-4cc6-8829-9e4319f75b17 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:40.907684 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1322/2684] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:50:40 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:50:40.911807 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09401d93-7196-4454-b7d5-4075ad9dd4fd admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:40.922129 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09401d93-7196-4454-b7d5-4075ad9dd4fd admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:40.926728 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac537c-c6e3-4c12-bd50-20bc7273a66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:40.927320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac537c-c6e3-4c12-bd50-20bc7273a66a admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:40.927604 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac537c-c6e3-4c12-bd50-20bc7273a66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:40.927878 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac537c-c6e3-4c12-bd50-20bc7273a66a admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:40.928514 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac537c-c6e3-4c12-bd50-20bc7273a66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:40.930124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac537c-c6e3-4c12-bd50-20bc7273a66a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:40.940335 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1363/2685] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:50:40.944171 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94069d-2766-4cc6-8829-9e4319f75b17 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:40.954599 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94069d-2766-4cc6-8829-9e4319f75b17 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:40.958999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f725a8-7818-49c6-9bb0-e818abf9c1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:40.959579 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f725a8-7818-49c6-9bb0-e818abf9c1bc admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:40.960109 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f725a8-7818-49c6-9bb0-e818abf9c1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:40.960380 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f725a8-7818-49c6-9bb0-e818abf9c1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:40.961008 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f725a8-7818-49c6-9bb0-e818abf9c1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:40.962649 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f725a8-7818-49c6-9bb0-e818abf9c1bc admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:40.972832 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1323/2686] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:50:40.976670 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac537c-c6e3-4c12-bd50-20bc7273a66a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:40.986976 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac537c-c6e3-4c12-bd50-20bc7273a66a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:40.991550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfa3b6-235a-4b0c-817f-d7c7b2483ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:40.992184 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfa3b6-235a-4b0c-817f-d7c7b2483ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:40.992466 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfa3b6-235a-4b0c-817f-d7c7b2483ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:40.992742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfa3b6-235a-4b0c-817f-d7c7b2483ea2 admin admin] PATH_INFO: `/v3/projects/be1f890a2ef44959868e49bb949dc727/users/e435230aecdc48d8948db35ae519f3dd/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:41.010281 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfa3b6-235a-4b0c-817f-d7c7b2483ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1f890a2ef44959868e49bb949dc727, user_id=e435230aecdc48d8948db35ae519f3dd, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:41.012949 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfa3b6-235a-4b0c-817f-d7c7b2483ea2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:41.025442 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1364/2687] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:50:40 2022] PUT /identity/v3/projects/be1f890a2ef44959868e49bb949dc727/users/e435230aecdc48d8948db35ae519f3dd/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:41.035596 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3a5c3-1aa4-4a34-84b8-e12810f70b30 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:41.035879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3a5c3-1aa4-4a34-84b8-e12810f70b30 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:41.036149 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3a5c3-1aa4-4a34-84b8-e12810f70b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:41.063770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-50e3a5c3-1aa4-4a34-84b8-e12810f70b30 None None] MFA Rules not processed for user `e435230aecdc48d8948db35ae519f3dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:41.064943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-50e3a5c3-1aa4-4a34-84b8-e12810f70b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:41.104775 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:41.128237 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1324/2688] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:41.132731 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfa3b6-235a-4b0c-817f-d7c7b2483ea2 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:41.176784 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:41.194788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfa3b6-235a-4b0c-817f-d7c7b2483ea2 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:41.199342 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351d3da-2956-48be-9fe0-10a9f727db78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:41.199933 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351d3da-2956-48be-9fe0-10a9f727db78 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:41.200211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351d3da-2956-48be-9fe0-10a9f727db78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:41.200482 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351d3da-2956-48be-9fe0-10a9f727db78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:41.201134 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351d3da-2956-48be-9fe0-10a9f727db78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:41.203050 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351d3da-2956-48be-9fe0-10a9f727db78 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:41.227928 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1365/2689] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:50:41 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:50:41.232011 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3a5c3-1aa4-4a34-84b8-e12810f70b30 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:41.243017 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3a5c3-1aa4-4a34-84b8-e12810f70b30 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:41.299381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3b59e-c63d-4409-938e-9253408f4bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:41.299989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3b59e-c63d-4409-938e-9253408f4bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:41.300267 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3b59e-c63d-4409-938e-9253408f4bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:41.300541 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3b59e-c63d-4409-938e-9253408f4bc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:41.301219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3b59e-c63d-4409-938e-9253408f4bc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:41.303132 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3b59e-c63d-4409-938e-9253408f4bc2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:41.324054 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1325/2690] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:50:41 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:50:41.328121 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351d3da-2956-48be-9fe0-10a9f727db78 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:41.338609 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351d3da-2956-48be-9fe0-10a9f727db78 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:41.343248 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd537f-5bd7-423a-ab78-8e8cd81ab499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:41.344349 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd537f-5bd7-423a-ab78-8e8cd81ab499 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:41.344681 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd537f-5bd7-423a-ab78-8e8cd81ab499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:41.344958 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd537f-5bd7-423a-ab78-8e8cd81ab499 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:41.345698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd537f-5bd7-423a-ab78-8e8cd81ab499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:41.347303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd537f-5bd7-423a-ab78-8e8cd81ab499 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:41.358137 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1366/2691] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:50:41.362872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3b59e-c63d-4409-938e-9253408f4bc2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:41.372677 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3b59e-c63d-4409-938e-9253408f4bc2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:41.377222 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8270dae-fcc1-4c5f-8c47-3c42bc2e092d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:41.377854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8270dae-fcc1-4c5f-8c47-3c42bc2e092d admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:41.378129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8270dae-fcc1-4c5f-8c47-3c42bc2e092d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:41.378395 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8270dae-fcc1-4c5f-8c47-3c42bc2e092d admin admin] PATH_INFO: `/v3/projects/066d39e5e1be49e0ad67e27523bbf629/users/393dcb340fb1459ebedf947e537cb52a/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:41.393753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8270dae-fcc1-4c5f-8c47-3c42bc2e092d admin admin] RBAC: Authorizing `identity:create_grant(project_id=066d39e5e1be49e0ad67e27523bbf629, user_id=393dcb340fb1459ebedf947e537cb52a, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:41.396946 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8270dae-fcc1-4c5f-8c47-3c42bc2e092d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:41.410876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1326/2692] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:50:41 2022] PUT /identity/v3/projects/066d39e5e1be49e0ad67e27523bbf629/users/393dcb340fb1459ebedf947e537cb52a/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:41.414870 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd537f-5bd7-423a-ab78-8e8cd81ab499 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:41.425353 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd537f-5bd7-423a-ab78-8e8cd81ab499 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:41.480430 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7851684-e224-425e-8883-9c244873f9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:41.480964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7851684-e224-425e-8883-9c244873f9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:41.481273 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7851684-e224-425e-8883-9c244873f9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:41.481587 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7851684-e224-425e-8883-9c244873f9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:41.482224 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7851684-e224-425e-8883-9c244873f9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:41.484003 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7851684-e224-425e-8883-9c244873f9b3 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:41.494234 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1367/2693] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:50:41.498430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8270dae-fcc1-4c5f-8c47-3c42bc2e092d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:41.508498 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8270dae-fcc1-4c5f-8c47-3c42bc2e092d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:41.513009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56949dda-44a7-432e-aa96-33e89cad6a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:41.513689 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56949dda-44a7-432e-aa96-33e89cad6a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:41.513966 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56949dda-44a7-432e-aa96-33e89cad6a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:41.514239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56949dda-44a7-432e-aa96-33e89cad6a4a admin admin] PATH_INFO: `/v3/projects/066d39e5e1be49e0ad67e27523bbf629/users/393dcb340fb1459ebedf947e537cb52a/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:41.516243 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56949dda-44a7-432e-aa96-33e89cad6a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=066d39e5e1be49e0ad67e27523bbf629, user_id=393dcb340fb1459ebedf947e537cb52a, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:41.518928 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56949dda-44a7-432e-aa96-33e89cad6a4a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:41.528794 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1327/2694] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:50:41 2022] PUT /identity/v3/projects/066d39e5e1be49e0ad67e27523bbf629/users/393dcb340fb1459ebedf947e537cb52a/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:41.540130 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d60333-ed09-4173-9d09-586c2b414373 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:41.540413 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d60333-ed09-4173-9d09-586c2b414373 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:41.540714 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d60333-ed09-4173-9d09-586c2b414373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:41.571206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-58d60333-ed09-4173-9d09-586c2b414373 None None] MFA Rules not processed for user `393dcb340fb1459ebedf947e537cb52a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:41.572530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-58d60333-ed09-4173-9d09-586c2b414373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:41.652202 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1368/2695] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:41.664765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56949dda-44a7-432e-aa96-33e89cad6a4a admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:41.666479 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-56949dda-44a7-432e-aa96-33e89cad6a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:41.728343 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56949dda-44a7-432e-aa96-33e89cad6a4a admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:41.732461 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f3417-f963-4e8c-b954-5bec33589248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:41.733052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f3417-f963-4e8c-b954-5bec33589248 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:41.733360 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f3417-f963-4e8c-b954-5bec33589248 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:41.733632 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f3417-f963-4e8c-b954-5bec33589248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:41.743311 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f3417-f963-4e8c-b954-5bec33589248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:41.744802 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f3417-f963-4e8c-b954-5bec33589248 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:41.757171 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1328/2696] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:50:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:50:41.823136 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d60333-ed09-4173-9d09-586c2b414373 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:41.866222 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:41.888390 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d60333-ed09-4173-9d09-586c2b414373 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:41.893521 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655f6e2-3d05-4a34-97da-8364c1dd9f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:41.894147 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655f6e2-3d05-4a34-97da-8364c1dd9f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:41.894426 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655f6e2-3d05-4a34-97da-8364c1dd9f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:41.894698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655f6e2-3d05-4a34-97da-8364c1dd9f31 admin admin] PATH_INFO: `/v3/users/e435230aecdc48d8948db35ae519f3dd` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:41.895868 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655f6e2-3d05-4a34-97da-8364c1dd9f31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e435230aecdc48d8948db35ae519f3dd)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:41.897801 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655f6e2-3d05-4a34-97da-8364c1dd9f31 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:41.943137 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-b655f6e2-3d05-4a34-97da-8364c1dd9f31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e435230aecdc48d8948db35ae519f3dd'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:41.949970 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-b655f6e2-3d05-4a34-97da-8364c1dd9f31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e435230aecdc48d8948db35ae519f3dd'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:41.950578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-b655f6e2-3d05-4a34-97da-8364c1dd9f31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e435230aecdc48d8948db35ae519f3dd'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:41.951185 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-b655f6e2-3d05-4a34-97da-8364c1dd9f31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e435230aecdc48d8948db35ae519f3dd'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:41.958756 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-b655f6e2-3d05-4a34-97da-8364c1dd9f31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e435230aecdc48d8948db35ae519f3dd'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:41.977001 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1369/2697] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:50:41 2022] DELETE /identity/v3/users/e435230aecdc48d8948db35ae519f3dd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:41.981870 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce129e9-52d7-43d1-b7c0-ffe778885f0a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:41.982182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce129e9-52d7-43d1-b7c0-ffe778885f0a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:41.982643 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce129e9-52d7-43d1-b7c0-ffe778885f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:42.000976 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-6ce129e9-52d7-43d1-b7c0-ffe778885f0a None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:42.002201 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6ce129e9-52d7-43d1-b7c0-ffe778885f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:42.037230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:42.064913 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1329/2698] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:42.074558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655f6e2-3d05-4a34-97da-8364c1dd9f31 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:42.075968 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b655f6e2-3d05-4a34-97da-8364c1dd9f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:42.132574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655f6e2-3d05-4a34-97da-8364c1dd9f31 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:42.136221 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad476f1b-6cab-47d0-9b58-e82dcefab11b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:42.136901 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad476f1b-6cab-47d0-9b58-e82dcefab11b service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:42.137220 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad476f1b-6cab-47d0-9b58-e82dcefab11b service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:42.137490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad476f1b-6cab-47d0-9b58-e82dcefab11b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:42.147033 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad476f1b-6cab-47d0-9b58-e82dcefab11b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:42.148436 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad476f1b-6cab-47d0-9b58-e82dcefab11b service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:42.158125 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1370/2699] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:50:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:50:42.426702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce129e9-52d7-43d1-b7c0-ffe778885f0a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:42.428889 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6ce129e9-52d7-43d1-b7c0-ffe778885f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:42.444688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce129e9-52d7-43d1-b7c0-ffe778885f0a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:42.449396 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14770c1-919c-4a30-b767-8d489f637a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:42.450023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14770c1-919c-4a30-b767-8d489f637a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:42.450303 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14770c1-919c-4a30-b767-8d489f637a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:42.450572 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14770c1-919c-4a30-b767-8d489f637a7b admin admin] PATH_INFO: `/v3/projects/be1f890a2ef44959868e49bb949dc727` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:42.451679 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14770c1-919c-4a30-b767-8d489f637a7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=be1f890a2ef44959868e49bb949dc727)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:42.454324 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14770c1-919c-4a30-b767-8d489f637a7b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:42.500304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d14770c1-919c-4a30-b767-8d489f637a7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1f890a2ef44959868e49bb949dc727', 'request_id': 'req-d14770c1-919c-4a30-b767-8d489f637a7b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:42.506744 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d14770c1-919c-4a30-b767-8d489f637a7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1f890a2ef44959868e49bb949dc727', 'request_id': 'req-d14770c1-919c-4a30-b767-8d489f637a7b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:42.512390 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d14770c1-919c-4a30-b767-8d489f637a7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1f890a2ef44959868e49bb949dc727', 'request_id': 'req-d14770c1-919c-4a30-b767-8d489f637a7b'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:42.523097 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d14770c1-919c-4a30-b767-8d489f637a7b admin admin] The token cache is being invalidate because project be1f890a2ef44959868e49bb949dc727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:50:42.523380 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d14770c1-919c-4a30-b767-8d489f637a7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:42.523992 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d14770c1-919c-4a30-b767-8d489f637a7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:42.525488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1330/2700] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:50:42 2022] DELETE /identity/v3/projects/be1f890a2ef44959868e49bb949dc727 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:42.529422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad476f1b-6cab-47d0-9b58-e82dcefab11b service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:42.539031 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad476f1b-6cab-47d0-9b58-e82dcefab11b service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:42.595328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898daf1-1918-45d6-baf3-84fec1c3acb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:42.595939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898daf1-1918-45d6-baf3-84fec1c3acb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:42.596215 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898daf1-1918-45d6-baf3-84fec1c3acb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:42.596482 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898daf1-1918-45d6-baf3-84fec1c3acb9 admin admin] PATH_INFO: `/v3/users/393dcb340fb1459ebedf947e537cb52a` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:42.597604 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898daf1-1918-45d6-baf3-84fec1c3acb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=393dcb340fb1459ebedf947e537cb52a)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:42.599498 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898daf1-1918-45d6-baf3-84fec1c3acb9 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:42.600958 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:42.646079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f898daf1-1918-45d6-baf3-84fec1c3acb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '393dcb340fb1459ebedf947e537cb52a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:42.654062 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f898daf1-1918-45d6-baf3-84fec1c3acb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '393dcb340fb1459ebedf947e537cb52a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:42.654660 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f898daf1-1918-45d6-baf3-84fec1c3acb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '393dcb340fb1459ebedf947e537cb52a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:42.655250 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f898daf1-1918-45d6-baf3-84fec1c3acb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '393dcb340fb1459ebedf947e537cb52a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:42.662919 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-f898daf1-1918-45d6-baf3-84fec1c3acb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '393dcb340fb1459ebedf947e537cb52a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:42.680276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1371/2701] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:50:42 2022] DELETE /identity/v3/users/393dcb340fb1459ebedf947e537cb52a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:42.897413 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14770c1-919c-4a30-b767-8d489f637a7b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:42.898951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d14770c1-919c-4a30-b767-8d489f637a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:42.958934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14770c1-919c-4a30-b767-8d489f637a7b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:42.967451 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898daf1-1918-45d6-baf3-84fec1c3acb9 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:42.969686 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f898daf1-1918-45d6-baf3-84fec1c3acb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:43.012685 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5d20d-4ac9-4489-9704-1126bc0c8674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:43.013419 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5d20d-4ac9-4489-9704-1126bc0c8674 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:43.013770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5d20d-4ac9-4489-9704-1126bc0c8674 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:43.014118 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5d20d-4ac9-4489-9704-1126bc0c8674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:43.016060 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9eb5d20d-4ac9-4489-9704-1126bc0c8674 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:43.047610 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898daf1-1918-45d6-baf3-84fec1c3acb9 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:43.050757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:43.053559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd637a58-6d59-407d-8b27-607c990aabd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:43.054194 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd637a58-6d59-407d-8b27-607c990aabd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:43.054475 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd637a58-6d59-407d-8b27-607c990aabd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:43.054743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd637a58-6d59-407d-8b27-607c990aabd7 admin admin] PATH_INFO: `/v3/projects/066d39e5e1be49e0ad67e27523bbf629` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:43.055980 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd637a58-6d59-407d-8b27-607c990aabd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=066d39e5e1be49e0ad67e27523bbf629)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:43.057915 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd637a58-6d59-407d-8b27-607c990aabd7 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:43.086094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5d20d-4ac9-4489-9704-1126bc0c8674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:43.087545 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5d20d-4ac9-4489-9704-1126bc0c8674 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:43.098614 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1331/2702] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:50:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:50:43.106516 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bd637a58-6d59-407d-8b27-607c990aabd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '066d39e5e1be49e0ad67e27523bbf629', 'request_id': 'req-bd637a58-6d59-407d-8b27-607c990aabd7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:43.113195 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bd637a58-6d59-407d-8b27-607c990aabd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '066d39e5e1be49e0ad67e27523bbf629', 'request_id': 'req-bd637a58-6d59-407d-8b27-607c990aabd7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:43.120992 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bd637a58-6d59-407d-8b27-607c990aabd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '066d39e5e1be49e0ad67e27523bbf629', 'request_id': 'req-bd637a58-6d59-407d-8b27-607c990aabd7'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:43.132121 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bd637a58-6d59-407d-8b27-607c990aabd7 admin admin] The token cache is being invalidate because project 066d39e5e1be49e0ad67e27523bbf629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:50:43.132411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bd637a58-6d59-407d-8b27-607c990aabd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:43.133048 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bd637a58-6d59-407d-8b27-607c990aabd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:43.137992 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1372/2703] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:50:42 2022] DELETE /identity/v3/projects/066d39e5e1be49e0ad67e27523bbf629 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:43.139634 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f99b7d-09f1-47c6-b8c2-c0aa58e0ece8 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:43.139912 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f99b7d-09f1-47c6-b8c2-c0aa58e0ece8 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:43.140212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f99b7d-09f1-47c6-b8c2-c0aa58e0ece8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:43.160368 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e5f99b7d-09f1-47c6-b8c2-c0aa58e0ece8 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:43.161847 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e5f99b7d-09f1-47c6-b8c2-c0aa58e0ece8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:43.228227 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1332/2704] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:43.236162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbbd0f-7876-4b3b-9986-5bdffab8153d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:43.236478 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbbd0f-7876-4b3b-9986-5bdffab8153d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:43.236722 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbbd0f-7876-4b3b-9986-5bdffab8153d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:43.257727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-83fbbd0f-7876-4b3b-9986-5bdffab8153d None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:43.260435 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-83fbbd0f-7876-4b3b-9986-5bdffab8153d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:43.275618 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1373/2705] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:43.280125 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f99b7d-09f1-47c6-b8c2-c0aa58e0ece8 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:43.290920 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f99b7d-09f1-47c6-b8c2-c0aa58e0ece8 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:43.295821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60f15e-6678-4b97-82ec-e3c79b425bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:43.296486 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60f15e-6678-4b97-82ec-e3c79b425bce admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:43.296753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60f15e-6678-4b97-82ec-e3c79b425bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:43.297027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60f15e-6678-4b97-82ec-e3c79b425bce admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:43.297775 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60f15e-6678-4b97-82ec-e3c79b425bce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:50:43.298024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60f15e-6678-4b97-82ec-e3c79b425bce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:43.299646 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60f15e-6678-4b97-82ec-e3c79b425bce admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:43.313030 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1333/2706] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:50:43.317616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbbd0f-7876-4b3b-9986-5bdffab8153d None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:43.322086 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:43.329033 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbbd0f-7876-4b3b-9986-5bdffab8153d None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:43.336302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be391edb-0480-4434-ab51-34fe2cd57972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:43.337133 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be391edb-0480-4434-ab51-34fe2cd57972 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:43.337488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be391edb-0480-4434-ab51-34fe2cd57972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:43.337821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be391edb-0480-4434-ab51-34fe2cd57972 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:43.338531 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be391edb-0480-4434-ab51-34fe2cd57972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:43.340524 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be391edb-0480-4434-ab51-34fe2cd57972 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:43.369606 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1374/2707] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:50:43 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:50:43.373887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60f15e-6678-4b97-82ec-e3c79b425bce admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:43.385693 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60f15e-6678-4b97-82ec-e3c79b425bce admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:43.445513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91fdd4-5e47-4157-927a-047dc68c30e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:43.446498 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91fdd4-5e47-4157-927a-047dc68c30e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:43.446777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91fdd4-5e47-4157-927a-047dc68c30e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:43.447079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91fdd4-5e47-4157-927a-047dc68c30e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:43.447715 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91fdd4-5e47-4157-927a-047dc68c30e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:43.449819 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91fdd4-5e47-4157-927a-047dc68c30e2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:43.472697 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1334/2708] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:50:43 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:50:43.476806 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be391edb-0480-4434-ab51-34fe2cd57972 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:43.488746 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be391edb-0480-4434-ab51-34fe2cd57972 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:43.493465 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e683a-9a49-4287-83dd-88e05587269f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:43.494061 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e683a-9a49-4287-83dd-88e05587269f admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:43.494336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e683a-9a49-4287-83dd-88e05587269f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:43.494606 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e683a-9a49-4287-83dd-88e05587269f admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:43.495251 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e683a-9a49-4287-83dd-88e05587269f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:43.496821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e683a-9a49-4287-83dd-88e05587269f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:43.509830 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1375/2709] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 00:50:43.511013 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91fdd4-5e47-4157-927a-047dc68c30e2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:43.521759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91fdd4-5e47-4157-927a-047dc68c30e2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:43.526455 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef7c85-0d2b-48c6-babb-76c33d8d84c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:43.527145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef7c85-0d2b-48c6-babb-76c33d8d84c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:43.527488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef7c85-0d2b-48c6-babb-76c33d8d84c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:43.527829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef7c85-0d2b-48c6-babb-76c33d8d84c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:43.528540 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef7c85-0d2b-48c6-babb-76c33d8d84c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:43.530254 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef7c85-0d2b-48c6-babb-76c33d8d84c7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:43.542329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1335/2710] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:50:43.548004 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e683a-9a49-4287-83dd-88e05587269f admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:43.558192 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e683a-9a49-4287-83dd-88e05587269f admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:43.563514 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820990c-647c-44e0-963a-86c2b2fff496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:43.564164 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820990c-647c-44e0-963a-86c2b2fff496 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:43.564446 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820990c-647c-44e0-963a-86c2b2fff496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:43.564742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820990c-647c-44e0-963a-86c2b2fff496 admin admin] PATH_INFO: `/v3/projects/7588588ee75940a48d9d5e201045fdfc/users/6eec487229d34975940585de1503f02a/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:43.579966 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820990c-647c-44e0-963a-86c2b2fff496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7588588ee75940a48d9d5e201045fdfc, user_id=6eec487229d34975940585de1503f02a, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:43.582935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820990c-647c-44e0-963a-86c2b2fff496 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:43.596708 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1376/2711] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:50:43 2022] PUT /identity/v3/projects/7588588ee75940a48d9d5e201045fdfc/users/6eec487229d34975940585de1503f02a/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:43.607265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f9c2e-8efb-4bbf-adcb-dd61151276bf None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:43.607548 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f9c2e-8efb-4bbf-adcb-dd61151276bf None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:43.607815 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f9c2e-8efb-4bbf-adcb-dd61151276bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:43.636872 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-268f9c2e-8efb-4bbf-adcb-dd61151276bf None None] MFA Rules not processed for user `6eec487229d34975940585de1503f02a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:43.638218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-268f9c2e-8efb-4bbf-adcb-dd61151276bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:43.658857 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:43.712033 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1336/2712] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:50:43.713136 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820990c-647c-44e0-963a-86c2b2fff496 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:43.778090 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820990c-647c-44e0-963a-86c2b2fff496 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:43.782872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410fa5d-93ea-4a5c-86eb-f2cb373be172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:43.783478 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410fa5d-93ea-4a5c-86eb-f2cb373be172 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:43.783761 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410fa5d-93ea-4a5c-86eb-f2cb373be172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:43.784032 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410fa5d-93ea-4a5c-86eb-f2cb373be172 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:43.784667 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410fa5d-93ea-4a5c-86eb-f2cb373be172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:43.786599 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410fa5d-93ea-4a5c-86eb-f2cb373be172 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:43.814022 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1377/2713] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:50:43 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:50:43.818012 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f9c2e-8efb-4bbf-adcb-dd61151276bf None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:43.829375 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f9c2e-8efb-4bbf-adcb-dd61151276bf None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:43.887719 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ce8dd-3739-45f8-a631-3518e7439ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:43.888319 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ce8dd-3739-45f8-a631-3518e7439ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:43.888595 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ce8dd-3739-45f8-a631-3518e7439ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:43.888862 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ce8dd-3739-45f8-a631-3518e7439ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:43.889535 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ce8dd-3739-45f8-a631-3518e7439ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:43.892007 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ce8dd-3739-45f8-a631-3518e7439ab1 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:43.914793 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1337/2714] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:50:43 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:50:43.918608 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410fa5d-93ea-4a5c-86eb-f2cb373be172 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:43.928778 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410fa5d-93ea-4a5c-86eb-f2cb373be172 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:43.933414 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67e203-447d-4922-98d1-88be88009898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:43.934005 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67e203-447d-4922-98d1-88be88009898 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:43.934283 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67e203-447d-4922-98d1-88be88009898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:43.934555 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67e203-447d-4922-98d1-88be88009898 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:43.935186 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67e203-447d-4922-98d1-88be88009898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:43.936888 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67e203-447d-4922-98d1-88be88009898 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:43.947849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1378/2715] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:50:43.952183 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ce8dd-3739-45f8-a631-3518e7439ab1 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:43.963182 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ce8dd-3739-45f8-a631-3518e7439ab1 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:43.967813 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b486c-bca5-44bb-aa4b-fd87e637359c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:43.968464 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b486c-bca5-44bb-aa4b-fd87e637359c admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:43.968744 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b486c-bca5-44bb-aa4b-fd87e637359c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:43.969025 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b486c-bca5-44bb-aa4b-fd87e637359c admin admin] PATH_INFO: `/v3/projects/a8a4cdaa05ac40f3a49432c8ea043d66/users/33324f8326b14146ac9b7544305620fd/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:43.983851 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b486c-bca5-44bb-aa4b-fd87e637359c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8a4cdaa05ac40f3a49432c8ea043d66, user_id=33324f8326b14146ac9b7544305620fd, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:43.987222 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b486c-bca5-44bb-aa4b-fd87e637359c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:44.000916 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1338/2716] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:50:43 2022] PUT /identity/v3/projects/a8a4cdaa05ac40f3a49432c8ea043d66/users/33324f8326b14146ac9b7544305620fd/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:44.005025 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67e203-447d-4922-98d1-88be88009898 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:44.015011 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67e203-447d-4922-98d1-88be88009898 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:44.071879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12f500-f47e-4897-a5c8-43be87cfd367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:44.072490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12f500-f47e-4897-a5c8-43be87cfd367 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:44.072772 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12f500-f47e-4897-a5c8-43be87cfd367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:44.073049 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12f500-f47e-4897-a5c8-43be87cfd367 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:44.073723 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12f500-f47e-4897-a5c8-43be87cfd367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:44.075307 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12f500-f47e-4897-a5c8-43be87cfd367 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:44.085622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1379/2717] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:50:44.089921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b486c-bca5-44bb-aa4b-fd87e637359c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:44.100369 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b486c-bca5-44bb-aa4b-fd87e637359c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:44.105030 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fb905-5148-4791-a573-18732af596a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:44.105723 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fb905-5148-4791-a573-18732af596a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:44.106450 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fb905-5148-4791-a573-18732af596a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:44.106450 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fb905-5148-4791-a573-18732af596a4 admin admin] PATH_INFO: `/v3/projects/a8a4cdaa05ac40f3a49432c8ea043d66/users/33324f8326b14146ac9b7544305620fd/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:44.108163 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fb905-5148-4791-a573-18732af596a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8a4cdaa05ac40f3a49432c8ea043d66, user_id=33324f8326b14146ac9b7544305620fd, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:44.111340 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fb905-5148-4791-a573-18732af596a4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:44.121576 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1339/2718] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:50:44 2022] PUT /identity/v3/projects/a8a4cdaa05ac40f3a49432c8ea043d66/users/33324f8326b14146ac9b7544305620fd/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:44.196321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe931d-cf59-46a8-bd29-cf56b00413f7 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:44.196635 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe931d-cf59-46a8-bd29-cf56b00413f7 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:44.196930 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe931d-cf59-46a8-bd29-cf56b00413f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:44.234408 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-eebe931d-cf59-46a8-bd29-cf56b00413f7 None None] MFA Rules not processed for user `33324f8326b14146ac9b7544305620fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:44.235643 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-eebe931d-cf59-46a8-bd29-cf56b00413f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:44.244211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:44.335456 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1380/2719] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:44.344400 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fb905-5148-4791-a573-18732af596a4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:44.346596 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-966fb905-5148-4791-a573-18732af596a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:44.416887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fb905-5148-4791-a573-18732af596a4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:44.420702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d742cd-4c93-4a90-81cf-5dbdc6d2f126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:44.421375 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d742cd-4c93-4a90-81cf-5dbdc6d2f126 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:44.422195 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d742cd-4c93-4a90-81cf-5dbdc6d2f126 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:44.422469 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d742cd-4c93-4a90-81cf-5dbdc6d2f126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:44.435393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d742cd-4c93-4a90-81cf-5dbdc6d2f126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:44.437137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d742cd-4c93-4a90-81cf-5dbdc6d2f126 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:44.448500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1340/2720] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:50:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:50:44.858467 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe931d-cf59-46a8-bd29-cf56b00413f7 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:44.924042 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe931d-cf59-46a8-bd29-cf56b00413f7 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:44.928864 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf49afb-db3a-47a1-89fd-187081e12c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:44.929537 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf49afb-db3a-47a1-89fd-187081e12c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:44.929821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf49afb-db3a-47a1-89fd-187081e12c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:44.930096 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf49afb-db3a-47a1-89fd-187081e12c6c admin admin] PATH_INFO: `/v3/users/6eec487229d34975940585de1503f02a` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:44.931228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf49afb-db3a-47a1-89fd-187081e12c6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eec487229d34975940585de1503f02a)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:44.933199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf49afb-db3a-47a1-89fd-187081e12c6c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:44.979768 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bdf49afb-db3a-47a1-89fd-187081e12c6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eec487229d34975940585de1503f02a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:44.987890 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bdf49afb-db3a-47a1-89fd-187081e12c6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eec487229d34975940585de1503f02a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:44.988495 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bdf49afb-db3a-47a1-89fd-187081e12c6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eec487229d34975940585de1503f02a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:44.989107 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bdf49afb-db3a-47a1-89fd-187081e12c6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eec487229d34975940585de1503f02a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:44.996037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bdf49afb-db3a-47a1-89fd-187081e12c6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eec487229d34975940585de1503f02a'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:45.013593 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1381/2721] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:50:44 2022] DELETE /identity/v3/users/6eec487229d34975940585de1503f02a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:45.018159 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438e34f-99b5-48df-a01f-4d9c5298123a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:45.018650 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438e34f-99b5-48df-a01f-4d9c5298123a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:45.018733 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438e34f-99b5-48df-a01f-4d9c5298123a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:45.037476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e438e34f-99b5-48df-a01f-4d9c5298123a None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:45.038688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e438e34f-99b5-48df-a01f-4d9c5298123a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:45.051294 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:45.115750 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1341/2722] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:45.123362 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf49afb-db3a-47a1-89fd-187081e12c6c admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:45.125223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-bdf49afb-db3a-47a1-89fd-187081e12c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:45.150545 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:45.191271 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf49afb-db3a-47a1-89fd-187081e12c6c admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:45.195094 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80c547-5140-4736-b13b-2b033128bd7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:45.195708 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80c547-5140-4736-b13b-2b033128bd7d service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:45.195989 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80c547-5140-4736-b13b-2b033128bd7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:45.196260 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80c547-5140-4736-b13b-2b033128bd7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:45.206913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80c547-5140-4736-b13b-2b033128bd7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:45.208356 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80c547-5140-4736-b13b-2b033128bd7d service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:45.219489 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1382/2723] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:50:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:50:45.521574 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438e34f-99b5-48df-a01f-4d9c5298123a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:45.523064 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e438e34f-99b5-48df-a01f-4d9c5298123a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:45.538023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438e34f-99b5-48df-a01f-4d9c5298123a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:45.543145 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0774ef-5f6d-43df-ae26-dc1abfbf6ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:45.543852 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0774ef-5f6d-43df-ae26-dc1abfbf6ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:45.544203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0774ef-5f6d-43df-ae26-dc1abfbf6ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:45.544529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0774ef-5f6d-43df-ae26-dc1abfbf6ee4 admin admin] PATH_INFO: `/v3/projects/7588588ee75940a48d9d5e201045fdfc` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:45.545749 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0774ef-5f6d-43df-ae26-dc1abfbf6ee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7588588ee75940a48d9d5e201045fdfc)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:45.548261 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0774ef-5f6d-43df-ae26-dc1abfbf6ee4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:45.603643 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6a0774ef-5f6d-43df-ae26-dc1abfbf6ee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7588588ee75940a48d9d5e201045fdfc', 'request_id': 'req-6a0774ef-5f6d-43df-ae26-dc1abfbf6ee4'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:45.627315 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6a0774ef-5f6d-43df-ae26-dc1abfbf6ee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7588588ee75940a48d9d5e201045fdfc', 'request_id': 'req-6a0774ef-5f6d-43df-ae26-dc1abfbf6ee4'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:45.636476 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6a0774ef-5f6d-43df-ae26-dc1abfbf6ee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7588588ee75940a48d9d5e201045fdfc', 'request_id': 'req-6a0774ef-5f6d-43df-ae26-dc1abfbf6ee4'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:45.653830 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6a0774ef-5f6d-43df-ae26-dc1abfbf6ee4 admin admin] The token cache is being invalidate because project 7588588ee75940a48d9d5e201045fdfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:50:45.654389 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6a0774ef-5f6d-43df-ae26-dc1abfbf6ee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:45.656879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-6a0774ef-5f6d-43df-ae26-dc1abfbf6ee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:45.658440 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1342/2724] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:50:45 2022] DELETE /identity/v3/projects/7588588ee75940a48d9d5e201045fdfc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:45.662683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80c547-5140-4736-b13b-2b033128bd7d service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:45.673597 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80c547-5140-4736-b13b-2b033128bd7d service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:45.733412 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a00be2-8e7e-41e1-a718-da0463da7dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:45.734590 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a00be2-8e7e-41e1-a718-da0463da7dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:45.734876 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a00be2-8e7e-41e1-a718-da0463da7dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:45.735149 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a00be2-8e7e-41e1-a718-da0463da7dd7 admin admin] PATH_INFO: `/v3/users/33324f8326b14146ac9b7544305620fd` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:45.736303 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a00be2-8e7e-41e1-a718-da0463da7dd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33324f8326b14146ac9b7544305620fd)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:45.738384 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a00be2-8e7e-41e1-a718-da0463da7dd7 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:45.786428 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-68a00be2-8e7e-41e1-a718-da0463da7dd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33324f8326b14146ac9b7544305620fd'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:45.794081 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-68a00be2-8e7e-41e1-a718-da0463da7dd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33324f8326b14146ac9b7544305620fd'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:45.795008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-68a00be2-8e7e-41e1-a718-da0463da7dd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33324f8326b14146ac9b7544305620fd'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:45.795777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-68a00be2-8e7e-41e1-a718-da0463da7dd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33324f8326b14146ac9b7544305620fd'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:45.803630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-68a00be2-8e7e-41e1-a718-da0463da7dd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33324f8326b14146ac9b7544305620fd'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:45.826398 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1383/2725] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:50:45 2022] DELETE /identity/v3/users/33324f8326b14146ac9b7544305620fd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:46.135427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0774ef-5f6d-43df-ae26-dc1abfbf6ee4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:46.137037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6a0774ef-5f6d-43df-ae26-dc1abfbf6ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:46.151569 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0774ef-5f6d-43df-ae26-dc1abfbf6ee4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:46.215404 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbf327-b631-4855-b40d-a806e721953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:46.216058 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbf327-b631-4855-b40d-a806e721953e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:46.216330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbf327-b631-4855-b40d-a806e721953e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:46.216600 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbf327-b631-4855-b40d-a806e721953e admin admin] PATH_INFO: `/v3/projects/a8a4cdaa05ac40f3a49432c8ea043d66` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:46.217772 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbf327-b631-4855-b40d-a806e721953e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8a4cdaa05ac40f3a49432c8ea043d66)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:46.220342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbf327-b631-4855-b40d-a806e721953e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:46.265560 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:46.270019 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-abcbf327-b631-4855-b40d-a806e721953e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8a4cdaa05ac40f3a49432c8ea043d66', 'request_id': 'req-abcbf327-b631-4855-b40d-a806e721953e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:46.278094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-abcbf327-b631-4855-b40d-a806e721953e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8a4cdaa05ac40f3a49432c8ea043d66', 'request_id': 'req-abcbf327-b631-4855-b40d-a806e721953e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:46.284715 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-abcbf327-b631-4855-b40d-a806e721953e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8a4cdaa05ac40f3a49432c8ea043d66', 'request_id': 'req-abcbf327-b631-4855-b40d-a806e721953e'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:46.297728 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-abcbf327-b631-4855-b40d-a806e721953e admin admin] The token cache is being invalidate because project a8a4cdaa05ac40f3a49432c8ea043d66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:50:46.298169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-abcbf327-b631-4855-b40d-a806e721953e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:46.298824 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-abcbf327-b631-4855-b40d-a806e721953e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:46.300294 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1343/2726] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:50:46 2022] DELETE /identity/v3/projects/a8a4cdaa05ac40f3a49432c8ea043d66 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:46.305032 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3963229-5407-45fe-b789-413311db33bd None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:46.305517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3963229-5407-45fe-b789-413311db33bd None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:46.305638 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3963229-5407-45fe-b789-413311db33bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:46.325760 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-d3963229-5407-45fe-b789-413311db33bd None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:46.326955 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-d3963229-5407-45fe-b789-413311db33bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:46.369013 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:46.391445 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1384/2727] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:50:46.399052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144ea4-d07d-4d7f-a8be-190edf806c54 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:46.399339 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144ea4-d07d-4d7f-a8be-190edf806c54 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:46.400245 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144ea4-d07d-4d7f-a8be-190edf806c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:46.420297 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a6144ea4-d07d-4d7f-a8be-190edf806c54 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:46.421614 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a6144ea4-d07d-4d7f-a8be-190edf806c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:46.432089 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1344/2728] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:46.435729 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3963229-5407-45fe-b789-413311db33bd None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:46.446067 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3963229-5407-45fe-b789-413311db33bd None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:46.450833 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62731e-2ea2-4f93-84a4-c5e3b419bbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:46.451443 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62731e-2ea2-4f93-84a4-c5e3b419bbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:46.451721 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62731e-2ea2-4f93-84a4-c5e3b419bbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:46.451988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62731e-2ea2-4f93-84a4-c5e3b419bbf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:46.453205 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62731e-2ea2-4f93-84a4-c5e3b419bbf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:50:46.453510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62731e-2ea2-4f93-84a4-c5e3b419bbf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:46.455351 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62731e-2ea2-4f93-84a4-c5e3b419bbf3 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:46.471472 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1385/2729] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:50:46.472862 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6144ea4-d07d-4d7f-a8be-190edf806c54 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:46.483922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6144ea4-d07d-4d7f-a8be-190edf806c54 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:46.490293 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbd3b3-01b5-429b-b2e8-f852d785336b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:46.490896 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbd3b3-01b5-429b-b2e8-f852d785336b admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:46.491174 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbd3b3-01b5-429b-b2e8-f852d785336b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:46.491446 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbd3b3-01b5-429b-b2e8-f852d785336b admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:46.492113 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbd3b3-01b5-429b-b2e8-f852d785336b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:46.494105 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbd3b3-01b5-429b-b2e8-f852d785336b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:46.522803 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1345/2730] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:50:46 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:50:46.527187 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62731e-2ea2-4f93-84a4-c5e3b419bbf3 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:46.538807 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62731e-2ea2-4f93-84a4-c5e3b419bbf3 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:46.614549 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bffb8a-db78-4cc0-92d7-0c73897cfd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:46.615169 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bffb8a-db78-4cc0-92d7-0c73897cfd5d admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:46.615451 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bffb8a-db78-4cc0-92d7-0c73897cfd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:46.615724 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bffb8a-db78-4cc0-92d7-0c73897cfd5d admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:46.616366 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bffb8a-db78-4cc0-92d7-0c73897cfd5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:46.618305 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bffb8a-db78-4cc0-92d7-0c73897cfd5d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:46.651448 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1386/2731] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:50:46 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:50:46.654886 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbd3b3-01b5-429b-b2e8-f852d785336b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:46.668785 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbd3b3-01b5-429b-b2e8-f852d785336b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:46.676799 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b7cda-4cb5-499b-8b94-9d76c9a8a9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:46.676994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b7cda-4cb5-499b-8b94-9d76c9a8a9cc admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:46.677373 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b7cda-4cb5-499b-8b94-9d76c9a8a9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:46.677663 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b7cda-4cb5-499b-8b94-9d76c9a8a9cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:46.678559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b7cda-4cb5-499b-8b94-9d76c9a8a9cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:46.681601 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b7cda-4cb5-499b-8b94-9d76c9a8a9cc admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:46.704394 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1346/2732] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:50:46.710600 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bffb8a-db78-4cc0-92d7-0c73897cfd5d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:46.725230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bffb8a-db78-4cc0-92d7-0c73897cfd5d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:46.731433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ff001-2425-4328-abe5-3ed69c022c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:46.733029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ff001-2425-4328-abe5-3ed69c022c88 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:46.733029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ff001-2425-4328-abe5-3ed69c022c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:46.733029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ff001-2425-4328-abe5-3ed69c022c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:46.735392 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ff001-2425-4328-abe5-3ed69c022c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:46.739445 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ff001-2425-4328-abe5-3ed69c022c88 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:46.750056 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1387/2733] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:50:46.754184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b7cda-4cb5-499b-8b94-9d76c9a8a9cc admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:46.766230 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b7cda-4cb5-499b-8b94-9d76c9a8a9cc admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:46.771414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a404e-f16c-46df-80fd-671d5aedc01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:46.772202 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a404e-f16c-46df-80fd-671d5aedc01d admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:46.772558 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a404e-f16c-46df-80fd-671d5aedc01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:46.772902 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a404e-f16c-46df-80fd-671d5aedc01d admin admin] PATH_INFO: `/v3/projects/1867d3bcbeb24d9897cfe20c4249fcb3/users/47a39b7cfec14e9fb50393905fcef567/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:46.790404 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a404e-f16c-46df-80fd-671d5aedc01d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1867d3bcbeb24d9897cfe20c4249fcb3, user_id=47a39b7cfec14e9fb50393905fcef567, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:46.792749 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a404e-f16c-46df-80fd-671d5aedc01d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:46.814111 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1347/2734] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:50:46 2022] PUT /identity/v3/projects/1867d3bcbeb24d9897cfe20c4249fcb3/users/47a39b7cfec14e9fb50393905fcef567/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:46.824244 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064066d-8058-40f2-ace5-f9d36fa9b2d7 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:46.824531 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064066d-8058-40f2-ace5-f9d36fa9b2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:46.824860 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064066d-8058-40f2-ace5-f9d36fa9b2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:46.864957 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-3064066d-8058-40f2-ace5-f9d36fa9b2d7 None None] MFA Rules not processed for user `47a39b7cfec14e9fb50393905fcef567`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:46.868051 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3064066d-8058-40f2-ace5-f9d36fa9b2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:46.944578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1388/2735] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:46.962646 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a404e-f16c-46df-80fd-671d5aedc01d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:46.964451 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4d5a404e-f16c-46df-80fd-671d5aedc01d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:47.040093 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a404e-f16c-46df-80fd-671d5aedc01d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:47.044852 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4e691-9730-4301-b892-949e269446e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:47.045737 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4e691-9730-4301-b892-949e269446e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:47.046085 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4e691-9730-4301-b892-949e269446e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:47.046943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4e691-9730-4301-b892-949e269446e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:47.056805 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4e691-9730-4301-b892-949e269446e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:47.058390 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4e691-9730-4301-b892-949e269446e7 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:47.070336 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1348/2736] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:50:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:50:47.202677 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064066d-8058-40f2-ace5-f9d36fa9b2d7 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:47.204098 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-3064066d-8058-40f2-ace5-f9d36fa9b2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:47.249012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:47.275060 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064066d-8058-40f2-ace5-f9d36fa9b2d7 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:47.279672 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d38aa1-3c60-41e4-b163-02f1d608fe06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:47.280302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d38aa1-3c60-41e4-b163-02f1d608fe06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:47.280608 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d38aa1-3c60-41e4-b163-02f1d608fe06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:47.281550 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d38aa1-3c60-41e4-b163-02f1d608fe06 admin admin] PATH_INFO: `/v3/users/888bda8e3665469cafd6739ae3423bab` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:47.282690 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d38aa1-3c60-41e4-b163-02f1d608fe06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=888bda8e3665469cafd6739ae3423bab)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:47.285229 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d38aa1-3c60-41e4-b163-02f1d608fe06 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:47.338466 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-13d38aa1-3c60-41e4-b163-02f1d608fe06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '888bda8e3665469cafd6739ae3423bab'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:47.351578 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-13d38aa1-3c60-41e4-b163-02f1d608fe06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '888bda8e3665469cafd6739ae3423bab'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:47.352497 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-13d38aa1-3c60-41e4-b163-02f1d608fe06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '888bda8e3665469cafd6739ae3423bab'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:47.360165 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-13d38aa1-3c60-41e4-b163-02f1d608fe06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '888bda8e3665469cafd6739ae3423bab'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:47.371112 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-13d38aa1-3c60-41e4-b163-02f1d608fe06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '888bda8e3665469cafd6739ae3423bab'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:47.391233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1389/2737] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:50:47 2022] DELETE /identity/v3/users/888bda8e3665469cafd6739ae3423bab => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:47.575518 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4e691-9730-4301-b892-949e269446e7 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:47.591761 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4e691-9730-4301-b892-949e269446e7 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:47.652901 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc0fd5-e335-4ed0-bef1-b77f0e0c0cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:47.654011 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc0fd5-e335-4ed0-bef1-b77f0e0c0cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:47.654011 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc0fd5-e335-4ed0-bef1-b77f0e0c0cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:47.654236 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc0fd5-e335-4ed0-bef1-b77f0e0c0cec admin admin] PATH_INFO: `/v3/projects/6d8c50f214e04fa1b50d3539e95baeab` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:47.656776 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc0fd5-e335-4ed0-bef1-b77f0e0c0cec admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d8c50f214e04fa1b50d3539e95baeab)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:47.658251 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc0fd5-e335-4ed0-bef1-b77f0e0c0cec admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:47.670236 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:47.709286 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-34cc0fd5-e335-4ed0-bef1-b77f0e0c0cec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d8c50f214e04fa1b50d3539e95baeab', 'request_id': 'req-34cc0fd5-e335-4ed0-bef1-b77f0e0c0cec'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:47.717611 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-34cc0fd5-e335-4ed0-bef1-b77f0e0c0cec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d8c50f214e04fa1b50d3539e95baeab', 'request_id': 'req-34cc0fd5-e335-4ed0-bef1-b77f0e0c0cec'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:47.726273 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-34cc0fd5-e335-4ed0-bef1-b77f0e0c0cec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d8c50f214e04fa1b50d3539e95baeab', 'request_id': 'req-34cc0fd5-e335-4ed0-bef1-b77f0e0c0cec'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:47.738041 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-34cc0fd5-e335-4ed0-bef1-b77f0e0c0cec admin admin] The token cache is being invalidate because project 6d8c50f214e04fa1b50d3539e95baeab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:50:47.738427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-34cc0fd5-e335-4ed0-bef1-b77f0e0c0cec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:47.739074 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-34cc0fd5-e335-4ed0-bef1-b77f0e0c0cec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:47.740535 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1349/2738] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:50:47 2022] DELETE /identity/v3/projects/6d8c50f214e04fa1b50d3539e95baeab => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:47.745501 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b218fcd-71e8-4c27-a1a5-33fb3daaa717 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:47.745791 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b218fcd-71e8-4c27-a1a5-33fb3daaa717 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:47.746090 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b218fcd-71e8-4c27-a1a5-33fb3daaa717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:47.766048 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8b218fcd-71e8-4c27-a1a5-33fb3daaa717 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:47.767235 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8b218fcd-71e8-4c27-a1a5-33fb3daaa717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:47.825212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1390/2739] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:47.834834 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97be0b-f5ff-428e-9e29-8d34587f457c None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:47.835115 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97be0b-f5ff-428e-9e29-8d34587f457c None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:47.835389 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97be0b-f5ff-428e-9e29-8d34587f457c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:47.855203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-4f97be0b-f5ff-428e-9e29-8d34587f457c None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:47.856413 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-4f97be0b-f5ff-428e-9e29-8d34587f457c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:47.864161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1350/2740] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:47.868441 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b218fcd-71e8-4c27-a1a5-33fb3daaa717 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:47.878201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b218fcd-71e8-4c27-a1a5-33fb3daaa717 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:47.882746 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a20df7-7155-4d10-aaea-4074a0f05efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:47.883337 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a20df7-7155-4d10-aaea-4074a0f05efc admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:47.883614 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a20df7-7155-4d10-aaea-4074a0f05efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:47.883885 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a20df7-7155-4d10-aaea-4074a0f05efc admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:47.884524 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a20df7-7155-4d10-aaea-4074a0f05efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:50:47.884826 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a20df7-7155-4d10-aaea-4074a0f05efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:47.886443 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a20df7-7155-4d10-aaea-4074a0f05efc admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:47.898257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1391/2741] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:50:47.902290 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97be0b-f5ff-428e-9e29-8d34587f457c None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:47.912121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97be0b-f5ff-428e-9e29-8d34587f457c None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:47.916743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176674d-9e94-40b3-bf39-0b8478c16253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:47.917348 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176674d-9e94-40b3-bf39-0b8478c16253 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:47.917624 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176674d-9e94-40b3-bf39-0b8478c16253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:47.917891 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176674d-9e94-40b3-bf39-0b8478c16253 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:47.918506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176674d-9e94-40b3-bf39-0b8478c16253 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:47.920437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176674d-9e94-40b3-bf39-0b8478c16253 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:47.947530 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1351/2742] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:50:47 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:50:47.951610 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a20df7-7155-4d10-aaea-4074a0f05efc admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:47.962201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a20df7-7155-4d10-aaea-4074a0f05efc admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:48.003008 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:48.020488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c3d4d-0db6-42ff-87dd-ec9342cf5998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:48.021134 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c3d4d-0db6-42ff-87dd-ec9342cf5998 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:48.021418 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c3d4d-0db6-42ff-87dd-ec9342cf5998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:48.021688 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c3d4d-0db6-42ff-87dd-ec9342cf5998 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:48.022321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c3d4d-0db6-42ff-87dd-ec9342cf5998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:48.024237 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c3d4d-0db6-42ff-87dd-ec9342cf5998 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:48.045211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1392/2743] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:50:47 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:50:48.049281 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176674d-9e94-40b3-bf39-0b8478c16253 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:48.059514 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176674d-9e94-40b3-bf39-0b8478c16253 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:48.064876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e655b-287b-4626-9c87-e116e1cac47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:48.065512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e655b-287b-4626-9c87-e116e1cac47f admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:48.065786 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e655b-287b-4626-9c87-e116e1cac47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:48.066056 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e655b-287b-4626-9c87-e116e1cac47f admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:48.066691 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e655b-287b-4626-9c87-e116e1cac47f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:48.068271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e655b-287b-4626-9c87-e116e1cac47f admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:48.078753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1352/2744] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 00:50:48.082645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c3d4d-0db6-42ff-87dd-ec9342cf5998 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:48.092799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c3d4d-0db6-42ff-87dd-ec9342cf5998 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:48.097535 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de1c19-61c1-4346-925d-92b6b531ee72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:48.098141 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de1c19-61c1-4346-925d-92b6b531ee72 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:48.098404 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de1c19-61c1-4346-925d-92b6b531ee72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:48.098683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de1c19-61c1-4346-925d-92b6b531ee72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:48.099324 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de1c19-61c1-4346-925d-92b6b531ee72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:48.100894 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de1c19-61c1-4346-925d-92b6b531ee72 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:48.111278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1393/2745] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:50:48.115366 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e655b-287b-4626-9c87-e116e1cac47f admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:48.125687 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e655b-287b-4626-9c87-e116e1cac47f admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:48.130188 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6a9a6-d614-4ce8-98af-ea473090fee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:48.130814 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6a9a6-d614-4ce8-98af-ea473090fee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:48.131090 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6a9a6-d614-4ce8-98af-ea473090fee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:48.131362 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6a9a6-d614-4ce8-98af-ea473090fee8 admin admin] PATH_INFO: `/v3/projects/aec54caea46949d3ad7d18f99d2f5d19/users/3c33e5b833d94502a5d86f67acce2eef/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:48.145881 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6a9a6-d614-4ce8-98af-ea473090fee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec54caea46949d3ad7d18f99d2f5d19, user_id=3c33e5b833d94502a5d86f67acce2eef, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:48.148556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6a9a6-d614-4ce8-98af-ea473090fee8 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:48.160914 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1353/2746] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:50:48 2022] PUT /identity/v3/projects/aec54caea46949d3ad7d18f99d2f5d19/users/3c33e5b833d94502a5d86f67acce2eef/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:48.165778 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111ae21-29b6-4813-a904-cdaec9c07022 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:48.166063 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111ae21-29b6-4813-a904-cdaec9c07022 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:48.166340 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111ae21-29b6-4813-a904-cdaec9c07022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:48.185029 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-7111ae21-29b6-4813-a904-cdaec9c07022 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:48.186341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7111ae21-29b6-4813-a904-cdaec9c07022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:48.247427 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1394/2747] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:50:48.257577 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6a9a6-d614-4ce8-98af-ea473090fee8 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:48.259277 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-79a6a9a6-d614-4ce8-98af-ea473090fee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:48.315743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6a9a6-d614-4ce8-98af-ea473090fee8 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:48.319380 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709a512-0522-4dd0-ac98-4de42f7f68e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:48.319980 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709a512-0522-4dd0-ac98-4de42f7f68e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:48.320275 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709a512-0522-4dd0-ac98-4de42f7f68e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:48.320536 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709a512-0522-4dd0-ac98-4de42f7f68e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:48.330245 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709a512-0522-4dd0-ac98-4de42f7f68e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:48.331708 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709a512-0522-4dd0-ac98-4de42f7f68e0 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:48.341487 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1354/2748] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:50:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:50:50.234326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111ae21-29b6-4813-a904-cdaec9c07022 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:50.235824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-7111ae21-29b6-4813-a904-cdaec9c07022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:50.248177 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111ae21-29b6-4813-a904-cdaec9c07022 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:50.253756 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f128c6-1d43-4c49-b291-9dd32feffc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:50.254482 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f128c6-1d43-4c49-b291-9dd32feffc7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:50.254836 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f128c6-1d43-4c49-b291-9dd32feffc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:50.255941 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f128c6-1d43-4c49-b291-9dd32feffc7e admin admin] PATH_INFO: `/v3/users/47a39b7cfec14e9fb50393905fcef567` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:50.257829 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f128c6-1d43-4c49-b291-9dd32feffc7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a39b7cfec14e9fb50393905fcef567)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:50.260573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f128c6-1d43-4c49-b291-9dd32feffc7e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:50.323174 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a7f128c6-1d43-4c49-b291-9dd32feffc7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a39b7cfec14e9fb50393905fcef567'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:50.332275 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a7f128c6-1d43-4c49-b291-9dd32feffc7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a39b7cfec14e9fb50393905fcef567'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:50.333399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a7f128c6-1d43-4c49-b291-9dd32feffc7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a39b7cfec14e9fb50393905fcef567'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:50.334015 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a7f128c6-1d43-4c49-b291-9dd32feffc7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a39b7cfec14e9fb50393905fcef567'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:50.366114 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-a7f128c6-1d43-4c49-b291-9dd32feffc7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a39b7cfec14e9fb50393905fcef567'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:50.397659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1395/2749] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:50:50 2022] DELETE /identity/v3/users/47a39b7cfec14e9fb50393905fcef567 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:50.402212 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729334b-58af-4420-9018-cdd9404e87ef None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:50.402735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729334b-58af-4420-9018-cdd9404e87ef None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:50.402826 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729334b-58af-4420-9018-cdd9404e87ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:50.426457 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-e729334b-58af-4420-9018-cdd9404e87ef None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:50.427806 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e729334b-58af-4420-9018-cdd9404e87ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:50.468593 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:50.503513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1355/2750] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:50.513302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f128c6-1d43-4c49-b291-9dd32feffc7e admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:50.514899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-a7f128c6-1d43-4c49-b291-9dd32feffc7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:50.560526 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:50.579971 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f128c6-1d43-4c49-b291-9dd32feffc7e admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:50.584124 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530f967-13d4-420a-8516-a99d321c9479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:50.585016 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530f967-13d4-420a-8516-a99d321c9479 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:50.585628 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530f967-13d4-420a-8516-a99d321c9479 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:50.585628 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530f967-13d4-420a-8516-a99d321c9479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:50.596064 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530f967-13d4-420a-8516-a99d321c9479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:50.598003 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530f967-13d4-420a-8516-a99d321c9479 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:50.608041 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1396/2751] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:50:51.041677 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729334b-58af-4420-9018-cdd9404e87ef None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:51.043558 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e729334b-58af-4420-9018-cdd9404e87ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:51.060022 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729334b-58af-4420-9018-cdd9404e87ef None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:51.065741 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abb468-ca30-406a-8fcf-29e0a9294382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:51.066391 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abb468-ca30-406a-8fcf-29e0a9294382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:51.066667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abb468-ca30-406a-8fcf-29e0a9294382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:51.066936 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abb468-ca30-406a-8fcf-29e0a9294382 admin admin] PATH_INFO: `/v3/projects/1867d3bcbeb24d9897cfe20c4249fcb3` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:51.068839 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abb468-ca30-406a-8fcf-29e0a9294382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1867d3bcbeb24d9897cfe20c4249fcb3)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:51.070894 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abb468-ca30-406a-8fcf-29e0a9294382 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:51.130027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f8abb468-ca30-406a-8fcf-29e0a9294382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1867d3bcbeb24d9897cfe20c4249fcb3', 'request_id': 'req-f8abb468-ca30-406a-8fcf-29e0a9294382'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:51.141356 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f8abb468-ca30-406a-8fcf-29e0a9294382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1867d3bcbeb24d9897cfe20c4249fcb3', 'request_id': 'req-f8abb468-ca30-406a-8fcf-29e0a9294382'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:51.148683 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f8abb468-ca30-406a-8fcf-29e0a9294382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1867d3bcbeb24d9897cfe20c4249fcb3', 'request_id': 'req-f8abb468-ca30-406a-8fcf-29e0a9294382'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:51.162994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f8abb468-ca30-406a-8fcf-29e0a9294382 admin admin] The token cache is being invalidate because project 1867d3bcbeb24d9897cfe20c4249fcb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:50:51.163430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f8abb468-ca30-406a-8fcf-29e0a9294382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:51.164520 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f8abb468-ca30-406a-8fcf-29e0a9294382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:50:51.172206 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47f581-9367-4294-bf8e-88f0084c8f44 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:51.172491 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47f581-9367-4294-bf8e-88f0084c8f44 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:51.172953 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47f581-9367-4294-bf8e-88f0084c8f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:51.175888 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1356/2752] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:50:51 2022] DELETE /identity/v3/projects/1867d3bcbeb24d9897cfe20c4249fcb3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:51.194001 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-fa47f581-9367-4294-bf8e-88f0084c8f44 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:51.195607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-fa47f581-9367-4294-bf8e-88f0084c8f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:51.285412 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1397/2753] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:51.287130 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0739e87-a9e0-4975-b9e2-0e21fd81fd41 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:51.287500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0739e87-a9e0-4975-b9e2-0e21fd81fd41 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:51.287790 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0739e87-a9e0-4975-b9e2-0e21fd81fd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:51.315452 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-a0739e87-a9e0-4975-b9e2-0e21fd81fd41 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:51.317474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a0739e87-a9e0-4975-b9e2-0e21fd81fd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:51.334071 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1357/2754] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:51.342301 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47f581-9367-4294-bf8e-88f0084c8f44 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:51.355688 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47f581-9367-4294-bf8e-88f0084c8f44 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:51.361371 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384219c-7606-44eb-a1ba-e1fab7c3c6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:51.362071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384219c-7606-44eb-a1ba-e1fab7c3c6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:51.362358 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384219c-7606-44eb-a1ba-e1fab7c3c6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:51.362634 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384219c-7606-44eb-a1ba-e1fab7c3c6c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:51.363286 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384219c-7606-44eb-a1ba-e1fab7c3c6c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:50:51.363588 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384219c-7606-44eb-a1ba-e1fab7c3c6c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:51.365225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384219c-7606-44eb-a1ba-e1fab7c3c6c5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:51.378090 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1398/2755] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:50:51.382611 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0739e87-a9e0-4975-b9e2-0e21fd81fd41 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:51.393129 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0739e87-a9e0-4975-b9e2-0e21fd81fd41 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:51.398235 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37d23c-b09a-4484-b240-34a2b5ed4e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:51.398540 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37d23c-b09a-4484-b240-34a2b5ed4e5b admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:51.398815 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37d23c-b09a-4484-b240-34a2b5ed4e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:51.399083 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37d23c-b09a-4484-b240-34a2b5ed4e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:51.399724 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37d23c-b09a-4484-b240-34a2b5ed4e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:51.402215 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37d23c-b09a-4484-b240-34a2b5ed4e5b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:51.439858 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1358/2756] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:50:51 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:50:51.444491 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384219c-7606-44eb-a1ba-e1fab7c3c6c5 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:51.456462 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384219c-7606-44eb-a1ba-e1fab7c3c6c5 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:51.521906 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44529c9-64fd-435d-b316-7a8f87e469bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:51.522547 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44529c9-64fd-435d-b316-7a8f87e469bb admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:51.522828 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44529c9-64fd-435d-b316-7a8f87e469bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:51.523098 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44529c9-64fd-435d-b316-7a8f87e469bb admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:51.523736 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44529c9-64fd-435d-b316-7a8f87e469bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:51.525727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44529c9-64fd-435d-b316-7a8f87e469bb admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:51.549315 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1399/2757] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:50:51 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:50:51.553490 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37d23c-b09a-4484-b240-34a2b5ed4e5b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:51.573764 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37d23c-b09a-4484-b240-34a2b5ed4e5b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:51.579174 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83cd51-1af9-4db3-9a36-8c0e97d9c62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:51.579788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83cd51-1af9-4db3-9a36-8c0e97d9c62b admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:51.580062 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83cd51-1af9-4db3-9a36-8c0e97d9c62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:51.580468 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83cd51-1af9-4db3-9a36-8c0e97d9c62b admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:51.581174 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83cd51-1af9-4db3-9a36-8c0e97d9c62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:51.583087 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83cd51-1af9-4db3-9a36-8c0e97d9c62b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:51.595418 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1359/2758] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:50:51.603602 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44529c9-64fd-435d-b316-7a8f87e469bb admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:51.623624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44529c9-64fd-435d-b316-7a8f87e469bb admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:51.630560 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59877720-be65-480e-b0a6-f49255c3387c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:51.633273 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59877720-be65-480e-b0a6-f49255c3387c admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:51.633556 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59877720-be65-480e-b0a6-f49255c3387c admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:51.633828 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59877720-be65-480e-b0a6-f49255c3387c admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:51.635521 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59877720-be65-480e-b0a6-f49255c3387c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:51.639312 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59877720-be65-480e-b0a6-f49255c3387c admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:51.660106 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1400/2759] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:50:51.665138 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83cd51-1af9-4db3-9a36-8c0e97d9c62b admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:51.677367 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83cd51-1af9-4db3-9a36-8c0e97d9c62b admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:51.683526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d88ec-2f6b-43d7-91bf-faadb71735e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:51.684221 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d88ec-2f6b-43d7-91bf-faadb71735e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:51.684502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d88ec-2f6b-43d7-91bf-faadb71735e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:51.684845 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d88ec-2f6b-43d7-91bf-faadb71735e2 admin admin] PATH_INFO: `/v3/projects/6e41d767cb6b4718a0c3335ac728480f/users/5b2cda92aac84c41a048f0fce172766a/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:51.707788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d88ec-2f6b-43d7-91bf-faadb71735e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e41d767cb6b4718a0c3335ac728480f, user_id=5b2cda92aac84c41a048f0fce172766a, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:51.713453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d88ec-2f6b-43d7-91bf-faadb71735e2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:51.759803 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729b4dc-0f1c-4e61-9de0-dc545090a8ac None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:51.760086 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729b4dc-0f1c-4e61-9de0-dc545090a8ac None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:51.760324 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1360/2760] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:50:51 2022] PUT /identity/v3/projects/6e41d767cb6b4718a0c3335ac728480f/users/5b2cda92aac84c41a048f0fce172766a/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:50:51.760440 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729b4dc-0f1c-4e61-9de0-dc545090a8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:51.828683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-5729b4dc-0f1c-4e61-9de0-dc545090a8ac None None] MFA Rules not processed for user `5b2cda92aac84c41a048f0fce172766a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:51.834767 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5729b4dc-0f1c-4e61-9de0-dc545090a8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:51.917795 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:51.975962 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1401/2761] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:51.988226 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d88ec-2f6b-43d7-91bf-faadb71735e2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:51.990709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8a5d88ec-2f6b-43d7-91bf-faadb71735e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:52.055113 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d88ec-2f6b-43d7-91bf-faadb71735e2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:52.059209 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e62c69-3572-4ea1-8bf5-5d7d83170bfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:52.059831 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e62c69-3572-4ea1-8bf5-5d7d83170bfb service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:52.060109 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e62c69-3572-4ea1-8bf5-5d7d83170bfb service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:52.060380 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e62c69-3572-4ea1-8bf5-5d7d83170bfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:52.071366 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e62c69-3572-4ea1-8bf5-5d7d83170bfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:52.073532 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e62c69-3572-4ea1-8bf5-5d7d83170bfb service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:52.085169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1361/2762] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:50:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:50:52.611814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7800f8-b06b-439c-99a6-5511bf28c210 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:52.612297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7800f8-b06b-439c-99a6-5511bf28c210 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:52.612383 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7800f8-b06b-439c-99a6-5511bf28c210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:52.645570 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-8a7800f8-b06b-439c-99a6-5511bf28c210 None None] MFA Rules not processed for user `3c33e5b833d94502a5d86f67acce2eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:52.646810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8a7800f8-b06b-439c-99a6-5511bf28c210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:52.716430 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1402/2763] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:50:52.732590 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e62c69-3572-4ea1-8bf5-5d7d83170bfb service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:52.734913 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-70e62c69-3572-4ea1-8bf5-5d7d83170bfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:52.740797 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:50:52.817561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e62c69-3572-4ea1-8bf5-5d7d83170bfb service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:52.823668 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506962c-7388-4130-aa27-39845b60cec7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:52.824094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506962c-7388-4130-aa27-39845b60cec7 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:52.824375 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506962c-7388-4130-aa27-39845b60cec7 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:52.824707 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506962c-7388-4130-aa27-39845b60cec7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:52.835316 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506962c-7388-4130-aa27-39845b60cec7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:52.836924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506962c-7388-4130-aa27-39845b60cec7 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:52.846862 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1362/2764] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:50:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:50:54.186894 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51195c44-e5eb-4afd-9c9b-3267fc25dea3 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:54.187452 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51195c44-e5eb-4afd-9c9b-3267fc25dea3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:54.187452 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51195c44-e5eb-4afd-9c9b-3267fc25dea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:54.207067 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-51195c44-e5eb-4afd-9c9b-3267fc25dea3 None None] MFA Rules not processed for user `3c33e5b833d94502a5d86f67acce2eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:50:54.208265 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-51195c44-e5eb-4afd-9c9b-3267fc25dea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:54.215523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1403/2765] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:50:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:50:54.542991 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506962c-7388-4130-aa27-39845b60cec7 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:54.544651 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c506962c-7388-4130-aa27-39845b60cec7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:54.610488 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506962c-7388-4130-aa27-39845b60cec7 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:54.614289 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bedd6-5d5d-4f34-83f5-de59fda5a66e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:54.614889 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bedd6-5d5d-4f34-83f5-de59fda5a66e service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:54.615170 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bedd6-5d5d-4f34-83f5-de59fda5a66e service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:54.615442 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bedd6-5d5d-4f34-83f5-de59fda5a66e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:54.617205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-481bedd6-5d5d-4f34-83f5-de59fda5a66e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:54.627523 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481bedd6-5d5d-4f34-83f5-de59fda5a66e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:54.628959 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481bedd6-5d5d-4f34-83f5-de59fda5a66e service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:54.637123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1363/2766] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:50:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:50:54.964988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51195c44-e5eb-4afd-9c9b-3267fc25dea3 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:50:54.966607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-51195c44-e5eb-4afd-9c9b-3267fc25dea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:55.047913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51195c44-e5eb-4afd-9c9b-3267fc25dea3 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:50:55.052849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcc8e9-b1c6-45bc-bf54-d602888ea92c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed987b44d934ac7b2dc64c0aab28099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:50:55.053597 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcc8e9-b1c6-45bc-bf54-d602888ea92c service placement] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:50:55.053873 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcc8e9-b1c6-45bc-bf54-d602888ea92c service placement] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:50:55.054140 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcc8e9-b1c6-45bc-bf54-d602888ea92c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:50:55.055821 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-1abcc8e9-b1c6-45bc-bf54-d602888ea92c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:50:55.067926 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcc8e9-b1c6-45bc-bf54-d602888ea92c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:50:55.069556 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcc8e9-b1c6-45bc-bf54-d602888ea92c service placement] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:50:55.080274 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1404/2767] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:50:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:51:02.398228 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bedd6-5d5d-4f34-83f5-de59fda5a66e service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:51:02.459466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bedd6-5d5d-4f34-83f5-de59fda5a66e service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:51:02.463990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942735d-9a9f-4a6c-9561-712dc61d82a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:51:02.464602 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942735d-9a9f-4a6c-9561-712dc61d82a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:51:02.464876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942735d-9a9f-4a6c-9561-712dc61d82a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:51:02.465172 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942735d-9a9f-4a6c-9561-712dc61d82a7 admin admin] PATH_INFO: `/v3/users/5b2cda92aac84c41a048f0fce172766a` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:51:02.466279 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942735d-9a9f-4a6c-9561-712dc61d82a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b2cda92aac84c41a048f0fce172766a)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:51:02.468206 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942735d-9a9f-4a6c-9561-712dc61d82a7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:51:02.504226 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:51:02.518628 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f942735d-9a9f-4a6c-9561-712dc61d82a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b2cda92aac84c41a048f0fce172766a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:51:02.526575 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f942735d-9a9f-4a6c-9561-712dc61d82a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b2cda92aac84c41a048f0fce172766a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:51:02.527243 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f942735d-9a9f-4a6c-9561-712dc61d82a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b2cda92aac84c41a048f0fce172766a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:51:02.527911 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f942735d-9a9f-4a6c-9561-712dc61d82a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b2cda92aac84c41a048f0fce172766a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:51:02.540952 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-f942735d-9a9f-4a6c-9561-712dc61d82a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b2cda92aac84c41a048f0fce172766a'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:51:02.558370 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1364/2768] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:51:02 2022] DELETE /identity/v3/users/5b2cda92aac84c41a048f0fce172766a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:51:02.562893 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb248017-430d-406d-bc54-50166cfbacf6 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:51:02.564018 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb248017-430d-406d-bc54-50166cfbacf6 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:51:02.564224 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb248017-430d-406d-bc54-50166cfbacf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:51:02.584403 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-bb248017-430d-406d-bc54-50166cfbacf6 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:51:02.585669 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-bb248017-430d-406d-bc54-50166cfbacf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:51:02.629749 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:51:02.648903 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1405/2769] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:51:02.658876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942735d-9a9f-4a6c-9561-712dc61d82a7 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:51:02.660421 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f942735d-9a9f-4a6c-9561-712dc61d82a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:51:02.722500 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942735d-9a9f-4a6c-9561-712dc61d82a7 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:51:02.726200 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f33b5-6f34-49e4-80c0-0ecc2a3405fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:51:02.726800 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f33b5-6f34-49e4-80c0-0ecc2a3405fc service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:51:02.727080 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f33b5-6f34-49e4-80c0-0ecc2a3405fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:51:02.727354 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f33b5-6f34-49e4-80c0-0ecc2a3405fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:51:02.737273 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f33b5-6f34-49e4-80c0-0ecc2a3405fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:51:02.738711 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f33b5-6f34-49e4-80c0-0ecc2a3405fc service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:51:02.748110 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1365/2770] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:51:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:51:03.021833 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb248017-430d-406d-bc54-50166cfbacf6 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:51:03.023329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-bb248017-430d-406d-bc54-50166cfbacf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:51:03.038946 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb248017-430d-406d-bc54-50166cfbacf6 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:51:03.045780 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab501da-f83c-4d52-ab26-7831795da0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:51:03.046257 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab501da-f83c-4d52-ab26-7831795da0c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:51:03.046603 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab501da-f83c-4d52-ab26-7831795da0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:51:03.046945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab501da-f83c-4d52-ab26-7831795da0c2 admin admin] PATH_INFO: `/v3/projects/6e41d767cb6b4718a0c3335ac728480f` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:51:03.048831 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab501da-f83c-4d52-ab26-7831795da0c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e41d767cb6b4718a0c3335ac728480f)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:51:03.050844 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab501da-f83c-4d52-ab26-7831795da0c2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:51:03.099374 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bab501da-f83c-4d52-ab26-7831795da0c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e41d767cb6b4718a0c3335ac728480f', 'request_id': 'req-bab501da-f83c-4d52-ab26-7831795da0c2'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:51:03.104809 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bab501da-f83c-4d52-ab26-7831795da0c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e41d767cb6b4718a0c3335ac728480f', 'request_id': 'req-bab501da-f83c-4d52-ab26-7831795da0c2'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:51:03.113662 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bab501da-f83c-4d52-ab26-7831795da0c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e41d767cb6b4718a0c3335ac728480f', 'request_id': 'req-bab501da-f83c-4d52-ab26-7831795da0c2'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:51:03.128095 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bab501da-f83c-4d52-ab26-7831795da0c2 admin admin] The token cache is being invalidate because project 6e41d767cb6b4718a0c3335ac728480f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:51:03.128391 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bab501da-f83c-4d52-ab26-7831795da0c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:51:03.129055 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-bab501da-f83c-4d52-ab26-7831795da0c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:51:03.138121 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1406/2771] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:51:03 2022] DELETE /identity/v3/projects/6e41d767cb6b4718a0c3335ac728480f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:51:04.663622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f33b5-6f34-49e4-80c0-0ecc2a3405fc service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:51:04.665078 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-594f33b5-6f34-49e4-80c0-0ecc2a3405fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:51:04.742292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f33b5-6f34-49e4-80c0-0ecc2a3405fc service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:51:04.787683 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:51:04.806040 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c60738-4160-44bb-91bc-745b9c5f1557 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:51:04.806645 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c60738-4160-44bb-91bc-745b9c5f1557 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:51:04.806927 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c60738-4160-44bb-91bc-745b9c5f1557 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:51:04.807281 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c60738-4160-44bb-91bc-745b9c5f1557 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:51:04.812459 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-20c60738-4160-44bb-91bc-745b9c5f1557 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:51:04.825330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c60738-4160-44bb-91bc-745b9c5f1557 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:51:04.826910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c60738-4160-44bb-91bc-745b9c5f1557 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:51:04.838169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1366/2772] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:51:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:51:13.124715 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=33,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:51:14.833765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=11 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:19.646870 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab501da-f83c-4d52-ab26-7831795da0c2 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:53:19.648298 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-bab501da-f83c-4d52-ab26-7831795da0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:53:19.757433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab501da-f83c-4d52-ab26-7831795da0c2 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:53:19.764952 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae0aac-d848-495b-b391-089cdc0b8198 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:53:19.765787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae0aac-d848-495b-b391-089cdc0b8198 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:53:19.766140 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae0aac-d848-495b-b391-089cdc0b8198 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:53:19.766422 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae0aac-d848-495b-b391-089cdc0b8198 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:53:19.768514 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-25ae0aac-d848-495b-b391-089cdc0b8198 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:53:19.791543 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae0aac-d848-495b-b391-089cdc0b8198 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:53:19.791886 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae0aac-d848-495b-b391-089cdc0b8198 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:53:19.804629 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1407/2773] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:53:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:53:24.048450 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c60738-4160-44bb-91bc-745b9c5f1557 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:53:24.050004 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-20c60738-4160-44bb-91bc-745b9c5f1557 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:53:24.206266 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c60738-4160-44bb-91bc-745b9c5f1557 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:53:24.213203 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9309fa4-e685-4b23-a72d-62d783444f54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed987b44d934ac7b2dc64c0aab28099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:53:24.213816 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9309fa4-e685-4b23-a72d-62d783444f54 service placement] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:53:24.214095 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9309fa4-e685-4b23-a72d-62d783444f54 service placement] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:53:24.214367 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9309fa4-e685-4b23-a72d-62d783444f54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:53:24.216143 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c9309fa4-e685-4b23-a72d-62d783444f54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:53:24.228044 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9309fa4-e685-4b23-a72d-62d783444f54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:53:24.229679 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9309fa4-e685-4b23-a72d-62d783444f54 service placement] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:53:24.240130 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1367/2774] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:53:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:53:28.316622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91893ac4-1deb-485c-a6f1-080b2b5fd5c1 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:53:28.317248 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91893ac4-1deb-485c-a6f1-080b2b5fd5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:53:28.317248 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91893ac4-1deb-485c-a6f1-080b2b5fd5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:53:28.340713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-91893ac4-1deb-485c-a6f1-080b2b5fd5c1 None None] MFA Rules not processed for user `3c33e5b833d94502a5d86f67acce2eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:53:28.342115 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-91893ac4-1deb-485c-a6f1-080b2b5fd5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:53:28.408473 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1408/2775] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:53:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:53:33.852405 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9309fa4-e685-4b23-a72d-62d783444f54 service placement] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:53:33.854648 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c9309fa4-e685-4b23-a72d-62d783444f54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:53:33.869453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9309fa4-e685-4b23-a72d-62d783444f54 service placement] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:53:33.875167 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cc0e8-4f03-4ea0-b9c3-6f7b0e7bae73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed987b44d934ac7b2dc64c0aab28099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:53:33.876078 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cc0e8-4f03-4ea0-b9c3-6f7b0e7bae73 service placement] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:53:33.885552 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cc0e8-4f03-4ea0-b9c3-6f7b0e7bae73 service placement] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:53:33.886421 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cc0e8-4f03-4ea0-b9c3-6f7b0e7bae73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:53:33.889348 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1f9cc0e8-4f03-4ea0-b9c3-6f7b0e7bae73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:53:33.911320 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9cc0e8-4f03-4ea0-b9c3-6f7b0e7bae73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:53:33.913978 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9cc0e8-4f03-4ea0-b9c3-6f7b0e7bae73 service placement] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:53:33.944976 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91893ac4-1deb-485c-a6f1-080b2b5fd5c1 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:53:33.945587 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1368/2776] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:53:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:53:33.946587 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-91893ac4-1deb-485c-a6f1-080b2b5fd5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:53:34.056984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=100 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:34.071517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91893ac4-1deb-485c-a6f1-080b2b5fd5c1 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:53:34.076872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50080d38-faf8-4acf-8f95-2dcf0cec5a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:53:34.079748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50080d38-faf8-4acf-8f95-2dcf0cec5a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:53:34.079748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50080d38-faf8-4acf-8f95-2dcf0cec5a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:53:34.079748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50080d38-faf8-4acf-8f95-2dcf0cec5a31 admin admin] PATH_INFO: `/v3/users/d5025975a88f43b6abbd88051539efac` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:53:34.079748 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50080d38-faf8-4acf-8f95-2dcf0cec5a31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5025975a88f43b6abbd88051539efac)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:53:34.081450 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50080d38-faf8-4acf-8f95-2dcf0cec5a31 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:53:34.131174 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-50080d38-faf8-4acf-8f95-2dcf0cec5a31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5025975a88f43b6abbd88051539efac'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:53:34.143818 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-50080d38-faf8-4acf-8f95-2dcf0cec5a31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5025975a88f43b6abbd88051539efac'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:53:34.144682 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-50080d38-faf8-4acf-8f95-2dcf0cec5a31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5025975a88f43b6abbd88051539efac'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:53:34.146415 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-50080d38-faf8-4acf-8f95-2dcf0cec5a31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5025975a88f43b6abbd88051539efac'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:53:34.160607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-50080d38-faf8-4acf-8f95-2dcf0cec5a31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5025975a88f43b6abbd88051539efac'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:53:34.180698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1409/2777] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:53:33 2022] DELETE /identity/v3/users/d5025975a88f43b6abbd88051539efac => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:53:34.383503 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cc0e8-4f03-4ea0-b9c3-6f7b0e7bae73 service placement] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:53:34.395784 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cc0e8-4f03-4ea0-b9c3-6f7b0e7bae73 service placement] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:53:34.457762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d88ffc-56f9-42d1-ad89-4f7eff07a769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:53:34.458763 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d88ffc-56f9-42d1-ad89-4f7eff07a769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:53:34.459357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d88ffc-56f9-42d1-ad89-4f7eff07a769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:53:34.459831 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d88ffc-56f9-42d1-ad89-4f7eff07a769 admin admin] PATH_INFO: `/v3/projects/26ff69265c1a4321a92190aa1f9f986f` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:53:34.461329 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d88ffc-56f9-42d1-ad89-4f7eff07a769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26ff69265c1a4321a92190aa1f9f986f)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:53:34.463352 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d88ffc-56f9-42d1-ad89-4f7eff07a769 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:53:34.476276 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=100 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:34.514887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-72d88ffc-56f9-42d1-ad89-4f7eff07a769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26ff69265c1a4321a92190aa1f9f986f', 'request_id': 'req-72d88ffc-56f9-42d1-ad89-4f7eff07a769'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:53:34.523472 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-72d88ffc-56f9-42d1-ad89-4f7eff07a769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26ff69265c1a4321a92190aa1f9f986f', 'request_id': 'req-72d88ffc-56f9-42d1-ad89-4f7eff07a769'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:53:34.529951 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-72d88ffc-56f9-42d1-ad89-4f7eff07a769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26ff69265c1a4321a92190aa1f9f986f', 'request_id': 'req-72d88ffc-56f9-42d1-ad89-4f7eff07a769'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:53:34.541295 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-72d88ffc-56f9-42d1-ad89-4f7eff07a769 admin admin] The token cache is being invalidate because project 26ff69265c1a4321a92190aa1f9f986f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:53:34.541590 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-72d88ffc-56f9-42d1-ad89-4f7eff07a769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:53:34.542264 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-72d88ffc-56f9-42d1-ad89-4f7eff07a769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:53:34.543747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1369/2778] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:53:34 2022] DELETE /identity/v3/projects/26ff69265c1a4321a92190aa1f9f986f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:53:34.547852 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50080d38-faf8-4acf-8f95-2dcf0cec5a31 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:53:34.550068 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-50080d38-faf8-4acf-8f95-2dcf0cec5a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:53:34.562909 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50080d38-faf8-4acf-8f95-2dcf0cec5a31 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:53:34.633457 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370d410-ff3e-4c80-a826-cda5a0fbd042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:53:34.634093 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370d410-ff3e-4c80-a826-cda5a0fbd042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:53:34.634375 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370d410-ff3e-4c80-a826-cda5a0fbd042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:53:34.634650 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370d410-ff3e-4c80-a826-cda5a0fbd042 admin admin] PATH_INFO: `/v3/users/21fc60b88f7940318fa0fd217664c594` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:53:34.636325 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370d410-ff3e-4c80-a826-cda5a0fbd042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21fc60b88f7940318fa0fd217664c594)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:53:34.638296 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370d410-ff3e-4c80-a826-cda5a0fbd042 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:53:34.691324 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2370d410-ff3e-4c80-a826-cda5a0fbd042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21fc60b88f7940318fa0fd217664c594'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:53:34.700095 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2370d410-ff3e-4c80-a826-cda5a0fbd042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21fc60b88f7940318fa0fd217664c594'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:53:34.700766 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2370d410-ff3e-4c80-a826-cda5a0fbd042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21fc60b88f7940318fa0fd217664c594'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:53:34.701539 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2370d410-ff3e-4c80-a826-cda5a0fbd042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21fc60b88f7940318fa0fd217664c594'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:53:34.709693 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-2370d410-ff3e-4c80-a826-cda5a0fbd042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21fc60b88f7940318fa0fd217664c594'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:53:34.715454 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:34.729305 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1410/2779] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:53:34 2022] DELETE /identity/v3/users/21fc60b88f7940318fa0fd217664c594 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:53:34.899465 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d88ffc-56f9-42d1-ad89-4f7eff07a769 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:53:34.900996 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-72d88ffc-56f9-42d1-ad89-4f7eff07a769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:53:34.915543 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d88ffc-56f9-42d1-ad89-4f7eff07a769 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:53:34.973287 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197e3d3-17ed-4ef9-893a-50bb01c81f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:53:34.973910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197e3d3-17ed-4ef9-893a-50bb01c81f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:53:34.974186 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197e3d3-17ed-4ef9-893a-50bb01c81f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:53:34.974457 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197e3d3-17ed-4ef9-893a-50bb01c81f79 admin admin] PATH_INFO: `/v3/projects/367ac0aab2184757bc740f66a50f453b` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:53:34.975551 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197e3d3-17ed-4ef9-893a-50bb01c81f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=367ac0aab2184757bc740f66a50f453b)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:53:34.977504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197e3d3-17ed-4ef9-893a-50bb01c81f79 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:53:35.023333 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b197e3d3-17ed-4ef9-893a-50bb01c81f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '367ac0aab2184757bc740f66a50f453b', 'request_id': 'req-b197e3d3-17ed-4ef9-893a-50bb01c81f79'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:53:35.031755 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b197e3d3-17ed-4ef9-893a-50bb01c81f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '367ac0aab2184757bc740f66a50f453b', 'request_id': 'req-b197e3d3-17ed-4ef9-893a-50bb01c81f79'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:53:35.037295 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b197e3d3-17ed-4ef9-893a-50bb01c81f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '367ac0aab2184757bc740f66a50f453b', 'request_id': 'req-b197e3d3-17ed-4ef9-893a-50bb01c81f79'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:53:35.048106 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b197e3d3-17ed-4ef9-893a-50bb01c81f79 admin admin] The token cache is being invalidate because project 367ac0aab2184757bc740f66a50f453b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:53:35.048389 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b197e3d3-17ed-4ef9-893a-50bb01c81f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:53:35.049004 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-b197e3d3-17ed-4ef9-893a-50bb01c81f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:53:35.050510 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1370/2780] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:53:34 2022] DELETE /identity/v3/projects/367ac0aab2184757bc740f66a50f453b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:53:44.725637 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=5,keystone:DELETE=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:53:45.045200 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=71,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:54:37.429321 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370d410-ff3e-4c80-a826-cda5a0fbd042 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:54:37.432713 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2370d410-ff3e-4c80-a826-cda5a0fbd042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:54:37.449007 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370d410-ff3e-4c80-a826-cda5a0fbd042 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:54:37.513728 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea86cca-550d-4125-b35e-eb177067b0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:54:37.514368 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea86cca-550d-4125-b35e-eb177067b0a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:54:37.514647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea86cca-550d-4125-b35e-eb177067b0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:54:37.514921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea86cca-550d-4125-b35e-eb177067b0a8 admin admin] PATH_INFO: `/v3/users/3c33e5b833d94502a5d86f67acce2eef` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:54:37.516145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea86cca-550d-4125-b35e-eb177067b0a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c33e5b833d94502a5d86f67acce2eef)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:54:37.518116 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea86cca-550d-4125-b35e-eb177067b0a8 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:54:37.565347 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0ea86cca-550d-4125-b35e-eb177067b0a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c33e5b833d94502a5d86f67acce2eef'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:54:37.575907 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0ea86cca-550d-4125-b35e-eb177067b0a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c33e5b833d94502a5d86f67acce2eef'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:54:37.576582 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0ea86cca-550d-4125-b35e-eb177067b0a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c33e5b833d94502a5d86f67acce2eef'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:54:37.577296 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0ea86cca-550d-4125-b35e-eb177067b0a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c33e5b833d94502a5d86f67acce2eef'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:54:37.584297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-0ea86cca-550d-4125-b35e-eb177067b0a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c33e5b833d94502a5d86f67acce2eef'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:54:37.601331 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1411/2781] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:54:37 2022] DELETE /identity/v3/users/3c33e5b833d94502a5d86f67acce2eef => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:54:37.771271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197e3d3-17ed-4ef9-893a-50bb01c81f79 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:54:37.772767 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b197e3d3-17ed-4ef9-893a-50bb01c81f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:54:37.785468 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197e3d3-17ed-4ef9-893a-50bb01c81f79 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:54:37.846057 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c36f5-47c9-43e9-8d2e-5ad1999eabb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:54:37.846728 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c36f5-47c9-43e9-8d2e-5ad1999eabb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:54:37.847032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c36f5-47c9-43e9-8d2e-5ad1999eabb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:54:37.847301 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c36f5-47c9-43e9-8d2e-5ad1999eabb7 admin admin] PATH_INFO: `/v3/projects/aec54caea46949d3ad7d18f99d2f5d19` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:54:37.848421 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c36f5-47c9-43e9-8d2e-5ad1999eabb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aec54caea46949d3ad7d18f99d2f5d19)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:54:37.851032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c36f5-47c9-43e9-8d2e-5ad1999eabb7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:54:37.900574 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-404c36f5-47c9-43e9-8d2e-5ad1999eabb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aec54caea46949d3ad7d18f99d2f5d19', 'request_id': 'req-404c36f5-47c9-43e9-8d2e-5ad1999eabb7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:54:37.907152 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-404c36f5-47c9-43e9-8d2e-5ad1999eabb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aec54caea46949d3ad7d18f99d2f5d19', 'request_id': 'req-404c36f5-47c9-43e9-8d2e-5ad1999eabb7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:54:37.913331 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-404c36f5-47c9-43e9-8d2e-5ad1999eabb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aec54caea46949d3ad7d18f99d2f5d19', 'request_id': 'req-404c36f5-47c9-43e9-8d2e-5ad1999eabb7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:54:37.924924 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-404c36f5-47c9-43e9-8d2e-5ad1999eabb7 admin admin] The token cache is being invalidate because project aec54caea46949d3ad7d18f99d2f5d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:54:37.925257 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-404c36f5-47c9-43e9-8d2e-5ad1999eabb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:54:37.925898 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-404c36f5-47c9-43e9-8d2e-5ad1999eabb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:54:37.927375 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1371/2782] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:54:37 2022] DELETE /identity/v3/projects/aec54caea46949d3ad7d18f99d2f5d19 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:54:37.933101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222296d4-1327-4a6e-a232-85139fe9b4c6 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:54:37.933417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222296d4-1327-4a6e-a232-85139fe9b4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:54:37.933691 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222296d4-1327-4a6e-a232-85139fe9b4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:54:37.992420 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-222296d4-1327-4a6e-a232-85139fe9b4c6 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:54:37.993559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-222296d4-1327-4a6e-a232-85139fe9b4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:54:38.036013 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:54:38.053881 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1412/2783] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:54:38.061727 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e3a12-395a-4454-b955-f0db571e9450 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:54:38.062121 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e3a12-395a-4454-b955-f0db571e9450 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:54:38.062395 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e3a12-395a-4454-b955-f0db571e9450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:54:38.082336 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-121e3a12-395a-4454-b955-f0db571e9450 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:54:38.083528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-121e3a12-395a-4454-b955-f0db571e9450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:54:38.091410 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1372/2784] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:54:38.095641 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222296d4-1327-4a6e-a232-85139fe9b4c6 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:54:38.105709 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222296d4-1327-4a6e-a232-85139fe9b4c6 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:54:38.110198 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d1d65-6cec-42fd-9e8c-63a4b087f023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:54:38.110816 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d1d65-6cec-42fd-9e8c-63a4b087f023 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:54:38.111093 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d1d65-6cec-42fd-9e8c-63a4b087f023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:54:38.111363 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d1d65-6cec-42fd-9e8c-63a4b087f023 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:54:38.112546 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d1d65-6cec-42fd-9e8c-63a4b087f023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:54:38.112546 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d1d65-6cec-42fd-9e8c-63a4b087f023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:54:38.113929 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d1d65-6cec-42fd-9e8c-63a4b087f023 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:54:38.126268 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1413/2785] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:54:38.130761 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e3a12-395a-4454-b955-f0db571e9450 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:54:38.140111 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e3a12-395a-4454-b955-f0db571e9450 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:54:38.144990 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181d3e2-dbe0-4c3b-9627-2b1a05aa9be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:54:38.145612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181d3e2-dbe0-4c3b-9627-2b1a05aa9be2 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:54:38.145889 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181d3e2-dbe0-4c3b-9627-2b1a05aa9be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:54:38.146177 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181d3e2-dbe0-4c3b-9627-2b1a05aa9be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:54:38.147404 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181d3e2-dbe0-4c3b-9627-2b1a05aa9be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:54:38.149325 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181d3e2-dbe0-4c3b-9627-2b1a05aa9be2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:54:38.188066 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1373/2786] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:54:38 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:54:38.192329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d1d65-6cec-42fd-9e8c-63a4b087f023 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:54:38.202758 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d1d65-6cec-42fd-9e8c-63a4b087f023 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:54:38.260625 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403de0a3-ed52-4d54-8573-960ea81f6bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:54:38.261171 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403de0a3-ed52-4d54-8573-960ea81f6bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:54:38.261451 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403de0a3-ed52-4d54-8573-960ea81f6bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:54:38.261781 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403de0a3-ed52-4d54-8573-960ea81f6bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:54:38.262392 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403de0a3-ed52-4d54-8573-960ea81f6bd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:54:38.264288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403de0a3-ed52-4d54-8573-960ea81f6bd6 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:54:38.285782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1414/2787] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:54:38 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:54:38.290546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181d3e2-dbe0-4c3b-9627-2b1a05aa9be2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:54:38.300865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181d3e2-dbe0-4c3b-9627-2b1a05aa9be2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:54:38.306880 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec0be7-037b-4cc9-8c3c-64372deb7c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:54:38.307483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec0be7-037b-4cc9-8c3c-64372deb7c54 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:54:38.307767 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec0be7-037b-4cc9-8c3c-64372deb7c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:54:38.308237 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec0be7-037b-4cc9-8c3c-64372deb7c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:54:38.309397 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec0be7-037b-4cc9-8c3c-64372deb7c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:54:38.311093 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec0be7-037b-4cc9-8c3c-64372deb7c54 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:54:38.321547 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1374/2788] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:54:38.326039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403de0a3-ed52-4d54-8573-960ea81f6bd6 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:54:38.339005 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403de0a3-ed52-4d54-8573-960ea81f6bd6 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:54:38.343686 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890f8e1-0ac5-4a93-b344-874960f9dce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:54:38.344369 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890f8e1-0ac5-4a93-b344-874960f9dce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:54:38.344668 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890f8e1-0ac5-4a93-b344-874960f9dce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:54:38.344944 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890f8e1-0ac5-4a93-b344-874960f9dce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:54:38.345860 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890f8e1-0ac5-4a93-b344-874960f9dce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:54:38.347246 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890f8e1-0ac5-4a93-b344-874960f9dce5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:54:38.358959 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1415/2789] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:54:38.363144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec0be7-037b-4cc9-8c3c-64372deb7c54 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:54:38.374873 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec0be7-037b-4cc9-8c3c-64372deb7c54 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:54:38.380146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14d312-5f98-403c-aef8-4ebe8800c5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:54:38.380792 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14d312-5f98-403c-aef8-4ebe8800c5be admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:54:38.381072 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14d312-5f98-403c-aef8-4ebe8800c5be admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:54:38.381382 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14d312-5f98-403c-aef8-4ebe8800c5be admin admin] PATH_INFO: `/v3/projects/cb4ab2183924495991f871f187f12bbb/users/b4ca69ce65034553a485ce6f9d3727e2/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:54:38.396063 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14d312-5f98-403c-aef8-4ebe8800c5be admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb4ab2183924495991f871f187f12bbb, user_id=b4ca69ce65034553a485ce6f9d3727e2, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:54:38.399284 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14d312-5f98-403c-aef8-4ebe8800c5be admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:54:38.414200 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1375/2790] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:54:38 2022] PUT /identity/v3/projects/cb4ab2183924495991f871f187f12bbb/users/b4ca69ce65034553a485ce6f9d3727e2/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:54:38.419434 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f04c-5bcc-4d9b-b2f1-295ef9b6bf84 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:54:38.419861 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f04c-5bcc-4d9b-b2f1-295ef9b6bf84 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:54:38.420183 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f04c-5bcc-4d9b-b2f1-295ef9b6bf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:54:38.439324 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-9e04f04c-5bcc-4d9b-b2f1-295ef9b6bf84 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:54:38.440749 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9e04f04c-5bcc-4d9b-b2f1-295ef9b6bf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:54:38.502154 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1416/2791] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:54:38.512714 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14d312-5f98-403c-aef8-4ebe8800c5be admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:54:38.514372 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-6b14d312-5f98-403c-aef8-4ebe8800c5be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:54:38.536829 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:54:38.594420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14d312-5f98-403c-aef8-4ebe8800c5be admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:54:38.598102 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c82e7-0dfb-4017-a1f5-85881148fded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:54:38.598693 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c82e7-0dfb-4017-a1f5-85881148fded service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:54:38.598966 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c82e7-0dfb-4017-a1f5-85881148fded service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:54:38.599231 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c82e7-0dfb-4017-a1f5-85881148fded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:54:38.608158 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c82e7-0dfb-4017-a1f5-85881148fded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:54:38.609636 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c82e7-0dfb-4017-a1f5-85881148fded service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:54:38.619437 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1376/2792] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:54:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:54:42.498069 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac654b-d89f-4718-8fcc-f67dd3a8c9c6 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:54:42.498583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac654b-d89f-4718-8fcc-f67dd3a8c9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:54:42.498700 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac654b-d89f-4718-8fcc-f67dd3a8c9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:54:42.531667 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-55ac654b-d89f-4718-8fcc-f67dd3a8c9c6 None None] MFA Rules not processed for user `b4ca69ce65034553a485ce6f9d3727e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:54:42.533036 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-55ac654b-d89f-4718-8fcc-f67dd3a8c9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:54:42.589579 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:54:42.615252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1417/2793] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:54:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:54:42.631847 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c82e7-0dfb-4017-a1f5-85881148fded service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:54:42.633377 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-112c82e7-0dfb-4017-a1f5-85881148fded service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:54:42.708453 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c82e7-0dfb-4017-a1f5-85881148fded service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:54:42.714070 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76580f-a4f7-46ec-857c-bcc6fc7b2d1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:54:42.714675 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76580f-a4f7-46ec-857c-bcc6fc7b2d1a service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:54:42.714972 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76580f-a4f7-46ec-857c-bcc6fc7b2d1a service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:54:42.715243 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76580f-a4f7-46ec-857c-bcc6fc7b2d1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:54:42.723468 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76580f-a4f7-46ec-857c-bcc6fc7b2d1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:54:42.725207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76580f-a4f7-46ec-857c-bcc6fc7b2d1a service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:54:42.742427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1377/2794] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:54:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:54:44.085364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74919eb7-ca98-4743-967e-12ba9b2806ff None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:54:44.085930 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74919eb7-ca98-4743-967e-12ba9b2806ff None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:54:44.085930 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74919eb7-ca98-4743-967e-12ba9b2806ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:54:44.105450 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-74919eb7-ca98-4743-967e-12ba9b2806ff None None] MFA Rules not processed for user `b4ca69ce65034553a485ce6f9d3727e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:54:44.106645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-74919eb7-ca98-4743-967e-12ba9b2806ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:54:44.113526 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1418/2795] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:54:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:54:44.151964 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76580f-a4f7-46ec-857c-bcc6fc7b2d1a service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:54:44.153523 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ec76580f-a4f7-46ec-857c-bcc6fc7b2d1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:54:44.213557 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76580f-a4f7-46ec-857c-bcc6fc7b2d1a service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:54:44.217519 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d24acf-b21f-45ba-a925-95ef3be63b8e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f12ce70a7c4f4396ab3fbb635dfc548b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:54:44.218137 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d24acf-b21f-45ba-a925-95ef3be63b8e service glance] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:54:44.219000 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d24acf-b21f-45ba-a925-95ef3be63b8e service glance] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:54:44.219454 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d24acf-b21f-45ba-a925-95ef3be63b8e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:54:44.221558 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d2d24acf-b21f-45ba-a925-95ef3be63b8e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:54:44.236617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d24acf-b21f-45ba-a925-95ef3be63b8e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:54:44.238116 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d24acf-b21f-45ba-a925-95ef3be63b8e service glance] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:54:44.249856 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1378/2796] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:54:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:54:44.861013 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74919eb7-ca98-4743-967e-12ba9b2806ff None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:54:44.862461 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-74919eb7-ca98-4743-967e-12ba9b2806ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:54:44.874871 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74919eb7-ca98-4743-967e-12ba9b2806ff None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:54:44.878407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607c7b9-ce83-4de2-b991-572833a70645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:54:44.879000 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607c7b9-ce83-4de2-b991-572833a70645 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:54:44.879274 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607c7b9-ce83-4de2-b991-572833a70645 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:54:44.879544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607c7b9-ce83-4de2-b991-572833a70645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:54:44.881349 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-8607c7b9-ce83-4de2-b991-572833a70645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:54:44.895606 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607c7b9-ce83-4de2-b991-572833a70645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:54:44.897820 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607c7b9-ce83-4de2-b991-572833a70645 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:54:44.909384 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1419/2797] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:54:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:54:54.244438 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=87 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:54:54.904810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=16 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:55:36.600852 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32836cfc-6cce-4f74-972b-0b5d60993476 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:55:36.601421 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32836cfc-6cce-4f74-972b-0b5d60993476 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:55:36.601421 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32836cfc-6cce-4f74-972b-0b5d60993476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:55:36.620075 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-32836cfc-6cce-4f74-972b-0b5d60993476 None None] MFA Rules not processed for user `b4ca69ce65034553a485ce6f9d3727e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:55:36.621309 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-32836cfc-6cce-4f74-972b-0b5d60993476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:55:36.628091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1379/2798] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:55:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:55:39.092873 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607c7b9-ce83-4de2-b991-572833a70645 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:55:39.102429 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607c7b9-ce83-4de2-b991-572833a70645 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:55:39.106127 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7069b40-e598-4dcf-83c3-953c77586bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:55:39.106746 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7069b40-e598-4dcf-83c3-953c77586bdd service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:55:39.107024 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7069b40-e598-4dcf-83c3-953c77586bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:55:39.107293 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7069b40-e598-4dcf-83c3-953c77586bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:55:39.109121 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b7069b40-e598-4dcf-83c3-953c77586bdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:55:39.119960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7069b40-e598-4dcf-83c3-953c77586bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:55:39.121431 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7069b40-e598-4dcf-83c3-953c77586bdd service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:55:39.130287 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1420/2799] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:55:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:55:39.776765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32836cfc-6cce-4f74-972b-0b5d60993476 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:55:39.778285 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-32836cfc-6cce-4f74-972b-0b5d60993476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:55:39.796225 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32836cfc-6cce-4f74-972b-0b5d60993476 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:55:39.802146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f72a5-30aa-4d88-a70d-8d43c61f0d59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:55:39.802755 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f72a5-30aa-4d88-a70d-8d43c61f0d59 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:55:39.803032 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f72a5-30aa-4d88-a70d-8d43c61f0d59 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:55:39.803309 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f72a5-30aa-4d88-a70d-8d43c61f0d59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:55:39.805597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f43f72a5-30aa-4d88-a70d-8d43c61f0d59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:55:39.828856 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f72a5-30aa-4d88-a70d-8d43c61f0d59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:55:39.830529 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f72a5-30aa-4d88-a70d-8d43c61f0d59 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:55:39.853277 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1380/2800] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:55:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:55:49.126199 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=6 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:55:49.837729 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=9 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:56:33.510411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd11b46-810a-4eee-99f7-bea56793e822 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:56:33.510968 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd11b46-810a-4eee-99f7-bea56793e822 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:56:33.510968 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd11b46-810a-4eee-99f7-bea56793e822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:56:33.529953 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-0bd11b46-810a-4eee-99f7-bea56793e822 None None] MFA Rules not processed for user `b4ca69ce65034553a485ce6f9d3727e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:56:33.531228 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0bd11b46-810a-4eee-99f7-bea56793e822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:56:33.538139 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1421/2801] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:56:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:56:33.840150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f72a5-30aa-4d88-a70d-8d43c61f0d59 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:56:33.850059 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f72a5-30aa-4d88-a70d-8d43c61f0d59 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:56:33.853596 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171e6e8-0fe9-4484-bb4f-097357383d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:56:33.854175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171e6e8-0fe9-4484-bb4f-097357383d45 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:56:33.854464 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171e6e8-0fe9-4484-bb4f-097357383d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:56:33.854713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171e6e8-0fe9-4484-bb4f-097357383d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:56:33.856386 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-e171e6e8-0fe9-4484-bb4f-097357383d45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:56:33.866150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171e6e8-0fe9-4484-bb4f-097357383d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:56:33.867550 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e171e6e8-0fe9-4484-bb4f-097357383d45 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:56:33.875357 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1381/2802] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:56:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:56:34.429394 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd11b46-810a-4eee-99f7-bea56793e822 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:56:34.430744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-0bd11b46-810a-4eee-99f7-bea56793e822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:56:34.501028 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd11b46-810a-4eee-99f7-bea56793e822 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:56:34.506012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4124d9c-b5b9-4a85-a1e5-354e6f060a9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed987b44d934ac7b2dc64c0aab28099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:56:34.506613 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4124d9c-b5b9-4a85-a1e5-354e6f060a9a service placement] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:56:34.506892 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4124d9c-b5b9-4a85-a1e5-354e6f060a9a service placement] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:56:34.507163 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4124d9c-b5b9-4a85-a1e5-354e6f060a9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:56:34.508872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c4124d9c-b5b9-4a85-a1e5-354e6f060a9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:56:34.520555 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4124d9c-b5b9-4a85-a1e5-354e6f060a9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:56:34.522164 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4124d9c-b5b9-4a85-a1e5-354e6f060a9a service placement] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:56:34.532449 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1422/2803] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:56:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:56:42.226600 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171e6e8-0fe9-4484-bb4f-097357383d45 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:56:42.242956 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171e6e8-0fe9-4484-bb4f-097357383d45 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:56:42.248624 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04866b6-e65d-45d5-978e-8b95ec8684e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:56:42.249276 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04866b6-e65d-45d5-978e-8b95ec8684e8 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:56:42.249560 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04866b6-e65d-45d5-978e-8b95ec8684e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:56:42.249834 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04866b6-e65d-45d5-978e-8b95ec8684e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:56:42.251682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c04866b6-e65d-45d5-978e-8b95ec8684e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:56:42.264111 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04866b6-e65d-45d5-978e-8b95ec8684e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:56:42.265782 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04866b6-e65d-45d5-978e-8b95ec8684e8 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:56:42.276408 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1382/2804] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:56:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:56:44.527795 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=35 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:56:52.271821 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=12 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:57:25.370622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f2dea-7260-4eba-b9b4-e2afce4a878f None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:57:25.371190 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f2dea-7260-4eba-b9b4-e2afce4a878f None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:57:25.371190 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f2dea-7260-4eba-b9b4-e2afce4a878f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:57:25.390168 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ba9f2dea-7260-4eba-b9b4-e2afce4a878f None None] MFA Rules not processed for user `b4ca69ce65034553a485ce6f9d3727e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:57:25.391387 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ba9f2dea-7260-4eba-b9b4-e2afce4a878f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:57:25.398746 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1423/2805] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:57:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:57:25.700824 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04866b6-e65d-45d5-978e-8b95ec8684e8 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:57:25.711015 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04866b6-e65d-45d5-978e-8b95ec8684e8 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:57:25.714608 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb67b4-e825-40ef-b9bb-46840a83a0ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:57:25.715194 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb67b4-e825-40ef-b9bb-46840a83a0ec service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:57:25.715468 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb67b4-e825-40ef-b9bb-46840a83a0ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:57:25.715736 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb67b4-e825-40ef-b9bb-46840a83a0ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:57:25.717439 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b1eb67b4-e825-40ef-b9bb-46840a83a0ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:57:25.726693 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb67b4-e825-40ef-b9bb-46840a83a0ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:57:25.728099 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb67b4-e825-40ef-b9bb-46840a83a0ec service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:57:25.735933 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1383/2806] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:57:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:57:35.385198 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:57:35.732468 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=6 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:26.680649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f2dea-7260-4eba-b9b4-e2afce4a878f None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:26.695412 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f2dea-7260-4eba-b9b4-e2afce4a878f None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:26.700557 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5abe8-81fa-46eb-8693-a489ec55c2bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed987b44d934ac7b2dc64c0aab28099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:26.701226 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5abe8-81fa-46eb-8693-a489ec55c2bb service placement] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:26.701517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5abe8-81fa-46eb-8693-a489ec55c2bb service placement] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:26.701971 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5abe8-81fa-46eb-8693-a489ec55c2bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:26.704204 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2bb5abe8-81fa-46eb-8693-a489ec55c2bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:26.720947 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5abe8-81fa-46eb-8693-a489ec55c2bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:26.722909 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5abe8-81fa-46eb-8693-a489ec55c2bb service placement] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:26.733811 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1424/2807] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:58:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:58:26.747993 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb67b4-e825-40ef-b9bb-46840a83a0ec service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:26.761849 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb67b4-e825-40ef-b9bb-46840a83a0ec service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:26.766559 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35190d73-a502-4269-a211-56b6b8039e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:26.767270 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35190d73-a502-4269-a211-56b6b8039e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:26.767609 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35190d73-a502-4269-a211-56b6b8039e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:26.767882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35190d73-a502-4269-a211-56b6b8039e00 admin admin] PATH_INFO: `/v3/users/b4ca69ce65034553a485ce6f9d3727e2` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:26.769009 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35190d73-a502-4269-a211-56b6b8039e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ca69ce65034553a485ce6f9d3727e2)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:26.771063 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35190d73-a502-4269-a211-56b6b8039e00 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:26.820912 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-35190d73-a502-4269-a211-56b6b8039e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ca69ce65034553a485ce6f9d3727e2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:26.829195 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-35190d73-a502-4269-a211-56b6b8039e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ca69ce65034553a485ce6f9d3727e2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:26.829804 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-35190d73-a502-4269-a211-56b6b8039e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ca69ce65034553a485ce6f9d3727e2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:26.830401 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-35190d73-a502-4269-a211-56b6b8039e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ca69ce65034553a485ce6f9d3727e2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:26.838964 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-35190d73-a502-4269-a211-56b6b8039e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ca69ce65034553a485ce6f9d3727e2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:26.856652 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1384/2808] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:58:26 2022] DELETE /identity/v3/users/b4ca69ce65034553a485ce6f9d3727e2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:27.051796 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5abe8-81fa-46eb-8693-a489ec55c2bb service placement] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:27.063163 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5abe8-81fa-46eb-8693-a489ec55c2bb service placement] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:27.120711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053719bd-48c0-4e83-8686-0b29e147679e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:27.121377 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053719bd-48c0-4e83-8686-0b29e147679e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:27.121660 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053719bd-48c0-4e83-8686-0b29e147679e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:27.121935 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053719bd-48c0-4e83-8686-0b29e147679e admin admin] PATH_INFO: `/v3/projects/cb4ab2183924495991f871f187f12bbb` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:27.123056 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053719bd-48c0-4e83-8686-0b29e147679e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb4ab2183924495991f871f187f12bbb)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:27.124986 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053719bd-48c0-4e83-8686-0b29e147679e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:27.170120 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-053719bd-48c0-4e83-8686-0b29e147679e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb4ab2183924495991f871f187f12bbb', 'request_id': 'req-053719bd-48c0-4e83-8686-0b29e147679e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:27.175659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-053719bd-48c0-4e83-8686-0b29e147679e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb4ab2183924495991f871f187f12bbb', 'request_id': 'req-053719bd-48c0-4e83-8686-0b29e147679e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:27.183438 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-053719bd-48c0-4e83-8686-0b29e147679e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb4ab2183924495991f871f187f12bbb', 'request_id': 'req-053719bd-48c0-4e83-8686-0b29e147679e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:27.194544 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-053719bd-48c0-4e83-8686-0b29e147679e admin admin] The token cache is being invalidate because project cb4ab2183924495991f871f187f12bbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:58:27.194837 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-053719bd-48c0-4e83-8686-0b29e147679e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:27.195463 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-053719bd-48c0-4e83-8686-0b29e147679e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:27.196968 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1425/2809] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:58:27 2022] DELETE /identity/v3/projects/cb4ab2183924495991f871f187f12bbb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:27.202282 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4762178-b156-48f2-9ba6-30bc2224fe9b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:27.202568 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4762178-b156-48f2-9ba6-30bc2224fe9b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:27.202845 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4762178-b156-48f2-9ba6-30bc2224fe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:27.226777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-d4762178-b156-48f2-9ba6-30bc2224fe9b None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:27.227364 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d4762178-b156-48f2-9ba6-30bc2224fe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:27.284999 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1385/2810] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:58:27.293241 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a6f0d-9615-4174-b332-ab6bf3ec63d8 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:27.293631 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a6f0d-9615-4174-b332-ab6bf3ec63d8 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:27.293909 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a6f0d-9615-4174-b332-ab6bf3ec63d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:27.316256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-ee0a6f0d-9615-4174-b332-ab6bf3ec63d8 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:27.317556 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ee0a6f0d-9615-4174-b332-ab6bf3ec63d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:27.325616 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1426/2811] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:58:27.329875 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4762178-b156-48f2-9ba6-30bc2224fe9b None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:27.341438 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4762178-b156-48f2-9ba6-30bc2224fe9b None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:27.346676 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec5bac-be96-437f-9a5b-62926892b350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:27.347377 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec5bac-be96-437f-9a5b-62926892b350 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:27.347710 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec5bac-be96-437f-9a5b-62926892b350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:27.347986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec5bac-be96-437f-9a5b-62926892b350 admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:27.348750 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec5bac-be96-437f-9a5b-62926892b350 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:58:27.349161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec5bac-be96-437f-9a5b-62926892b350 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:27.351553 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec5bac-be96-437f-9a5b-62926892b350 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:27.363223 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1386/2812] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:58:27.367535 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a6f0d-9615-4174-b332-ab6bf3ec63d8 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:27.376837 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a6f0d-9615-4174-b332-ab6bf3ec63d8 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:27.381490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee13fa2-9070-4108-85d7-d566721e79d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:27.382079 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee13fa2-9070-4108-85d7-d566721e79d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:27.382359 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee13fa2-9070-4108-85d7-d566721e79d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:27.382631 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee13fa2-9070-4108-85d7-d566721e79d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:27.383268 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee13fa2-9070-4108-85d7-d566721e79d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:27.385259 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee13fa2-9070-4108-85d7-d566721e79d7 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:27.411211 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1427/2813] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:58:27 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:58:27.415976 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec5bac-be96-437f-9a5b-62926892b350 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:27.425693 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec5bac-be96-437f-9a5b-62926892b350 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:27.481617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e269685-2fda-4a0c-84eb-d6f99ec2faf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:27.482138 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e269685-2fda-4a0c-84eb-d6f99ec2faf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:27.482416 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e269685-2fda-4a0c-84eb-d6f99ec2faf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:27.482689 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e269685-2fda-4a0c-84eb-d6f99ec2faf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:27.483322 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e269685-2fda-4a0c-84eb-d6f99ec2faf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:27.485280 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e269685-2fda-4a0c-84eb-d6f99ec2faf3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:27.493667 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:27.508595 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1387/2814] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:58:27 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:58:27.512655 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee13fa2-9070-4108-85d7-d566721e79d7 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:27.522845 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee13fa2-9070-4108-85d7-d566721e79d7 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:27.527490 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442e33e-c895-47c4-97c7-99a7605b1dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:27.528084 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442e33e-c895-47c4-97c7-99a7605b1dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:27.528363 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442e33e-c895-47c4-97c7-99a7605b1dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:27.528638 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442e33e-c895-47c4-97c7-99a7605b1dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:27.529317 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442e33e-c895-47c4-97c7-99a7605b1dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:27.530896 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442e33e-c895-47c4-97c7-99a7605b1dc4 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:27.541464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1428/2815] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:58:27.545868 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e269685-2fda-4a0c-84eb-d6f99ec2faf3 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:27.557480 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e269685-2fda-4a0c-84eb-d6f99ec2faf3 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:27.562242 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8801fc-29fd-4bfe-966e-e58aa6f96053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:27.562836 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8801fc-29fd-4bfe-966e-e58aa6f96053 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:27.563118 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8801fc-29fd-4bfe-966e-e58aa6f96053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:27.563392 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8801fc-29fd-4bfe-966e-e58aa6f96053 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:27.564034 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8801fc-29fd-4bfe-966e-e58aa6f96053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:27.565665 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8801fc-29fd-4bfe-966e-e58aa6f96053 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:27.576071 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1388/2816] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:58:27.579973 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442e33e-c895-47c4-97c7-99a7605b1dc4 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:27.590102 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442e33e-c895-47c4-97c7-99a7605b1dc4 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:27.594655 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5df71-04c1-470d-af4d-6f7265d915cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:27.595291 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5df71-04c1-470d-af4d-6f7265d915cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:27.595573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5df71-04c1-470d-af4d-6f7265d915cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:27.595846 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5df71-04c1-470d-af4d-6f7265d915cd admin admin] PATH_INFO: `/v3/projects/cb97607f33864b36a3d4a48d0494adc2/users/6b6f562971114a23b5827f869db411ed/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:27.609906 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5df71-04c1-470d-af4d-6f7265d915cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb97607f33864b36a3d4a48d0494adc2, user_id=6b6f562971114a23b5827f869db411ed, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:27.612531 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5df71-04c1-470d-af4d-6f7265d915cd admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:27.625561 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1429/2817] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:58:27 2022] PUT /identity/v3/projects/cb97607f33864b36a3d4a48d0494adc2/users/6b6f562971114a23b5827f869db411ed/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:58:27.636432 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b187710-b053-418d-9c5a-e86c91266235 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:27.636709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b187710-b053-418d-9c5a-e86c91266235 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:27.636980 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b187710-b053-418d-9c5a-e86c91266235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:27.665678 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0b187710-b053-418d-9c5a-e86c91266235 None None] MFA Rules not processed for user `6b6f562971114a23b5827f869db411ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:27.666865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0b187710-b053-418d-9c5a-e86c91266235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:27.732922 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1389/2818] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:58:27.737396 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5df71-04c1-470d-af4d-6f7265d915cd admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:27.751328 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:27.804367 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5df71-04c1-470d-af4d-6f7265d915cd admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:27.809041 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d505fb-a6ec-49c0-90c6-bebcbc1f4f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:27.809669 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d505fb-a6ec-49c0-90c6-bebcbc1f4f18 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:27.809950 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d505fb-a6ec-49c0-90c6-bebcbc1f4f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:27.810225 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d505fb-a6ec-49c0-90c6-bebcbc1f4f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:27.810848 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d505fb-a6ec-49c0-90c6-bebcbc1f4f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:27.812736 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d505fb-a6ec-49c0-90c6-bebcbc1f4f18 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:27.842256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1430/2819] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:58:27 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:58:27.846140 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b187710-b053-418d-9c5a-e86c91266235 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:27.857022 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b187710-b053-418d-9c5a-e86c91266235 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:27.914381 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c29e6b-0528-438d-bba6-f137ee7da7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:27.914994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c29e6b-0528-438d-bba6-f137ee7da7ff admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:27.915271 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c29e6b-0528-438d-bba6-f137ee7da7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:27.915543 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c29e6b-0528-438d-bba6-f137ee7da7ff admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:27.916173 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c29e6b-0528-438d-bba6-f137ee7da7ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:27.918133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c29e6b-0528-438d-bba6-f137ee7da7ff admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:27.940220 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1390/2820] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:58:27 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:58:27.945069 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d505fb-a6ec-49c0-90c6-bebcbc1f4f18 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:27.955467 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d505fb-a6ec-49c0-90c6-bebcbc1f4f18 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:27.960911 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790cea8-3373-40f9-b911-ffe26c9a8e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:27.961535 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790cea8-3373-40f9-b911-ffe26c9a8e09 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:27.961824 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790cea8-3373-40f9-b911-ffe26c9a8e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:27.962086 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790cea8-3373-40f9-b911-ffe26c9a8e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:27.962719 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790cea8-3373-40f9-b911-ffe26c9a8e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:27.964302 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790cea8-3373-40f9-b911-ffe26c9a8e09 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:27.974630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1431/2821] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:58:27.979313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c29e6b-0528-438d-bba6-f137ee7da7ff admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:27.989132 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c29e6b-0528-438d-bba6-f137ee7da7ff admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:27.994273 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4e687-90ce-4a63-b2a0-6e52102509b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:27.994905 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4e687-90ce-4a63-b2a0-6e52102509b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:27.995184 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4e687-90ce-4a63-b2a0-6e52102509b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:27.995457 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4e687-90ce-4a63-b2a0-6e52102509b4 admin admin] PATH_INFO: `/v3/projects/0df855c8e80a4796b43041f1294d8dd2/users/6e0d1be507524a3db07cab7d9d3ded10/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:28.009768 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4e687-90ce-4a63-b2a0-6e52102509b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df855c8e80a4796b43041f1294d8dd2, user_id=6e0d1be507524a3db07cab7d9d3ded10, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:28.012426 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4e687-90ce-4a63-b2a0-6e52102509b4 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:28.025995 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1391/2822] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:58:27 2022] PUT /identity/v3/projects/0df855c8e80a4796b43041f1294d8dd2/users/6e0d1be507524a3db07cab7d9d3ded10/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:58:28.030066 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790cea8-3373-40f9-b911-ffe26c9a8e09 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:28.040918 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790cea8-3373-40f9-b911-ffe26c9a8e09 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:28.095916 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb5716-d853-47e9-bf56-e5730534a8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:28.096516 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb5716-d853-47e9-bf56-e5730534a8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:28.096798 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb5716-d853-47e9-bf56-e5730534a8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:28.097115 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb5716-d853-47e9-bf56-e5730534a8e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:28.097849 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb5716-d853-47e9-bf56-e5730534a8e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:28.099428 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb5716-d853-47e9-bf56-e5730534a8e5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:28.109436 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1432/2823] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:58:28.113882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4e687-90ce-4a63-b2a0-6e52102509b4 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:28.126737 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4e687-90ce-4a63-b2a0-6e52102509b4 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:28.132339 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e2eac-3e6a-435f-9f7b-f184360621db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:28.133175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e2eac-3e6a-435f-9f7b-f184360621db admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:28.133546 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e2eac-3e6a-435f-9f7b-f184360621db admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:28.133899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e2eac-3e6a-435f-9f7b-f184360621db admin admin] PATH_INFO: `/v3/projects/0df855c8e80a4796b43041f1294d8dd2/users/6e0d1be507524a3db07cab7d9d3ded10/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:28.136318 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e2eac-3e6a-435f-9f7b-f184360621db admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df855c8e80a4796b43041f1294d8dd2, user_id=6e0d1be507524a3db07cab7d9d3ded10, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:28.139854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e2eac-3e6a-435f-9f7b-f184360621db admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:28.153062 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1392/2824] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:58:28 2022] PUT /identity/v3/projects/0df855c8e80a4796b43041f1294d8dd2/users/6e0d1be507524a3db07cab7d9d3ded10/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:28.216768 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d555e-f675-472b-86bf-c4ea04c59dfa None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:28.217071 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d555e-f675-472b-86bf-c4ea04c59dfa None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:28.217398 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d555e-f675-472b-86bf-c4ea04c59dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:28.245995 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-568d555e-f675-472b-86bf-c4ea04c59dfa None None] MFA Rules not processed for user `6e0d1be507524a3db07cab7d9d3ded10`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:28.247107 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-568d555e-f675-472b-86bf-c4ea04c59dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:28.318121 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1433/2825] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:58:28.332373 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e2eac-3e6a-435f-9f7b-f184360621db admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:28.334130 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3f2e2eac-3e6a-435f-9f7b-f184360621db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:28.357949 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:28.413536 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e2eac-3e6a-435f-9f7b-f184360621db admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:28.417174 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7a707-5547-4766-ad14-583cf28dab8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:28.417775 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a707-5547-4766-ad14-583cf28dab8e service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:28.418048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a707-5547-4766-ad14-583cf28dab8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:28.418313 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a707-5547-4766-ad14-583cf28dab8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:28.427082 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7a707-5547-4766-ad14-583cf28dab8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:28.429205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7a707-5547-4766-ad14-583cf28dab8e service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:28.438375 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1393/2826] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:58:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:58:28.816115 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d555e-f675-472b-86bf-c4ea04c59dfa None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:28.826406 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:28.878999 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d555e-f675-472b-86bf-c4ea04c59dfa None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:28.883534 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848df767-6d81-468a-8e4f-a2719822d8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:28.884179 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848df767-6d81-468a-8e4f-a2719822d8e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:28.884455 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848df767-6d81-468a-8e4f-a2719822d8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:28.884726 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848df767-6d81-468a-8e4f-a2719822d8e1 admin admin] PATH_INFO: `/v3/users/6b6f562971114a23b5827f869db411ed` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:28.885853 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848df767-6d81-468a-8e4f-a2719822d8e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6f562971114a23b5827f869db411ed)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:28.887770 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848df767-6d81-468a-8e4f-a2719822d8e1 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:28.940436 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-848df767-6d81-468a-8e4f-a2719822d8e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6f562971114a23b5827f869db411ed'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:28.947131 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-848df767-6d81-468a-8e4f-a2719822d8e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6f562971114a23b5827f869db411ed'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:28.947769 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-848df767-6d81-468a-8e4f-a2719822d8e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6f562971114a23b5827f869db411ed'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:28.948376 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-848df767-6d81-468a-8e4f-a2719822d8e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6f562971114a23b5827f869db411ed'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:28.955320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-848df767-6d81-468a-8e4f-a2719822d8e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6f562971114a23b5827f869db411ed'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:28.973591 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1434/2827] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:58:28 2022] DELETE /identity/v3/users/6b6f562971114a23b5827f869db411ed => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:28.978591 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae4269-9542-4f87-a462-494180a4507e None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:28.979052 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae4269-9542-4f87-a462-494180a4507e None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:28.979151 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae4269-9542-4f87-a462-494180a4507e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:28.997684 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-1eae4269-9542-4f87-a462-494180a4507e None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:28.998869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1eae4269-9542-4f87-a462-494180a4507e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:29.056535 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1394/2828] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:58:29.065866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848df767-6d81-468a-8e4f-a2719822d8e1 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:29.067278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-848df767-6d81-468a-8e4f-a2719822d8e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:29.124371 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848df767-6d81-468a-8e4f-a2719822d8e1 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:29.128459 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fa40f-f84c-476b-9518-42fad764b580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:29.129184 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fa40f-f84c-476b-9518-42fad764b580 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:29.129520 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fa40f-f84c-476b-9518-42fad764b580 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:29.129796 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fa40f-f84c-476b-9518-42fad764b580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:29.140945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98fa40f-f84c-476b-9518-42fad764b580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:29.142663 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98fa40f-f84c-476b-9518-42fad764b580 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:29.154117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1435/2829] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:58:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:58:29.412813 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae4269-9542-4f87-a462-494180a4507e None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:29.414354 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-1eae4269-9542-4f87-a462-494180a4507e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:29.426503 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae4269-9542-4f87-a462-494180a4507e None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:29.431138 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4bd11-5dd8-4e17-b9a6-e5848e6f988d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:29.431748 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4bd11-5dd8-4e17-b9a6-e5848e6f988d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:29.432026 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4bd11-5dd8-4e17-b9a6-e5848e6f988d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:29.432303 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4bd11-5dd8-4e17-b9a6-e5848e6f988d admin admin] PATH_INFO: `/v3/projects/cb97607f33864b36a3d4a48d0494adc2` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:29.433518 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4bd11-5dd8-4e17-b9a6-e5848e6f988d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb97607f33864b36a3d4a48d0494adc2)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:29.435445 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4bd11-5dd8-4e17-b9a6-e5848e6f988d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:29.482578 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-06c4bd11-5dd8-4e17-b9a6-e5848e6f988d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb97607f33864b36a3d4a48d0494adc2', 'request_id': 'req-06c4bd11-5dd8-4e17-b9a6-e5848e6f988d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:29.489040 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-06c4bd11-5dd8-4e17-b9a6-e5848e6f988d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb97607f33864b36a3d4a48d0494adc2', 'request_id': 'req-06c4bd11-5dd8-4e17-b9a6-e5848e6f988d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:29.495420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-06c4bd11-5dd8-4e17-b9a6-e5848e6f988d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb97607f33864b36a3d4a48d0494adc2', 'request_id': 'req-06c4bd11-5dd8-4e17-b9a6-e5848e6f988d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:29.507072 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-06c4bd11-5dd8-4e17-b9a6-e5848e6f988d admin admin] The token cache is being invalidate because project cb97607f33864b36a3d4a48d0494adc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:58:29.507356 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-06c4bd11-5dd8-4e17-b9a6-e5848e6f988d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:29.508000 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-06c4bd11-5dd8-4e17-b9a6-e5848e6f988d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:29.509505 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1395/2830] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:58:29 2022] DELETE /identity/v3/projects/cb97607f33864b36a3d4a48d0494adc2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:29.513484 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fa40f-f84c-476b-9518-42fad764b580 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:29.523053 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fa40f-f84c-476b-9518-42fad764b580 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:29.551520 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:29.581621 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d15e7-6277-4471-b621-a9157c368ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:29.582248 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d15e7-6277-4471-b621-a9157c368ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:29.582530 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d15e7-6277-4471-b621-a9157c368ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:29.582815 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d15e7-6277-4471-b621-a9157c368ae3 admin admin] PATH_INFO: `/v3/users/6e0d1be507524a3db07cab7d9d3ded10` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:29.583934 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d15e7-6277-4471-b621-a9157c368ae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e0d1be507524a3db07cab7d9d3ded10)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:29.586372 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d15e7-6277-4471-b621-a9157c368ae3 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:29.631289 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6c4d15e7-6277-4471-b621-a9157c368ae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e0d1be507524a3db07cab7d9d3ded10'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:29.638405 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6c4d15e7-6277-4471-b621-a9157c368ae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e0d1be507524a3db07cab7d9d3ded10'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:29.639113 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6c4d15e7-6277-4471-b621-a9157c368ae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e0d1be507524a3db07cab7d9d3ded10'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:29.639777 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6c4d15e7-6277-4471-b621-a9157c368ae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e0d1be507524a3db07cab7d9d3ded10'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:29.646559 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-6c4d15e7-6277-4471-b621-a9157c368ae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e0d1be507524a3db07cab7d9d3ded10'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:29.664620 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1436/2831] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:58:29 2022] DELETE /identity/v3/users/6e0d1be507524a3db07cab7d9d3ded10 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:29.933903 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4bd11-5dd8-4e17-b9a6-e5848e6f988d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:29.935393 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-06c4bd11-5dd8-4e17-b9a6-e5848e6f988d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:29.950098 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4bd11-5dd8-4e17-b9a6-e5848e6f988d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:29.977561 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:30.010256 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f272dc9-233e-420a-8e14-3081ac7bd33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:30.010865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f272dc9-233e-420a-8e14-3081ac7bd33d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:30.011146 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f272dc9-233e-420a-8e14-3081ac7bd33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:30.011414 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f272dc9-233e-420a-8e14-3081ac7bd33d admin admin] PATH_INFO: `/v3/projects/0df855c8e80a4796b43041f1294d8dd2` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:30.012512 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f272dc9-233e-420a-8e14-3081ac7bd33d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0df855c8e80a4796b43041f1294d8dd2)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:30.014477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f272dc9-233e-420a-8e14-3081ac7bd33d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:30.060080 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7f272dc9-233e-420a-8e14-3081ac7bd33d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0df855c8e80a4796b43041f1294d8dd2', 'request_id': 'req-7f272dc9-233e-420a-8e14-3081ac7bd33d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:30.067338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7f272dc9-233e-420a-8e14-3081ac7bd33d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0df855c8e80a4796b43041f1294d8dd2', 'request_id': 'req-7f272dc9-233e-420a-8e14-3081ac7bd33d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:30.073440 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7f272dc9-233e-420a-8e14-3081ac7bd33d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0df855c8e80a4796b43041f1294d8dd2', 'request_id': 'req-7f272dc9-233e-420a-8e14-3081ac7bd33d'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:30.084917 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7f272dc9-233e-420a-8e14-3081ac7bd33d admin admin] The token cache is being invalidate because project 0df855c8e80a4796b43041f1294d8dd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:58:30.085239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7f272dc9-233e-420a-8e14-3081ac7bd33d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:30.085900 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-7f272dc9-233e-420a-8e14-3081ac7bd33d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:30.087346 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1396/2832] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:58:29 2022] DELETE /identity/v3/projects/0df855c8e80a4796b43041f1294d8dd2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:30.092131 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddb28b-d598-4a5e-875d-b98d766ba7a6 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:30.092600 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddb28b-d598-4a5e-875d-b98d766ba7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:30.092795 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cddb28b-d598-4a5e-875d-b98d766ba7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:30.112226 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-9cddb28b-d598-4a5e-875d-b98d766ba7a6 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:30.113445 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-9cddb28b-d598-4a5e-875d-b98d766ba7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:30.172341 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1437/2833] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:58:30.180735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b267ab-207f-4eef-9922-746daa96ff3f None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:30.180961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b267ab-207f-4eef-9922-746daa96ff3f None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:30.181269 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b267ab-207f-4eef-9922-746daa96ff3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:30.200519 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-21b267ab-207f-4eef-9922-746daa96ff3f None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:30.201750 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-21b267ab-207f-4eef-9922-746daa96ff3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:30.209824 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1397/2834] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:58:30.213998 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddb28b-d598-4a5e-875d-b98d766ba7a6 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:30.223740 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cddb28b-d598-4a5e-875d-b98d766ba7a6 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:30.228788 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe0f27-8f00-4677-a20d-9726f6fef4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:30.229409 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe0f27-8f00-4677-a20d-9726f6fef4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:30.229692 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe0f27-8f00-4677-a20d-9726f6fef4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:30.229963 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe0f27-8f00-4677-a20d-9726f6fef4c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:30.230600 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe0f27-8f00-4677-a20d-9726f6fef4c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:58:30.230900 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe0f27-8f00-4677-a20d-9726f6fef4c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:30.232467 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe0f27-8f00-4677-a20d-9726f6fef4c2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:30.244240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1438/2835] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:58:30.248576 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b267ab-207f-4eef-9922-746daa96ff3f None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:30.257771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b267ab-207f-4eef-9922-746daa96ff3f None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:30.262334 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b1256-793e-40fa-b180-01366f898a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:30.262918 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b1256-793e-40fa-b180-01366f898a4e admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:30.263198 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b1256-793e-40fa-b180-01366f898a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:30.263469 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b1256-793e-40fa-b180-01366f898a4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:30.264091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b1256-793e-40fa-b180-01366f898a4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:30.266055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b1256-793e-40fa-b180-01366f898a4e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:30.294826 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1398/2836] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:58:30 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:58:30.299044 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe0f27-8f00-4677-a20d-9726f6fef4c2 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:30.308809 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe0f27-8f00-4677-a20d-9726f6fef4c2 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:30.344972 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:30.373749 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea25f6-30c3-4dd1-b0ae-86541c53a526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:30.374358 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea25f6-30c3-4dd1-b0ae-86541c53a526 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:30.374637 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea25f6-30c3-4dd1-b0ae-86541c53a526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:30.374910 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea25f6-30c3-4dd1-b0ae-86541c53a526 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:30.375558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea25f6-30c3-4dd1-b0ae-86541c53a526 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:30.377511 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea25f6-30c3-4dd1-b0ae-86541c53a526 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:30.405347 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1439/2837] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:58:30 2022] POST /identity/v3/users => generated 282 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:58:30.409504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b1256-793e-40fa-b180-01366f898a4e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:30.420360 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b1256-793e-40fa-b180-01366f898a4e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:30.424939 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67399f6c-b875-42bc-902a-311abbab629d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:30.425683 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67399f6c-b875-42bc-902a-311abbab629d admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:30.425961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67399f6c-b875-42bc-902a-311abbab629d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:30.426238 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67399f6c-b875-42bc-902a-311abbab629d admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:30.426869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67399f6c-b875-42bc-902a-311abbab629d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:30.428470 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67399f6c-b875-42bc-902a-311abbab629d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:30.438236 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1399/2838] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:58:30.442017 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea25f6-30c3-4dd1-b0ae-86541c53a526 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:30.452334 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea25f6-30c3-4dd1-b0ae-86541c53a526 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:30.457309 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715c5b1-4c0a-4234-aa1b-0c5239444878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:30.457905 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715c5b1-4c0a-4234-aa1b-0c5239444878 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:30.458212 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715c5b1-4c0a-4234-aa1b-0c5239444878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:30.458485 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715c5b1-4c0a-4234-aa1b-0c5239444878 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:30.459647 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715c5b1-4c0a-4234-aa1b-0c5239444878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:30.461275 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715c5b1-4c0a-4234-aa1b-0c5239444878 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:30.471143 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1440/2839] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:58:30.475854 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67399f6c-b875-42bc-902a-311abbab629d admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:30.485712 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67399f6c-b875-42bc-902a-311abbab629d admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:30.490252 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed1f09-bcb5-49a8-813c-7e81abc21062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:30.490887 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed1f09-bcb5-49a8-813c-7e81abc21062 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:30.491161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed1f09-bcb5-49a8-813c-7e81abc21062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:30.491429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed1f09-bcb5-49a8-813c-7e81abc21062 admin admin] PATH_INFO: `/v3/projects/0b1e4b662ee14b06aa58ab2d65f98e0b/users/585619f5581c4f3bb341fd99db9966d8/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:30.505801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed1f09-bcb5-49a8-813c-7e81abc21062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1e4b662ee14b06aa58ab2d65f98e0b, user_id=585619f5581c4f3bb341fd99db9966d8, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:30.508541 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed1f09-bcb5-49a8-813c-7e81abc21062 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:30.521206 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1400/2840] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:58:30 2022] PUT /identity/v3/projects/0b1e4b662ee14b06aa58ab2d65f98e0b/users/585619f5581c4f3bb341fd99db9966d8/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:30.532887 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3322a-9c79-4d8e-b290-b32d4253c3ac None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:30.533213 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3322a-9c79-4d8e-b290-b32d4253c3ac None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:30.533492 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3322a-9c79-4d8e-b290-b32d4253c3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:30.561519 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-cde3322a-9c79-4d8e-b290-b32d4253c3ac None None] MFA Rules not processed for user `585619f5581c4f3bb341fd99db9966d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:30.562731 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-cde3322a-9c79-4d8e-b290-b32d4253c3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:30.625558 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1441/2841] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:58:30.630041 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed1f09-bcb5-49a8-813c-7e81abc21062 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:30.679557 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:30.690894 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed1f09-bcb5-49a8-813c-7e81abc21062 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:30.700402 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60823f53-b330-40e6-bdb6-2c954679ad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:30.700991 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60823f53-b330-40e6-bdb6-2c954679ad36 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:30.701297 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60823f53-b330-40e6-bdb6-2c954679ad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:30.701618 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60823f53-b330-40e6-bdb6-2c954679ad36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:30.702237 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60823f53-b330-40e6-bdb6-2c954679ad36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:30.704131 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60823f53-b330-40e6-bdb6-2c954679ad36 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:30.731110 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1401/2842] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:58:30 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:58:30.735370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3322a-9c79-4d8e-b290-b32d4253c3ac None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:30.747630 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3322a-9c79-4d8e-b290-b32d4253c3ac None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:30.803023 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34f7f7-4170-4153-9b3e-3fa58900c43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:30.803624 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34f7f7-4170-4153-9b3e-3fa58900c43b admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:30.803901 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34f7f7-4170-4153-9b3e-3fa58900c43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:30.804169 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34f7f7-4170-4153-9b3e-3fa58900c43b admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:30.804798 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34f7f7-4170-4153-9b3e-3fa58900c43b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:30.806727 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34f7f7-4170-4153-9b3e-3fa58900c43b admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:30.828058 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1442/2843] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:58:30 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:58:30.832237 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60823f53-b330-40e6-bdb6-2c954679ad36 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:30.843366 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60823f53-b330-40e6-bdb6-2c954679ad36 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:30.848028 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de88b00-7590-4908-bbe8-a3b5ccc3a67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:30.848620 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de88b00-7590-4908-bbe8-a3b5ccc3a67e admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:30.848897 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de88b00-7590-4908-bbe8-a3b5ccc3a67e admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:30.849204 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de88b00-7590-4908-bbe8-a3b5ccc3a67e admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:30.849869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de88b00-7590-4908-bbe8-a3b5ccc3a67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:30.851468 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de88b00-7590-4908-bbe8-a3b5ccc3a67e admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:30.861807 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1402/2844] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:58:30.865746 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34f7f7-4170-4153-9b3e-3fa58900c43b admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:30.875375 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34f7f7-4170-4153-9b3e-3fa58900c43b admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:30.879958 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f226d31-49f9-4990-ad4e-5253f345243e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:30.880590 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f226d31-49f9-4990-ad4e-5253f345243e admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:30.880869 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f226d31-49f9-4990-ad4e-5253f345243e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:30.881679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f226d31-49f9-4990-ad4e-5253f345243e admin admin] PATH_INFO: `/v3/projects/4d10eab2eef340b1b240d7cfe3f42393/users/3ff08698f5a64bd8899d45c8eb2437c1/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:30.895887 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f226d31-49f9-4990-ad4e-5253f345243e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d10eab2eef340b1b240d7cfe3f42393, user_id=3ff08698f5a64bd8899d45c8eb2437c1, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:30.899181 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f226d31-49f9-4990-ad4e-5253f345243e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:30.911593 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1443/2845] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:58:30 2022] PUT /identity/v3/projects/4d10eab2eef340b1b240d7cfe3f42393/users/3ff08698f5a64bd8899d45c8eb2437c1/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:58:30.915410 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de88b00-7590-4908-bbe8-a3b5ccc3a67e admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:30.925408 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de88b00-7590-4908-bbe8-a3b5ccc3a67e admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:30.980689 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43c876-0831-4749-9d6a-d42a9f206a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:30.981251 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43c876-0831-4749-9d6a-d42a9f206a5b admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:30.981531 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43c876-0831-4749-9d6a-d42a9f206a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:30.981801 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43c876-0831-4749-9d6a-d42a9f206a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:30.982435 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43c876-0831-4749-9d6a-d42a9f206a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:30.984123 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43c876-0831-4749-9d6a-d42a9f206a5b admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:30.994153 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1403/2846] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:58:30.998315 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f226d31-49f9-4990-ad4e-5253f345243e admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:31.009013 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f226d31-49f9-4990-ad4e-5253f345243e admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:31.013623 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531b479-ced8-4b41-baaf-71eea11154b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:31.014261 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531b479-ced8-4b41-baaf-71eea11154b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:31.014538 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531b479-ced8-4b41-baaf-71eea11154b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:31.014811 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531b479-ced8-4b41-baaf-71eea11154b0 admin admin] PATH_INFO: `/v3/projects/4d10eab2eef340b1b240d7cfe3f42393/users/3ff08698f5a64bd8899d45c8eb2437c1/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:31.016711 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531b479-ced8-4b41-baaf-71eea11154b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d10eab2eef340b1b240d7cfe3f42393, user_id=3ff08698f5a64bd8899d45c8eb2437c1, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:31.019395 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531b479-ced8-4b41-baaf-71eea11154b0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:31.025146 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:31.031344 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1444/2847] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:58:30 2022] PUT /identity/v3/projects/4d10eab2eef340b1b240d7cfe3f42393/users/3ff08698f5a64bd8899d45c8eb2437c1/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:31.041642 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3ca79-3a52-401b-b305-90d9c96e9360 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:31.042162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3ca79-3a52-401b-b305-90d9c96e9360 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:31.042327 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3ca79-3a52-401b-b305-90d9c96e9360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:31.070618 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3da3ca79-3a52-401b-b305-90d9c96e9360 None None] MFA Rules not processed for user `3ff08698f5a64bd8899d45c8eb2437c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:31.071825 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3da3ca79-3a52-401b-b305-90d9c96e9360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:31.137661 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1404/2848] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:58:31.148715 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531b479-ced8-4b41-baaf-71eea11154b0 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:31.150415 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-6531b479-ced8-4b41-baaf-71eea11154b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:31.206863 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531b479-ced8-4b41-baaf-71eea11154b0 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:31.210473 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0562bc2-1aa5-4d35-858b-e7af4e0c2694 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:31.211061 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0562bc2-1aa5-4d35-858b-e7af4e0c2694 service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:31.211335 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0562bc2-1aa5-4d35-858b-e7af4e0c2694 service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:31.211604 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0562bc2-1aa5-4d35-858b-e7af4e0c2694 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:31.220262 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0562bc2-1aa5-4d35-858b-e7af4e0c2694 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:31.221702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0562bc2-1aa5-4d35-858b-e7af4e0c2694 service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:31.231156 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1445/2849] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:58:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:58:31.647369 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3ca79-3a52-401b-b305-90d9c96e9360 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:31.696384 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:31.711048 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3ca79-3a52-401b-b305-90d9c96e9360 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:31.715507 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6554484-ed9f-4455-8244-9ae203520346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:31.716126 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6554484-ed9f-4455-8244-9ae203520346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:31.716406 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6554484-ed9f-4455-8244-9ae203520346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:31.716677 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6554484-ed9f-4455-8244-9ae203520346 admin admin] PATH_INFO: `/v3/users/585619f5581c4f3bb341fd99db9966d8` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:31.717812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6554484-ed9f-4455-8244-9ae203520346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=585619f5581c4f3bb341fd99db9966d8)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:31.719738 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6554484-ed9f-4455-8244-9ae203520346 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:31.764078 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c6554484-ed9f-4455-8244-9ae203520346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '585619f5581c4f3bb341fd99db9966d8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:31.770861 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c6554484-ed9f-4455-8244-9ae203520346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '585619f5581c4f3bb341fd99db9966d8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:31.771483 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c6554484-ed9f-4455-8244-9ae203520346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '585619f5581c4f3bb341fd99db9966d8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:31.772641 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c6554484-ed9f-4455-8244-9ae203520346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '585619f5581c4f3bb341fd99db9966d8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:31.785652 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-c6554484-ed9f-4455-8244-9ae203520346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '585619f5581c4f3bb341fd99db9966d8'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:31.803435 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1405/2850] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:58:31 2022] DELETE /identity/v3/users/585619f5581c4f3bb341fd99db9966d8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:58:31.807920 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ac728-f2ab-4160-b07a-33e9a0c5927a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:31.808209 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ac728-f2ab-4160-b07a-33e9a0c5927a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:31.808491 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ac728-f2ab-4160-b07a-33e9a0c5927a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:31.827171 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-595ac728-f2ab-4160-b07a-33e9a0c5927a None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:31.828364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-595ac728-f2ab-4160-b07a-33e9a0c5927a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:31.887541 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1446/2851] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:58:31.897657 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6554484-ed9f-4455-8244-9ae203520346 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:31.899094 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c6554484-ed9f-4455-8244-9ae203520346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:31.954174 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6554484-ed9f-4455-8244-9ae203520346 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:31.958088 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cef569-2f59-46cb-9807-2dc617c49ba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:31.958681 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cef569-2f59-46cb-9807-2dc617c49ba0 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:31.959771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cef569-2f59-46cb-9807-2dc617c49ba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:31.960237 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cef569-2f59-46cb-9807-2dc617c49ba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:31.971957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cef569-2f59-46cb-9807-2dc617c49ba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:31.973426 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cef569-2f59-46cb-9807-2dc617c49ba0 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:31.986234 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1406/2852] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:58:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:58:32.245853 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ac728-f2ab-4160-b07a-33e9a0c5927a None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:32.247505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-595ac728-f2ab-4160-b07a-33e9a0c5927a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:32.260123 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ac728-f2ab-4160-b07a-33e9a0c5927a None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:32.264696 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98925fcd-37fe-4777-b696-6e8bfc83b5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:32.265364 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98925fcd-37fe-4777-b696-6e8bfc83b5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:32.265646 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98925fcd-37fe-4777-b696-6e8bfc83b5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:32.266034 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98925fcd-37fe-4777-b696-6e8bfc83b5b3 admin admin] PATH_INFO: `/v3/projects/0b1e4b662ee14b06aa58ab2d65f98e0b` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:32.267162 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98925fcd-37fe-4777-b696-6e8bfc83b5b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1e4b662ee14b06aa58ab2d65f98e0b)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:32.269065 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98925fcd-37fe-4777-b696-6e8bfc83b5b3 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:32.317543 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-98925fcd-37fe-4777-b696-6e8bfc83b5b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1e4b662ee14b06aa58ab2d65f98e0b', 'request_id': 'req-98925fcd-37fe-4777-b696-6e8bfc83b5b3'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:32.323003 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-98925fcd-37fe-4777-b696-6e8bfc83b5b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1e4b662ee14b06aa58ab2d65f98e0b', 'request_id': 'req-98925fcd-37fe-4777-b696-6e8bfc83b5b3'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:32.330581 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-98925fcd-37fe-4777-b696-6e8bfc83b5b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1e4b662ee14b06aa58ab2d65f98e0b', 'request_id': 'req-98925fcd-37fe-4777-b696-6e8bfc83b5b3'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:32.341897 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-98925fcd-37fe-4777-b696-6e8bfc83b5b3 admin admin] The token cache is being invalidate because project 0b1e4b662ee14b06aa58ab2d65f98e0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:58:32.342191 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-98925fcd-37fe-4777-b696-6e8bfc83b5b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:32.342834 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-98925fcd-37fe-4777-b696-6e8bfc83b5b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:32.344310 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1447/2853] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:58:32 2022] DELETE /identity/v3/projects/0b1e4b662ee14b06aa58ab2d65f98e0b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:32.348382 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cef569-2f59-46cb-9807-2dc617c49ba0 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:32.358363 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cef569-2f59-46cb-9807-2dc617c49ba0 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:32.416839 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dcc2dc-6bb7-464a-be7c-d3039d387f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:32.417489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcc2dc-6bb7-464a-be7c-d3039d387f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:32.417769 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcc2dc-6bb7-464a-be7c-d3039d387f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:32.418042 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcc2dc-6bb7-464a-be7c-d3039d387f9a admin admin] PATH_INFO: `/v3/users/3ff08698f5a64bd8899d45c8eb2437c1` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:32.419162 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcc2dc-6bb7-464a-be7c-d3039d387f9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ff08698f5a64bd8899d45c8eb2437c1)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:32.421113 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcc2dc-6bb7-464a-be7c-d3039d387f9a admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:32.433838 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:32.468338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-32dcc2dc-6bb7-464a-be7c-d3039d387f9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ff08698f5a64bd8899d45c8eb2437c1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:32.476309 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-32dcc2dc-6bb7-464a-be7c-d3039d387f9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ff08698f5a64bd8899d45c8eb2437c1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:32.476988 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-32dcc2dc-6bb7-464a-be7c-d3039d387f9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ff08698f5a64bd8899d45c8eb2437c1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:32.477607 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-32dcc2dc-6bb7-464a-be7c-d3039d387f9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ff08698f5a64bd8899d45c8eb2437c1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:32.484375 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-32dcc2dc-6bb7-464a-be7c-d3039d387f9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ff08698f5a64bd8899d45c8eb2437c1'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:32.501551 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1407/2854] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:58:32 2022] DELETE /identity/v3/users/3ff08698f5a64bd8899d45c8eb2437c1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:32.781160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98925fcd-37fe-4777-b696-6e8bfc83b5b3 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:32.782729 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-98925fcd-37fe-4777-b696-6e8bfc83b5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:32.797426 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98925fcd-37fe-4777-b696-6e8bfc83b5b3 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:32.818404 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:32.859883 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680172b9-21bf-4afe-8927-fe80c8d0791e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:32.860483 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680172b9-21bf-4afe-8927-fe80c8d0791e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:32.860787 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680172b9-21bf-4afe-8927-fe80c8d0791e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:32.861074 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680172b9-21bf-4afe-8927-fe80c8d0791e admin admin] PATH_INFO: `/v3/projects/4d10eab2eef340b1b240d7cfe3f42393` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:32.862273 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680172b9-21bf-4afe-8927-fe80c8d0791e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d10eab2eef340b1b240d7cfe3f42393)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:32.864277 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680172b9-21bf-4afe-8927-fe80c8d0791e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:32.909176 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-680172b9-21bf-4afe-8927-fe80c8d0791e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d10eab2eef340b1b240d7cfe3f42393', 'request_id': 'req-680172b9-21bf-4afe-8927-fe80c8d0791e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:32.914593 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-680172b9-21bf-4afe-8927-fe80c8d0791e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d10eab2eef340b1b240d7cfe3f42393', 'request_id': 'req-680172b9-21bf-4afe-8927-fe80c8d0791e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:32.921537 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-680172b9-21bf-4afe-8927-fe80c8d0791e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d10eab2eef340b1b240d7cfe3f42393', 'request_id': 'req-680172b9-21bf-4afe-8927-fe80c8d0791e'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:32.932292 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-680172b9-21bf-4afe-8927-fe80c8d0791e admin admin] The token cache is being invalidate because project 4d10eab2eef340b1b240d7cfe3f42393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:58:32.932582 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-680172b9-21bf-4afe-8927-fe80c8d0791e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:32.933235 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-680172b9-21bf-4afe-8927-fe80c8d0791e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:32.934683 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1448/2855] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:58:32 2022] DELETE /identity/v3/projects/4d10eab2eef340b1b240d7cfe3f42393 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:32.939508 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae27299-4c9e-441a-99e3-d5a58e71d763 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:32.939797 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae27299-4c9e-441a-99e3-d5a58e71d763 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:32.940071 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae27299-4c9e-441a-99e3-d5a58e71d763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:32.962063 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-eae27299-4c9e-441a-99e3-d5a58e71d763 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:32.963256 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-eae27299-4c9e-441a-99e3-d5a58e71d763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:33.027091 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1408/2856] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:58:33.034698 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e59e0c-3a2f-48dd-bf1d-414c7de29626 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:33.034991 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e59e0c-3a2f-48dd-bf1d-414c7de29626 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:33.035266 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e59e0c-3a2f-48dd-bf1d-414c7de29626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:33.054900 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-28e59e0c-3a2f-48dd-bf1d-414c7de29626 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:33.056106 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-28e59e0c-3a2f-48dd-bf1d-414c7de29626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:33.064075 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1449/2857] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:58:33.068217 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae27299-4c9e-441a-99e3-d5a58e71d763 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:33.078314 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae27299-4c9e-441a-99e3-d5a58e71d763 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:33.083088 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d94d0-8dde-4566-bcd5-3e838335bdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:33.083683 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d94d0-8dde-4566-bcd5-3e838335bdaf admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:33.083960 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d94d0-8dde-4566-bcd5-3e838335bdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:33.084310 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d94d0-8dde-4566-bcd5-3e838335bdaf admin admin] PATH_INFO: `/v3/domains` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:33.085457 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d94d0-8dde-4566-bcd5-3e838335bdaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:58:33.085759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d94d0-8dde-4566-bcd5-3e838335bdaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:33.087361 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d94d0-8dde-4566-bcd5-3e838335bdaf admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:33.098550 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1409/2858] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:58:33.102663 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e59e0c-3a2f-48dd-bf1d-414c7de29626 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:33.111933 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e59e0c-3a2f-48dd-bf1d-414c7de29626 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:33.116510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f925c-f9cb-422e-a8f6-b4c0a3bfe0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:33.117104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f925c-f9cb-422e-a8f6-b4c0a3bfe0cf admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:33.117407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f925c-f9cb-422e-a8f6-b4c0a3bfe0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:33.117677 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f925c-f9cb-422e-a8f6-b4c0a3bfe0cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:33.118311 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f925c-f9cb-422e-a8f6-b4c0a3bfe0cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:33.120193 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f925c-f9cb-422e-a8f6-b4c0a3bfe0cf admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:33.148523 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1450/2859] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:58:33 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:58:33.152309 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d94d0-8dde-4566-bcd5-3e838335bdaf admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:33.162375 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d94d0-8dde-4566-bcd5-3e838335bdaf admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:33.218765 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e543e01-ced5-418b-be25-5fce58bc7210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:33.219362 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e543e01-ced5-418b-be25-5fce58bc7210 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:33.219640 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e543e01-ced5-418b-be25-5fce58bc7210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:33.219914 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e543e01-ced5-418b-be25-5fce58bc7210 admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:33.220549 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e543e01-ced5-418b-be25-5fce58bc7210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:33.222501 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e543e01-ced5-418b-be25-5fce58bc7210 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:33.244504 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1410/2860] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:58:33 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:58:33.248583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f925c-f9cb-422e-a8f6-b4c0a3bfe0cf admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:33.259343 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f925c-f9cb-422e-a8f6-b4c0a3bfe0cf admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:33.263936 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f14bab-a34e-40d9-88ee-717a61fa4817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:33.264522 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f14bab-a34e-40d9-88ee-717a61fa4817 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:33.264801 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f14bab-a34e-40d9-88ee-717a61fa4817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:33.265073 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f14bab-a34e-40d9-88ee-717a61fa4817 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:33.265744 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f14bab-a34e-40d9-88ee-717a61fa4817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:33.267317 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f14bab-a34e-40d9-88ee-717a61fa4817 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:33.277991 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1451/2861] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:58:33.281718 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e543e01-ced5-418b-be25-5fce58bc7210 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:33.291517 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e543e01-ced5-418b-be25-5fce58bc7210 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:33.296144 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c13b5f-8b94-4c0d-8e1c-36282dcfb0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:33.296732 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c13b5f-8b94-4c0d-8e1c-36282dcfb0ca admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:33.297011 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c13b5f-8b94-4c0d-8e1c-36282dcfb0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:33.297316 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c13b5f-8b94-4c0d-8e1c-36282dcfb0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:33.297957 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c13b5f-8b94-4c0d-8e1c-36282dcfb0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:33.299543 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c13b5f-8b94-4c0d-8e1c-36282dcfb0ca admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:33.300760 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:33.312253 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1411/2862] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:58:33.316134 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f14bab-a34e-40d9-88ee-717a61fa4817 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:33.326832 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f14bab-a34e-40d9-88ee-717a61fa4817 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:33.331776 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc549d8-7390-457b-b4fc-b06c716ac3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:33.332424 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc549d8-7390-457b-b4fc-b06c716ac3a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:33.332702 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc549d8-7390-457b-b4fc-b06c716ac3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:33.332977 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc549d8-7390-457b-b4fc-b06c716ac3a2 admin admin] PATH_INFO: `/v3/projects/0e382d1c49b84ce39cd04168f4e6fdd5/users/56e359a127864884859141226c616ad8/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:33.347611 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc549d8-7390-457b-b4fc-b06c716ac3a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e382d1c49b84ce39cd04168f4e6fdd5, user_id=56e359a127864884859141226c616ad8, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:33.350310 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc549d8-7390-457b-b4fc-b06c716ac3a2 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:33.362733 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1452/2863] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:58:33 2022] PUT /identity/v3/projects/0e382d1c49b84ce39cd04168f4e6fdd5/users/56e359a127864884859141226c616ad8/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:33.374642 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86b1be-b499-4460-8dd0-8e728acf769a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:33.375157 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86b1be-b499-4460-8dd0-8e728acf769a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:33.375277 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86b1be-b499-4460-8dd0-8e728acf769a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:33.402891 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-ee86b1be-b499-4460-8dd0-8e728acf769a None None] MFA Rules not processed for user `56e359a127864884859141226c616ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:33.404105 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ee86b1be-b499-4460-8dd0-8e728acf769a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:33.467688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1412/2864] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:58:33.472197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc549d8-7390-457b-b4fc-b06c716ac3a2 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:33.521576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:33.534174 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc549d8-7390-457b-b4fc-b06c716ac3a2 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:33.538921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633375c-23e5-4307-9268-e7d3617ede8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:33.539522 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633375c-23e5-4307-9268-e7d3617ede8a admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:33.539806 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633375c-23e5-4307-9268-e7d3617ede8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:33.540083 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633375c-23e5-4307-9268-e7d3617ede8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:33.540749 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633375c-23e5-4307-9268-e7d3617ede8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:33.542679 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633375c-23e5-4307-9268-e7d3617ede8a admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:33.569580 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1453/2865] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:58:33 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:58:33.573606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86b1be-b499-4460-8dd0-8e728acf769a None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:33.584354 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86b1be-b499-4460-8dd0-8e728acf769a None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:33.639063 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60733f-52cf-4707-b578-82790334dbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:33.639587 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60733f-52cf-4707-b578-82790334dbcd admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:33.639865 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60733f-52cf-4707-b578-82790334dbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:33.640158 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60733f-52cf-4707-b578-82790334dbcd admin admin] PATH_INFO: `/v3/users` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:33.640753 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60733f-52cf-4707-b578-82790334dbcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:33.642702 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60733f-52cf-4707-b578-82790334dbcd admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:33.664024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1413/2866] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:58:33 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:58:33.667945 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633375c-23e5-4307-9268-e7d3617ede8a admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:33.678012 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633375c-23e5-4307-9268-e7d3617ede8a admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:33.683166 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9758ee7-3fa6-486e-8a13-4a273eae76a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:33.683757 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9758ee7-3fa6-486e-8a13-4a273eae76a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:33.684037 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9758ee7-3fa6-486e-8a13-4a273eae76a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:33.684310 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9758ee7-3fa6-486e-8a13-4a273eae76a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:33.684943 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9758ee7-3fa6-486e-8a13-4a273eae76a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:33.686561 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9758ee7-3fa6-486e-8a13-4a273eae76a5 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:33.696881 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1454/2867] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:58:33.700714 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60733f-52cf-4707-b578-82790334dbcd admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:33.710928 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60733f-52cf-4707-b578-82790334dbcd admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:33.715515 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76877f7-4059-4559-9c59-7ab7140d1869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:33.716150 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76877f7-4059-4559-9c59-7ab7140d1869 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:33.716432 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76877f7-4059-4559-9c59-7ab7140d1869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:33.716705 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76877f7-4059-4559-9c59-7ab7140d1869 admin admin] PATH_INFO: `/v3/projects/955025b84f654400a085883dd04d9db4/users/59bdaf7c6ee347b1b943c1a2e958bdf3/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:33.731808 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76877f7-4059-4559-9c59-7ab7140d1869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=955025b84f654400a085883dd04d9db4, user_id=59bdaf7c6ee347b1b943c1a2e958bdf3, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:33.734556 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76877f7-4059-4559-9c59-7ab7140d1869 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:33.747869 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1414/2868] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:58:33 2022] PUT /identity/v3/projects/955025b84f654400a085883dd04d9db4/users/59bdaf7c6ee347b1b943c1a2e958bdf3/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:33.751676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9758ee7-3fa6-486e-8a13-4a273eae76a5 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:33.761571 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9758ee7-3fa6-486e-8a13-4a273eae76a5 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:33.816604 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a93d7e-eb8e-4f47-9e31-63c2c7a19c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:33.817230 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a93d7e-eb8e-4f47-9e31-63c2c7a19c53 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:33.817510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a93d7e-eb8e-4f47-9e31-63c2c7a19c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:33.817779 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a93d7e-eb8e-4f47-9e31-63c2c7a19c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:33.818407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a93d7e-eb8e-4f47-9e31-63c2c7a19c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:33.819983 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a93d7e-eb8e-4f47-9e31-63c2c7a19c53 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:33.829404 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1455/2869] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:58:33.833930 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76877f7-4059-4559-9c59-7ab7140d1869 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:33.844403 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76877f7-4059-4559-9c59-7ab7140d1869 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:33.848956 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3c0f0-db1c-4490-916a-a4b3f39d14a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:33.849622 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3c0f0-db1c-4490-916a-a4b3f39d14a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:33.850425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3c0f0-db1c-4490-916a-a4b3f39d14a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:33.850692 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3c0f0-db1c-4490-916a-a4b3f39d14a3 admin admin] PATH_INFO: `/v3/projects/955025b84f654400a085883dd04d9db4/users/59bdaf7c6ee347b1b943c1a2e958bdf3/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:33.852606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3c0f0-db1c-4490-916a-a4b3f39d14a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=955025b84f654400a085883dd04d9db4, user_id=59bdaf7c6ee347b1b943c1a2e958bdf3, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:33.855258 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3c0f0-db1c-4490-916a-a4b3f39d14a3 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:33.865135 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1415/2870] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:58:33 2022] PUT /identity/v3/projects/955025b84f654400a085883dd04d9db4/users/59bdaf7c6ee347b1b943c1a2e958bdf3/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:58:33.875669 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa732d2f-2842-42e8-b5ca-01006a45c8ab None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:33.875960 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa732d2f-2842-42e8-b5ca-01006a45c8ab None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:33.876240 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa732d2f-2842-42e8-b5ca-01006a45c8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:33.903421 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-aa732d2f-2842-42e8-b5ca-01006a45c8ab None None] MFA Rules not processed for user `59bdaf7c6ee347b1b943c1a2e958bdf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:33.904726 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-aa732d2f-2842-42e8-b5ca-01006a45c8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:33.972039 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1456/2871] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:58:33.984895 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3c0f0-db1c-4490-916a-a4b3f39d14a3 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:33.986713 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-2df3c0f0-db1c-4490-916a-a4b3f39d14a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:34.028415 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:34.045296 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3c0f0-db1c-4490-916a-a4b3f39d14a3 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:34.048931 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b3f1d-bd1f-4df3-bed8-30a269503938 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:34.049562 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b3f1d-bd1f-4df3-bed8-30a269503938 service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:34.049844 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b3f1d-bd1f-4df3-bed8-30a269503938 service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:34.050120 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b3f1d-bd1f-4df3-bed8-30a269503938 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:34.059245 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b3f1d-bd1f-4df3-bed8-30a269503938 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:34.060686 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b3f1d-bd1f-4df3-bed8-30a269503938 service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:34.070151 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1416/2872] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:58:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:58:34.371134 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa732d2f-2842-42e8-b5ca-01006a45c8ab None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:34.380278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa732d2f-2842-42e8-b5ca-01006a45c8ab None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:34.385574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3afbd-c592-4bad-8419-5978b03574ba tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bdaf7c6ee347b1b943c1a2e958bdf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '955025b84f654400a085883dd04d9db4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:34.386173 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3afbd-c592-4bad-8419-5978b03574ba tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:34.386452 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3afbd-c592-4bad-8419-5978b03574ba tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:34.386747 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3afbd-c592-4bad-8419-5978b03574ba tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:34.387376 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3afbd-c592-4bad-8419-5978b03574ba tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:58:34.387678 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3afbd-c592-4bad-8419-5978b03574ba tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:34.389349 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3afbd-c592-4bad-8419-5978b03574ba tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:34.401402 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1457/2873] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:58:34.405023 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b3f1d-bd1f-4df3-bed8-30a269503938 service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:34.413997 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b3f1d-bd1f-4df3-bed8-30a269503938 service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:34.418477 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d8bbe-9356-400b-b7e5-99deb0e35664 tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bdaf7c6ee347b1b943c1a2e958bdf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '955025b84f654400a085883dd04d9db4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:34.419055 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d8bbe-9356-400b-b7e5-99deb0e35664 tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:34.419333 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d8bbe-9356-400b-b7e5-99deb0e35664 tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:34.419606 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d8bbe-9356-400b-b7e5-99deb0e35664 tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:34.420228 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d8bbe-9356-400b-b7e5-99deb0e35664 tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:34.422223 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d8bbe-9356-400b-b7e5-99deb0e35664 tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:34.451284 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1417/2874] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:58:34 2022] POST /identity/v3/projects => generated 353 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:58:34.452488 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3afbd-c592-4bad-8419-5978b03574ba tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:34.464340 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3afbd-c592-4bad-8419-5978b03574ba tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:34.497010 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:34.525279 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fd96d-ce40-4d27-8124-12eeb45d2a70 tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bdaf7c6ee347b1b943c1a2e958bdf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '955025b84f654400a085883dd04d9db4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:34.525879 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fd96d-ce40-4d27-8124-12eeb45d2a70 tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:34.526164 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fd96d-ce40-4d27-8124-12eeb45d2a70 tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:34.526441 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fd96d-ce40-4d27-8124-12eeb45d2a70 tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:34.527082 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fd96d-ce40-4d27-8124-12eeb45d2a70 tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:58:34.527388 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fd96d-ce40-4d27-8124-12eeb45d2a70 tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:34.528962 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fd96d-ce40-4d27-8124-12eeb45d2a70 tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:34.539985 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1458/2875] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:58:34.576736 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d8bbe-9356-400b-b7e5-99deb0e35664 tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:34.588721 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d8bbe-9356-400b-b7e5-99deb0e35664 tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:34.593660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da1302-7a19-486a-a05d-ede1e76b52ba tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59bdaf7c6ee347b1b943c1a2e958bdf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '955025b84f654400a085883dd04d9db4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:34.594316 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da1302-7a19-486a-a05d-ede1e76b52ba tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:34.594598 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da1302-7a19-486a-a05d-ede1e76b52ba tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:34.594871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da1302-7a19-486a-a05d-ede1e76b52ba tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] PATH_INFO: `/v3/projects/c32df8fb70e84d71bc253d324892fdac` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:34.595977 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da1302-7a19-486a-a05d-ede1e76b52ba tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c32df8fb70e84d71bc253d324892fdac)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:34.597943 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da1302-7a19-486a-a05d-ede1e76b52ba tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:34.643701 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-33da1302-7a19-486a-a05d-ede1e76b52ba tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c32df8fb70e84d71bc253d324892fdac', 'request_id': 'req-33da1302-7a19-486a-a05d-ede1e76b52ba'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:34.651466 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-33da1302-7a19-486a-a05d-ede1e76b52ba tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c32df8fb70e84d71bc253d324892fdac', 'request_id': 'req-33da1302-7a19-486a-a05d-ede1e76b52ba'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:34.657304 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-33da1302-7a19-486a-a05d-ede1e76b52ba tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c32df8fb70e84d71bc253d324892fdac', 'request_id': 'req-33da1302-7a19-486a-a05d-ede1e76b52ba'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:34.668454 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-33da1302-7a19-486a-a05d-ede1e76b52ba tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] The token cache is being invalidate because project c32df8fb70e84d71bc253d324892fdac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:58:34.668736 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-33da1302-7a19-486a-a05d-ede1e76b52ba tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:34.669378 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-33da1302-7a19-486a-a05d-ede1e76b52ba tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:34.670807 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1418/2876] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:58:34 2022] DELETE /identity/v3/projects/c32df8fb70e84d71bc253d324892fdac => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:34.858607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fd96d-ce40-4d27-8124-12eeb45d2a70 tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:34.860376 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-ca5fd96d-ce40-4d27-8124-12eeb45d2a70 tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:34.923517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fd96d-ce40-4d27-8124-12eeb45d2a70 tempest-VolumeQuotaClassesTest-1055895867 tempest-VolumeQuotaClassesTest-1055895867-project-admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:34.978331 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3633311-5f1c-414f-95e5-420fc0120124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:34.978903 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3633311-5f1c-414f-95e5-420fc0120124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:34.979185 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3633311-5f1c-414f-95e5-420fc0120124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:34.979487 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3633311-5f1c-414f-95e5-420fc0120124 admin admin] PATH_INFO: `/v3/users/56e359a127864884859141226c616ad8` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:34.980716 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3633311-5f1c-414f-95e5-420fc0120124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56e359a127864884859141226c616ad8)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:34.982682 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3633311-5f1c-414f-95e5-420fc0120124 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:35.027410 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c3633311-5f1c-414f-95e5-420fc0120124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56e359a127864884859141226c616ad8'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:35.033819 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c3633311-5f1c-414f-95e5-420fc0120124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56e359a127864884859141226c616ad8'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:35.034459 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c3633311-5f1c-414f-95e5-420fc0120124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56e359a127864884859141226c616ad8'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:35.035073 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c3633311-5f1c-414f-95e5-420fc0120124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56e359a127864884859141226c616ad8'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:35.041887 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-c3633311-5f1c-414f-95e5-420fc0120124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56e359a127864884859141226c616ad8'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:35.051887 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:35.060858 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1459/2877] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:58:34 2022] DELETE /identity/v3/users/56e359a127864884859141226c616ad8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:35.065318 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c5617-3e79-4b22-b9f4-3ace2d6e0249 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:35.065607 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c5617-3e79-4b22-b9f4-3ace2d6e0249 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:35.065883 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c5617-3e79-4b22-b9f4-3ace2d6e0249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:35.085984 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-f89c5617-3e79-4b22-b9f4-3ace2d6e0249 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:35.087186 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f89c5617-3e79-4b22-b9f4-3ace2d6e0249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:35.143694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1419/2878] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:58:35.153159 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3633311-5f1c-414f-95e5-420fc0120124 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:35.154543 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-c3633311-5f1c-414f-95e5-420fc0120124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:35.212923 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3633311-5f1c-414f-95e5-420fc0120124 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:35.216576 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfccb2-a72d-4a73-8673-258778bd4232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:35.217202 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfccb2-a72d-4a73-8673-258778bd4232 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:35.217481 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfccb2-a72d-4a73-8673-258778bd4232 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:35.217750 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfccb2-a72d-4a73-8673-258778bd4232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:35.227044 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfccb2-a72d-4a73-8673-258778bd4232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:35.228510 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfccb2-a72d-4a73-8673-258778bd4232 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:35.237799 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1460/2879] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:58:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:58:35.510074 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c5617-3e79-4b22-b9f4-3ace2d6e0249 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:35.511528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-f89c5617-3e79-4b22-b9f4-3ace2d6e0249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:35.524295 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c5617-3e79-4b22-b9f4-3ace2d6e0249 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:35.529097 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1795cc6-f813-476f-826a-87b6ed5cf031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:35.529814 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1795cc6-f813-476f-826a-87b6ed5cf031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:35.530187 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1795cc6-f813-476f-826a-87b6ed5cf031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:35.530528 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1795cc6-f813-476f-826a-87b6ed5cf031 admin admin] PATH_INFO: `/v3/projects/0e382d1c49b84ce39cd04168f4e6fdd5` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:35.531726 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1795cc6-f813-476f-826a-87b6ed5cf031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e382d1c49b84ce39cd04168f4e6fdd5)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:35.533700 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1795cc6-f813-476f-826a-87b6ed5cf031 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:35.572166 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:35.582871 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a1795cc6-f813-476f-826a-87b6ed5cf031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e382d1c49b84ce39cd04168f4e6fdd5', 'request_id': 'req-a1795cc6-f813-476f-826a-87b6ed5cf031'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:35.591004 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a1795cc6-f813-476f-826a-87b6ed5cf031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e382d1c49b84ce39cd04168f4e6fdd5', 'request_id': 'req-a1795cc6-f813-476f-826a-87b6ed5cf031'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:35.596541 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a1795cc6-f813-476f-826a-87b6ed5cf031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e382d1c49b84ce39cd04168f4e6fdd5', 'request_id': 'req-a1795cc6-f813-476f-826a-87b6ed5cf031'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:35.608029 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a1795cc6-f813-476f-826a-87b6ed5cf031 admin admin] The token cache is being invalidate because project 0e382d1c49b84ce39cd04168f4e6fdd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:58:35.608314 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a1795cc6-f813-476f-826a-87b6ed5cf031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:35.608947 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a1795cc6-f813-476f-826a-87b6ed5cf031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:35.610506 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1420/2880] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:58:35 2022] DELETE /identity/v3/projects/0e382d1c49b84ce39cd04168f4e6fdd5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:35.614519 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfccb2-a72d-4a73-8673-258778bd4232 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:35.624272 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfccb2-a72d-4a73-8673-258778bd4232 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:35.679946 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3450ed8-7d1c-4f0d-ae53-8c0a8541a0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:35.680567 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3450ed8-7d1c-4f0d-ae53-8c0a8541a0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:35.680852 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3450ed8-7d1c-4f0d-ae53-8c0a8541a0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:35.681157 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3450ed8-7d1c-4f0d-ae53-8c0a8541a0bb admin admin] PATH_INFO: `/v3/users/59bdaf7c6ee347b1b943c1a2e958bdf3` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:35.682278 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3450ed8-7d1c-4f0d-ae53-8c0a8541a0bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=59bdaf7c6ee347b1b943c1a2e958bdf3)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:35.684192 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3450ed8-7d1c-4f0d-ae53-8c0a8541a0bb admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:35.728928 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d3450ed8-7d1c-4f0d-ae53-8c0a8541a0bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59bdaf7c6ee347b1b943c1a2e958bdf3'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:35.736201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d3450ed8-7d1c-4f0d-ae53-8c0a8541a0bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59bdaf7c6ee347b1b943c1a2e958bdf3'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:35.736818 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d3450ed8-7d1c-4f0d-ae53-8c0a8541a0bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59bdaf7c6ee347b1b943c1a2e958bdf3'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:35.737462 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d3450ed8-7d1c-4f0d-ae53-8c0a8541a0bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59bdaf7c6ee347b1b943c1a2e958bdf3'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:35.744370 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-d3450ed8-7d1c-4f0d-ae53-8c0a8541a0bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59bdaf7c6ee347b1b943c1a2e958bdf3'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:35.761942 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1461/2881] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:58:35 2022] DELETE /identity/v3/users/59bdaf7c6ee347b1b943c1a2e958bdf3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:36.033954 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1795cc6-f813-476f-826a-87b6ed5cf031 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:36.035490 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-a1795cc6-f813-476f-826a-87b6ed5cf031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:36.050265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1795cc6-f813-476f-826a-87b6ed5cf031 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:36.107474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afa928-ad9e-4244-9c27-c6154201c5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:36.108100 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afa928-ad9e-4244-9c27-c6154201c5d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:36.108377 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afa928-ad9e-4244-9c27-c6154201c5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:36.108644 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afa928-ad9e-4244-9c27-c6154201c5d0 admin admin] PATH_INFO: `/v3/projects/955025b84f654400a085883dd04d9db4` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:36.109762 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afa928-ad9e-4244-9c27-c6154201c5d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=955025b84f654400a085883dd04d9db4)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:36.111672 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afa928-ad9e-4244-9c27-c6154201c5d0 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:36.156899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-65afa928-ad9e-4244-9c27-c6154201c5d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '955025b84f654400a085883dd04d9db4', 'request_id': 'req-65afa928-ad9e-4244-9c27-c6154201c5d0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:36.163492 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-65afa928-ad9e-4244-9c27-c6154201c5d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '955025b84f654400a085883dd04d9db4', 'request_id': 'req-65afa928-ad9e-4244-9c27-c6154201c5d0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:36.169050 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-65afa928-ad9e-4244-9c27-c6154201c5d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '955025b84f654400a085883dd04d9db4', 'request_id': 'req-65afa928-ad9e-4244-9c27-c6154201c5d0'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:36.179759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-65afa928-ad9e-4244-9c27-c6154201c5d0 admin admin] The token cache is being invalidate because project 955025b84f654400a085883dd04d9db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:58:36.180041 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-65afa928-ad9e-4244-9c27-c6154201c5d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:36.180664 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-65afa928-ad9e-4244-9c27-c6154201c5d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:36.182155 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1421/2882] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:58:36 2022] DELETE /identity/v3/projects/955025b84f654400a085883dd04d9db4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:36.186992 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eacc0e-e763-4e5d-83d5-43d9cc82709d None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:36.187285 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eacc0e-e763-4e5d-83d5-43d9cc82709d None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:36.187589 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eacc0e-e763-4e5d-83d5-43d9cc82709d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:36.208076 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-66eacc0e-e763-4e5d-83d5-43d9cc82709d None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:36.209335 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-66eacc0e-e763-4e5d-83d5-43d9cc82709d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:36.219270 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:36.273203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1462/2883] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:58:36.281263 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de59266-926e-47bb-9eaa-003cd4691638 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:36.281513 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de59266-926e-47bb-9eaa-003cd4691638 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:36.281787 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de59266-926e-47bb-9eaa-003cd4691638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:36.301126 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-8de59266-926e-47bb-9eaa-003cd4691638 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:36.302315 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8de59266-926e-47bb-9eaa-003cd4691638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:36.310665 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1422/2884] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:58:36.314754 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eacc0e-e763-4e5d-83d5-43d9cc82709d None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:36.325022 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eacc0e-e763-4e5d-83d5-43d9cc82709d None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:36.329850 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcd5b0-1513-4b79-9035-e39c0ee1f2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:36.330447 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcd5b0-1513-4b79-9035-e39c0ee1f2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:36.330728 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcd5b0-1513-4b79-9035-e39c0ee1f2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:36.331268 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddcd5b0-1513-4b79-9035-e39c0ee1f2a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:36.331914 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddcd5b0-1513-4b79-9035-e39c0ee1f2a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:58:36.332219 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddcd5b0-1513-4b79-9035-e39c0ee1f2a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:36.333843 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddcd5b0-1513-4b79-9035-e39c0ee1f2a8 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:36.345573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1463/2885] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:58:36.349889 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de59266-926e-47bb-9eaa-003cd4691638 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:36.358937 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de59266-926e-47bb-9eaa-003cd4691638 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:36.363745 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9aa18-8c48-46c2-8c98-4723e7bd0d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:36.364342 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9aa18-8c48-46c2-8c98-4723e7bd0d56 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:36.364812 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9aa18-8c48-46c2-8c98-4723e7bd0d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:36.365118 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9aa18-8c48-46c2-8c98-4723e7bd0d56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:36.365752 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9aa18-8c48-46c2-8c98-4723e7bd0d56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:36.368294 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9aa18-8c48-46c2-8c98-4723e7bd0d56 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:36.395074 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1423/2886] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:58:36 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:58:36.399300 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcd5b0-1513-4b79-9035-e39c0ee1f2a8 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:36.409035 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddcd5b0-1513-4b79-9035-e39c0ee1f2a8 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:36.466149 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d34a0-a310-48c1-b9a6-79593ce9e97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:36.467128 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d34a0-a310-48c1-b9a6-79593ce9e97e admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:36.467594 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d34a0-a310-48c1-b9a6-79593ce9e97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:36.468004 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d34a0-a310-48c1-b9a6-79593ce9e97e admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:36.468642 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d34a0-a310-48c1-b9a6-79593ce9e97e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:36.470588 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d34a0-a310-48c1-b9a6-79593ce9e97e admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:36.491601 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1464/2887] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:58:36 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:58:36.495721 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9aa18-8c48-46c2-8c98-4723e7bd0d56 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:36.505815 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9aa18-8c48-46c2-8c98-4723e7bd0d56 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:36.510986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b8a08-2d5d-459a-9caa-8d8367cffb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:36.511577 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b8a08-2d5d-459a-9caa-8d8367cffb08 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:36.511833 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b8a08-2d5d-459a-9caa-8d8367cffb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:36.512100 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b8a08-2d5d-459a-9caa-8d8367cffb08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:36.512730 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b8a08-2d5d-459a-9caa-8d8367cffb08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:36.514379 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b8a08-2d5d-459a-9caa-8d8367cffb08 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:36.523983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1424/2888] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:58:36.527751 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d34a0-a310-48c1-b9a6-79593ce9e97e admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:36.537661 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d34a0-a310-48c1-b9a6-79593ce9e97e admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:36.544284 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a232820-ae8d-438c-8e48-185c206f9479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:36.544456 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a232820-ae8d-438c-8e48-185c206f9479 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:36.544779 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a232820-ae8d-438c-8e48-185c206f9479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:36.545117 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a232820-ae8d-438c-8e48-185c206f9479 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:36.545835 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a232820-ae8d-438c-8e48-185c206f9479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:36.547645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a232820-ae8d-438c-8e48-185c206f9479 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:36.558532 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1465/2889] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:58:36.562652 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b8a08-2d5d-459a-9caa-8d8367cffb08 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:36.573326 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b8a08-2d5d-459a-9caa-8d8367cffb08 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:36.577954 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27295b8-2558-47fd-8192-183709ff1e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:36.578597 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27295b8-2558-47fd-8192-183709ff1e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:36.578880 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27295b8-2558-47fd-8192-183709ff1e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:36.579158 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27295b8-2558-47fd-8192-183709ff1e55 admin admin] PATH_INFO: `/v3/projects/35f762474264489897936eb46c4b6bbc/users/f3c75afd0f264f57bded45342d3fd9fa/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:36.591209 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:36.594493 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27295b8-2558-47fd-8192-183709ff1e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f762474264489897936eb46c4b6bbc, user_id=f3c75afd0f264f57bded45342d3fd9fa, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:36.597718 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27295b8-2558-47fd-8192-183709ff1e55 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:36.611640 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1425/2890] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:58:36 2022] PUT /identity/v3/projects/35f762474264489897936eb46c4b6bbc/users/f3c75afd0f264f57bded45342d3fd9fa/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:36.623749 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabe450-48ee-47dd-b9a8-f9c21687cbf0 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:36.624242 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabe450-48ee-47dd-b9a8-f9c21687cbf0 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:36.624360 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabe450-48ee-47dd-b9a8-f9c21687cbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:36.651629 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-aeabe450-48ee-47dd-b9a8-f9c21687cbf0 None None] MFA Rules not processed for user `f3c75afd0f264f57bded45342d3fd9fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:36.653005 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-aeabe450-48ee-47dd-b9a8-f9c21687cbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:36.716201 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1466/2891] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:58:36.720646 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27295b8-2558-47fd-8192-183709ff1e55 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:36.781218 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27295b8-2558-47fd-8192-183709ff1e55 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:36.785946 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc6732-694d-4a1f-83fe-0f8d7fa17c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:36.786534 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc6732-694d-4a1f-83fe-0f8d7fa17c9c admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:36.786814 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc6732-694d-4a1f-83fe-0f8d7fa17c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:36.787083 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc6732-694d-4a1f-83fe-0f8d7fa17c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:36.787758 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc6732-694d-4a1f-83fe-0f8d7fa17c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:36.790151 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc6732-694d-4a1f-83fe-0f8d7fa17c9c admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:36.815956 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1426/2892] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:58:36 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:58:36.819934 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabe450-48ee-47dd-b9a8-f9c21687cbf0 None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:36.830393 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabe450-48ee-47dd-b9a8-f9c21687cbf0 None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:36.838269 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:36.887241 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5233c9-820e-4742-a2f7-0cf07e44dd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:36.887851 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5233c9-820e-4742-a2f7-0cf07e44dd15 admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:36.888134 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5233c9-820e-4742-a2f7-0cf07e44dd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:36.888417 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5233c9-820e-4742-a2f7-0cf07e44dd15 admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:36.889283 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5233c9-820e-4742-a2f7-0cf07e44dd15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:36.891148 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5233c9-820e-4742-a2f7-0cf07e44dd15 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:36.912118 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1467/2893] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:58:36 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:58:36.916149 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc6732-694d-4a1f-83fe-0f8d7fa17c9c admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:36.926306 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc6732-694d-4a1f-83fe-0f8d7fa17c9c admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:36.930921 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f27ee4-bdc6-4301-9551-b5be79dca4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:36.931509 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f27ee4-bdc6-4301-9551-b5be79dca4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:36.931789 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f27ee4-bdc6-4301-9551-b5be79dca4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:36.932062 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f27ee4-bdc6-4301-9551-b5be79dca4b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:36.932694 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f27ee4-bdc6-4301-9551-b5be79dca4b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:36.934339 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f27ee4-bdc6-4301-9551-b5be79dca4b2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:36.945369 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1427/2894] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:58:36.949427 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5233c9-820e-4742-a2f7-0cf07e44dd15 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:36.959519 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5233c9-820e-4742-a2f7-0cf07e44dd15 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:36.964670 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa0e6e-6201-45ed-8f1b-6cfbaecdde2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:36.965347 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa0e6e-6201-45ed-8f1b-6cfbaecdde2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:36.965627 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa0e6e-6201-45ed-8f1b-6cfbaecdde2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:36.965907 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa0e6e-6201-45ed-8f1b-6cfbaecdde2d admin admin] PATH_INFO: `/v3/projects/35e250279a4743399de305f1ee664345/users/d19701ea184b4a8eb55c21d154d15030/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:36.980235 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa0e6e-6201-45ed-8f1b-6cfbaecdde2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e250279a4743399de305f1ee664345, user_id=d19701ea184b4a8eb55c21d154d15030, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:36.982913 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa0e6e-6201-45ed-8f1b-6cfbaecdde2d admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:36.995298 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1468/2895] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:58:36 2022] PUT /identity/v3/projects/35e250279a4743399de305f1ee664345/users/d19701ea184b4a8eb55c21d154d15030/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:58:36.999175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f27ee4-bdc6-4301-9551-b5be79dca4b2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:37.009677 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f27ee4-bdc6-4301-9551-b5be79dca4b2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:37.064654 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7858e4-ecf7-4f27-9045-4156a510417d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:37.065242 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7858e4-ecf7-4f27-9045-4156a510417d admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:37.065524 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7858e4-ecf7-4f27-9045-4156a510417d admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:37.065799 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7858e4-ecf7-4f27-9045-4156a510417d admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:37.066429 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7858e4-ecf7-4f27-9045-4156a510417d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:37.068024 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7858e4-ecf7-4f27-9045-4156a510417d admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:37.078092 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1428/2896] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:58:37.082384 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa0e6e-6201-45ed-8f1b-6cfbaecdde2d admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:37.092861 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa0e6e-6201-45ed-8f1b-6cfbaecdde2d admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:37.097606 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac07a86-d572-45f2-8514-dea0bfae2444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:37.098256 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac07a86-d572-45f2-8514-dea0bfae2444 admin admin] REQUEST_METHOD: `PUT` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:37.098543 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac07a86-d572-45f2-8514-dea0bfae2444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:37.098847 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac07a86-d572-45f2-8514-dea0bfae2444 admin admin] PATH_INFO: `/v3/projects/35e250279a4743399de305f1ee664345/users/d19701ea184b4a8eb55c21d154d15030/roles/0ee2daa9cb3c41fb901603e3d8caf784` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:37.100778 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac07a86-d572-45f2-8514-dea0bfae2444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e250279a4743399de305f1ee664345, user_id=d19701ea184b4a8eb55c21d154d15030, role_id=0ee2daa9cb3c41fb901603e3d8caf784)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:37.103450 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac07a86-d572-45f2-8514-dea0bfae2444 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:37.113519 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1469/2897] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:58:37 2022] PUT /identity/v3/projects/35e250279a4743399de305f1ee664345/users/d19701ea184b4a8eb55c21d154d15030/roles/0ee2daa9cb3c41fb901603e3d8caf784 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:37.124330 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6e598-bb54-4b8c-90af-7043ae9bb6d6 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:37.124612 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6e598-bb54-4b8c-90af-7043ae9bb6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:37.124885 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6e598-bb54-4b8c-90af-7043ae9bb6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:37.152541 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b5d6e598-bb54-4b8c-90af-7043ae9bb6d6 None None] MFA Rules not processed for user `d19701ea184b4a8eb55c21d154d15030`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:37.153777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b5d6e598-bb54-4b8c-90af-7043ae9bb6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:37.201902 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:37.222566 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1429/2898] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:37 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:58:37.234016 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac07a86-d572-45f2-8514-dea0bfae2444 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:37.235714 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-fac07a86-d572-45f2-8514-dea0bfae2444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:37.292674 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac07a86-d572-45f2-8514-dea0bfae2444 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:37.296320 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd397974-f38c-4cd6-badc-a7e0823cc23b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:37.296914 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd397974-f38c-4cd6-badc-a7e0823cc23b service cinder] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:37.297226 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd397974-f38c-4cd6-badc-a7e0823cc23b service cinder] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:37.297503 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd397974-f38c-4cd6-badc-a7e0823cc23b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:37.307872 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd397974-f38c-4cd6-badc-a7e0823cc23b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:37.309323 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd397974-f38c-4cd6-badc-a7e0823cc23b service cinder] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:37.318758 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1470/2899] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:58:37 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:58:37.392086 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6e598-bb54-4b8c-90af-7043ae9bb6d6 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:37.401747 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6e598-bb54-4b8c-90af-7043ae9bb6d6 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:37.405265 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f3bf6-2da3-43d9-abf9-5c2ead8b113c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:37.405850 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f3bf6-2da3-43d9-abf9-5c2ead8b113c service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:37.406119 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f3bf6-2da3-43d9-abf9-5c2ead8b113c service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:37.406384 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f3bf6-2da3-43d9-abf9-5c2ead8b113c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:37.461989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f3bf6-2da3-43d9-abf9-5c2ead8b113c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:37.463427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f3bf6-2da3-43d9-abf9-5c2ead8b113c service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:37.472489 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1430/2900] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:58:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:58:37.733023 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd397974-f38c-4cd6-badc-a7e0823cc23b service cinder] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:37.795899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd397974-f38c-4cd6-badc-a7e0823cc23b service cinder] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:37.800640 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8074f1-e7e7-42ad-bca0-0d3508b8914f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:37.801288 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8074f1-e7e7-42ad-bca0-0d3508b8914f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:37.801589 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8074f1-e7e7-42ad-bca0-0d3508b8914f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:37.801870 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8074f1-e7e7-42ad-bca0-0d3508b8914f admin admin] PATH_INFO: `/v3/users/f3c75afd0f264f57bded45342d3fd9fa` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:37.802982 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8074f1-e7e7-42ad-bca0-0d3508b8914f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3c75afd0f264f57bded45342d3fd9fa)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:37.804891 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8074f1-e7e7-42ad-bca0-0d3508b8914f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:37.810282 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:37.853577 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5b8074f1-e7e7-42ad-bca0-0d3508b8914f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3c75afd0f264f57bded45342d3fd9fa'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:37.860568 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5b8074f1-e7e7-42ad-bca0-0d3508b8914f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3c75afd0f264f57bded45342d3fd9fa'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:37.861197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5b8074f1-e7e7-42ad-bca0-0d3508b8914f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3c75afd0f264f57bded45342d3fd9fa'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:37.861814 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5b8074f1-e7e7-42ad-bca0-0d3508b8914f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3c75afd0f264f57bded45342d3fd9fa'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:37.868715 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-5b8074f1-e7e7-42ad-bca0-0d3508b8914f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3c75afd0f264f57bded45342d3fd9fa'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:37.885268 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1471/2901] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:58:37 2022] DELETE /identity/v3/users/f3c75afd0f264f57bded45342d3fd9fa => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:37.889691 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a92c50-92bb-4308-9435-91f1e6c8f725 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:37.890169 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a92c50-92bb-4308-9435-91f1e6c8f725 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:37.890278 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a92c50-92bb-4308-9435-91f1e6c8f725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:37.909286 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-42a92c50-92bb-4308-9435-91f1e6c8f725 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:37.910474 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-42a92c50-92bb-4308-9435-91f1e6c8f725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:37.968863 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1431/2902] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:58:37.979174 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8074f1-e7e7-42ad-bca0-0d3508b8914f admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:37.980543 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5b8074f1-e7e7-42ad-bca0-0d3508b8914f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:38.035766 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8074f1-e7e7-42ad-bca0-0d3508b8914f admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:38.039921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0b24d-1e26-406b-8465-bcb9e2d4c780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:38.040506 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0b24d-1e26-406b-8465-bcb9e2d4c780 service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:38.040783 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0b24d-1e26-406b-8465-bcb9e2d4c780 service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:38.041052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0b24d-1e26-406b-8465-bcb9e2d4c780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:38.049937 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0b24d-1e26-406b-8465-bcb9e2d4c780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:38.051399 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0b24d-1e26-406b-8465-bcb9e2d4c780 service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:38.061138 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1472/2903] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 00:58:38.319684 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a92c50-92bb-4308-9435-91f1e6c8f725 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:38.327662 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-42a92c50-92bb-4308-9435-91f1e6c8f725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:38.340967 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a92c50-92bb-4308-9435-91f1e6c8f725 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:38.348452 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86846c1-98b6-4752-bb80-933fd92f16b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:38.349107 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86846c1-98b6-4752-bb80-933fd92f16b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:38.349403 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86846c1-98b6-4752-bb80-933fd92f16b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:38.349740 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86846c1-98b6-4752-bb80-933fd92f16b2 admin admin] PATH_INFO: `/v3/projects/35f762474264489897936eb46c4b6bbc` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:38.350799 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86846c1-98b6-4752-bb80-933fd92f16b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f762474264489897936eb46c4b6bbc)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:38.352775 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86846c1-98b6-4752-bb80-933fd92f16b2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:38.399006 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d86846c1-98b6-4752-bb80-933fd92f16b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f762474264489897936eb46c4b6bbc', 'request_id': 'req-d86846c1-98b6-4752-bb80-933fd92f16b2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:38.405876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d86846c1-98b6-4752-bb80-933fd92f16b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f762474264489897936eb46c4b6bbc', 'request_id': 'req-d86846c1-98b6-4752-bb80-933fd92f16b2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:38.411210 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d86846c1-98b6-4752-bb80-933fd92f16b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f762474264489897936eb46c4b6bbc', 'request_id': 'req-d86846c1-98b6-4752-bb80-933fd92f16b2'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:38.422113 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d86846c1-98b6-4752-bb80-933fd92f16b2 admin admin] The token cache is being invalidate because project 35f762474264489897936eb46c4b6bbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:58:38.422404 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d86846c1-98b6-4752-bb80-933fd92f16b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:38.423039 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-d86846c1-98b6-4752-bb80-933fd92f16b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:38.424498 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1432/2904] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:58:38 2022] DELETE /identity/v3/projects/35f762474264489897936eb46c4b6bbc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 00:58:38.428574 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0b24d-1e26-406b-8465-bcb9e2d4c780 service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:38.438179 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0b24d-1e26-406b-8465-bcb9e2d4c780 service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:38.495060 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9886f8-46d3-4620-a48e-b948163f58b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:38.495682 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9886f8-46d3-4620-a48e-b948163f58b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:38.495964 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9886f8-46d3-4620-a48e-b948163f58b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:38.496238 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9886f8-46d3-4620-a48e-b948163f58b0 admin admin] PATH_INFO: `/v3/users/d19701ea184b4a8eb55c21d154d15030` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:38.497382 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9886f8-46d3-4620-a48e-b948163f58b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d19701ea184b4a8eb55c21d154d15030)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:38.499301 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9886f8-46d3-4620-a48e-b948163f58b0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:38.531743 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:38.545797 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7e9886f8-46d3-4620-a48e-b948163f58b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd19701ea184b4a8eb55c21d154d15030'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:38.552959 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7e9886f8-46d3-4620-a48e-b948163f58b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd19701ea184b4a8eb55c21d154d15030'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:38.554159 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7e9886f8-46d3-4620-a48e-b948163f58b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd19701ea184b4a8eb55c21d154d15030'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:38.554762 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7e9886f8-46d3-4620-a48e-b948163f58b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd19701ea184b4a8eb55c21d154d15030'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:38.561645 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-7e9886f8-46d3-4620-a48e-b948163f58b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd19701ea184b4a8eb55c21d154d15030'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:38.578869 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1473/2905] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 00:58:38 2022] DELETE /identity/v3/users/d19701ea184b4a8eb55c21d154d15030 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:38.855134 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86846c1-98b6-4752-bb80-933fd92f16b2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:38.856803 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-d86846c1-98b6-4752-bb80-933fd92f16b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:38.872552 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86846c1-98b6-4752-bb80-933fd92f16b2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:38.877425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:38.930937 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8e0f4-7780-4215-a7d3-dce523b39ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:38.931600 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8e0f4-7780-4215-a7d3-dce523b39ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:38.931751 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8e0f4-7780-4215-a7d3-dce523b39ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:38.932021 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8e0f4-7780-4215-a7d3-dce523b39ae7 admin admin] PATH_INFO: `/v3/projects/35e250279a4743399de305f1ee664345` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:38.933151 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8e0f4-7780-4215-a7d3-dce523b39ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35e250279a4743399de305f1ee664345)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:38.935064 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8e0f4-7780-4215-a7d3-dce523b39ae7 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:38.979709 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a2d8e0f4-7780-4215-a7d3-dce523b39ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35e250279a4743399de305f1ee664345', 'request_id': 'req-a2d8e0f4-7780-4215-a7d3-dce523b39ae7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:38.986743 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a2d8e0f4-7780-4215-a7d3-dce523b39ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35e250279a4743399de305f1ee664345', 'request_id': 'req-a2d8e0f4-7780-4215-a7d3-dce523b39ae7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:38.992759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a2d8e0f4-7780-4215-a7d3-dce523b39ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35e250279a4743399de305f1ee664345', 'request_id': 'req-a2d8e0f4-7780-4215-a7d3-dce523b39ae7'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:39.003417 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a2d8e0f4-7780-4215-a7d3-dce523b39ae7 admin admin] The token cache is being invalidate because project 35e250279a4743399de305f1ee664345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 00:58:39.003727 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a2d8e0f4-7780-4215-a7d3-dce523b39ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:39.004349 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-a2d8e0f4-7780-4215-a7d3-dce523b39ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 00:58:39.005844 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1433/2906] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 00:58:38 2022] DELETE /identity/v3/projects/35e250279a4743399de305f1ee664345 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:39.010701 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b906799-d17a-4d04-b366-4bd6db3c465e None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:39.011186 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b906799-d17a-4d04-b366-4bd6db3c465e None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:39.011304 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b906799-d17a-4d04-b366-4bd6db3c465e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:39.030329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-2b906799-d17a-4d04-b366-4bd6db3c465e None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:39.031517 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-2b906799-d17a-4d04-b366-4bd6db3c465e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:39.090103 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1474/2907] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:58:39.099318 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04579b9-c414-4e92-98d6-60ac1fccedd1 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:39.099604 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04579b9-c414-4e92-98d6-60ac1fccedd1 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:39.099879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04579b9-c414-4e92-98d6-60ac1fccedd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:39.120178 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-b04579b9-c414-4e92-98d6-60ac1fccedd1 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:39.121400 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-b04579b9-c414-4e92-98d6-60ac1fccedd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:39.129178 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1434/2908] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 00:58:39.133361 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b906799-d17a-4d04-b366-4bd6db3c465e None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:39.142931 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b906799-d17a-4d04-b366-4bd6db3c465e None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:39.147453 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bbc67-58e3-40ed-bf4e-360a7caf18d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:39.148042 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bbc67-58e3-40ed-bf4e-360a7caf18d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:39.148325 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bbc67-58e3-40ed-bf4e-360a7caf18d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:39.148593 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bbc67-58e3-40ed-bf4e-360a7caf18d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:39.149267 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bbc67-58e3-40ed-bf4e-360a7caf18d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 00:58:39.149573 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bbc67-58e3-40ed-bf4e-360a7caf18d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:39.151145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bbc67-58e3-40ed-bf4e-360a7caf18d0 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:39.162411 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1475/2909] 10.222.0.52 () {58 vars in 1153 bytes} [Thu Sep 15 00:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 00:58:39.167051 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04579b9-c414-4e92-98d6-60ac1fccedd1 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:39.176219 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04579b9-c414-4e92-98d6-60ac1fccedd1 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:39.181527 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebabac-8313-40a2-8218-2bdc6264a431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:39.182030 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebabac-8313-40a2-8218-2bdc6264a431 admin admin] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:39.182305 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebabac-8313-40a2-8218-2bdc6264a431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:39.182573 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebabac-8313-40a2-8218-2bdc6264a431 admin admin] PATH_INFO: `/v3/projects` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:39.183200 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebabac-8313-40a2-8218-2bdc6264a431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:39.185102 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebabac-8313-40a2-8218-2bdc6264a431 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:39.211663 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1435/2910] 10.222.0.52 () {60 vars in 1153 bytes} [Thu Sep 15 00:58:39 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 00:58:39.215520 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bbc67-58e3-40ed-bf4e-360a7caf18d0 admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:39.225251 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bbc67-58e3-40ed-bf4e-360a7caf18d0 admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:39.281791 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159d6a4-bff4-4f58-a084-ed5f4bd0769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:39.282386 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159d6a4-bff4-4f58-a084-ed5f4bd0769f admin admin] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:39.282661 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159d6a4-bff4-4f58-a084-ed5f4bd0769f admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:39.282929 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159d6a4-bff4-4f58-a084-ed5f4bd0769f admin admin] PATH_INFO: `/v3/users` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:39.283557 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159d6a4-bff4-4f58-a084-ed5f4bd0769f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:39.285487 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159d6a4-bff4-4f58-a084-ed5f4bd0769f admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:39.306676 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1476/2911] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Sep 15 00:58:39 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 00:58:39.310766 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebabac-8313-40a2-8218-2bdc6264a431 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:39.320852 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebabac-8313-40a2-8218-2bdc6264a431 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:39.325992 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435b775-661b-430d-be31-fe536d6c51a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:39.326697 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435b775-661b-430d-be31-fe536d6c51a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:39.326980 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435b775-661b-430d-be31-fe536d6c51a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:39.327247 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435b775-661b-430d-be31-fe536d6c51a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:39.327879 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435b775-661b-430d-be31-fe536d6c51a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:39.329526 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435b775-661b-430d-be31-fe536d6c51a5 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:39.340668 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1436/2912] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:58:39.344939 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159d6a4-bff4-4f58-a084-ed5f4bd0769f admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:39.356590 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159d6a4-bff4-4f58-a084-ed5f4bd0769f admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:39.361352 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb787a-c5ff-47a2-a638-8a5471ffba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:39.361954 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb787a-c5ff-47a2-a638-8a5471ffba92 admin admin] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:39.362233 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb787a-c5ff-47a2-a638-8a5471ffba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:39.362505 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb787a-c5ff-47a2-a638-8a5471ffba92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:39.363173 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb787a-c5ff-47a2-a638-8a5471ffba92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:39.364857 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb787a-c5ff-47a2-a638-8a5471ffba92 admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:39.375591 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1477/2913] 10.222.0.52 () {58 vars in 1122 bytes} [Thu Sep 15 00:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 00:58:39.379771 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435b775-661b-430d-be31-fe536d6c51a5 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:39.389926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435b775-661b-430d-be31-fe536d6c51a5 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:39.394617 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac801774-a136-4f38-81f2-0c6311edbff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:39.395259 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac801774-a136-4f38-81f2-0c6311edbff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:39.395537 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac801774-a136-4f38-81f2-0c6311edbff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:39.395810 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac801774-a136-4f38-81f2-0c6311edbff2 admin admin] PATH_INFO: `/v3/projects/0cb2ec57f5db4d86bb67f183f5183273/users/a1cdec56d1854cbb82cf235fc47418ab/roles/24171c44541e4c4782ec7d3f03b50467` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:39.410638 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac801774-a136-4f38-81f2-0c6311edbff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb2ec57f5db4d86bb67f183f5183273, user_id=a1cdec56d1854cbb82cf235fc47418ab, role_id=24171c44541e4c4782ec7d3f03b50467)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:39.413986 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac801774-a136-4f38-81f2-0c6311edbff2 admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:39.426175 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1437/2914] 10.222.0.52 () {60 vars in 1483 bytes} [Thu Sep 15 00:58:39 2022] PUT /identity/v3/projects/0cb2ec57f5db4d86bb67f183f5183273/users/a1cdec56d1854cbb82cf235fc47418ab/roles/24171c44541e4c4782ec7d3f03b50467 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 00:58:39.431056 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f95eb-61b2-4644-85ab-3ad1fa210d77 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:39.431343 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f95eb-61b2-4644-85ab-3ad1fa210d77 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:39.431670 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f95eb-61b2-4644-85ab-3ad1fa210d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:39.450494 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-5e6f95eb-61b2-4644-85ab-3ad1fa210d77 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:39.451714 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5e6f95eb-61b2-4644-85ab-3ad1fa210d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:39.460145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:39.511911 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1478/2915] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:58:39.521469 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac801774-a136-4f38-81f2-0c6311edbff2 admin admin] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:39.523149 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ac801774-a136-4f38-81f2-0c6311edbff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:39.562980 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:39.582176 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac801774-a136-4f38-81f2-0c6311edbff2 admin admin] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:39.585744 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea2b5a-b4c4-49a3-ad7a-c4eac96fa8b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:39.586920 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea2b5a-b4c4-49a3-ad7a-c4eac96fa8b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:39.587194 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea2b5a-b4c4-49a3-ad7a-c4eac96fa8b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:39.587460 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea2b5a-b4c4-49a3-ad7a-c4eac96fa8b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:39.596138 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea2b5a-b4c4-49a3-ad7a-c4eac96fa8b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:39.597611 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea2b5a-b4c4-49a3-ad7a-c4eac96fa8b6 service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:39.606673 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1438/2916] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:58:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:58:40.229810 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f2028-4f24-4512-a12e-0a1950ecb5a3 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:40.230340 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f2028-4f24-4512-a12e-0a1950ecb5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:40.230659 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f2028-4f24-4512-a12e-0a1950ecb5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:40.260232 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-be0f2028-4f24-4512-a12e-0a1950ecb5a3 None None] MFA Rules not processed for user `a1cdec56d1854cbb82cf235fc47418ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:40.261443 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-be0f2028-4f24-4512-a12e-0a1950ecb5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:40.329538 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1479/2917] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:58:40.340360 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea2b5a-b4c4-49a3-ad7a-c4eac96fa8b6 service neutron] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:40.342292 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-dcea2b5a-b4c4-49a3-ad7a-c4eac96fa8b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:40.405541 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea2b5a-b4c4-49a3-ad7a-c4eac96fa8b6 service neutron] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:40.409207 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45178b-7d0b-4c6c-977b-ef954d75503f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8e11feaab0c4d29b78b2e9273e5d2ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:40.409875 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45178b-7d0b-4c6c-977b-ef954d75503f service cinder] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:40.410082 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45178b-7d0b-4c6c-977b-ef954d75503f service cinder] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:40.410353 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45178b-7d0b-4c6c-977b-ef954d75503f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:40.419497 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45178b-7d0b-4c6c-977b-ef954d75503f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:40.420926 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45178b-7d0b-4c6c-977b-ef954d75503f service cinder] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:40.429718 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1439/2918] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:58:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:58:41.799363 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3ff16-ab65-48d5-9527-1c62f2beb6a8 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:41.799912 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3ff16-ab65-48d5-9527-1c62f2beb6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:41.799912 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3ff16-ab65-48d5-9527-1c62f2beb6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:41.819583 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-10f3ff16-ab65-48d5-9527-1c62f2beb6a8 None None] MFA Rules not processed for user `a1cdec56d1854cbb82cf235fc47418ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:58:41.821492 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-10f3ff16-ab65-48d5-9527-1c62f2beb6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:41.828291 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1480/2919] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:58:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:58:42.913819 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45178b-7d0b-4c6c-977b-ef954d75503f service cinder] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:58:42.915239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-ec45178b-7d0b-4c6c-977b-ef954d75503f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:42.985161 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45178b-7d0b-4c6c-977b-ef954d75503f service cinder] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:58:42.990046 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf27f97-47bb-4c0f-ae07-4393d0321f62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed987b44d934ac7b2dc64c0aab28099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:58:42.990639 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf27f97-47bb-4c0f-ae07-4393d0321f62 service placement] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:58:42.990916 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf27f97-47bb-4c0f-ae07-4393d0321f62 service placement] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:58:42.991757 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf27f97-47bb-4c0f-ae07-4393d0321f62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:58:42.993981 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9bf27f97-47bb-4c0f-ae07-4393d0321f62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:58:43.005077 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf27f97-47bb-4c0f-ae07-4393d0321f62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:58:43.006688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf27f97-47bb-4c0f-ae07-4393d0321f62 service placement] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:58:43.017013 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1440/2920] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:58:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:58:51.814329 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=56 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:58:53.013337 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=68 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:59:08.328794 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a349850-0c94-427c-b2ba-22f20fb31da5 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:08.329400 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a349850-0c94-427c-b2ba-22f20fb31da5 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:08.329400 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a349850-0c94-427c-b2ba-22f20fb31da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:08.349807 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-5a349850-0c94-427c-b2ba-22f20fb31da5 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:59:08.351006 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5a349850-0c94-427c-b2ba-22f20fb31da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:59:08.358856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1481/2921] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Sep 15 00:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:59:08.417333 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf27f97-47bb-4c0f-ae07-4393d0321f62 service placement] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:59:08.419246 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-9bf27f97-47bb-4c0f-ae07-4393d0321f62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:59:08.490427 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf27f97-47bb-4c0f-ae07-4393d0321f62 service placement] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:59:08.495786 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37939c55-adcc-4d1d-ac6f-daaae36a0e09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:59:08.496431 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37939c55-adcc-4d1d-ac6f-daaae36a0e09 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:08.496704 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37939c55-adcc-4d1d-ac6f-daaae36a0e09 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:08.496973 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37939c55-adcc-4d1d-ac6f-daaae36a0e09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:08.505449 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37939c55-adcc-4d1d-ac6f-daaae36a0e09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:59:08.507027 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37939c55-adcc-4d1d-ac6f-daaae36a0e09 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:59:08.516256 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1441/2922] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:59:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:59:11.421379 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d2fad-6ef7-4002-b935-ea8620c66bc7 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:11.421909 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d2fad-6ef7-4002-b935-ea8620c66bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:11.421909 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d2fad-6ef7-4002-b935-ea8620c66bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:11.441667 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-349d2fad-6ef7-4002-b935-ea8620c66bc7 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:59:11.442861 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-349d2fad-6ef7-4002-b935-ea8620c66bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:59:11.450660 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1482/2923] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Sep 15 00:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:59:11.470910 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37939c55-adcc-4d1d-ac6f-daaae36a0e09 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:59:11.472356 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-37939c55-adcc-4d1d-ac6f-daaae36a0e09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:59:11.486706 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37939c55-adcc-4d1d-ac6f-daaae36a0e09 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:59:11.492136 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d439a0-8bd6-4c06-8ae6-e05d32b6f23d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:59:11.492717 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d439a0-8bd6-4c06-8ae6-e05d32b6f23d service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:11.492989 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d439a0-8bd6-4c06-8ae6-e05d32b6f23d service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:11.493284 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d439a0-8bd6-4c06-8ae6-e05d32b6f23d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:11.501171 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d439a0-8bd6-4c06-8ae6-e05d32b6f23d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:59:11.503239 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d439a0-8bd6-4c06-8ae6-e05d32b6f23d service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:59:11.512396 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1442/2924] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:59:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:59:14.640383 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20bd05-55be-4a31-9141-5dbb60f46a77 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:14.640925 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20bd05-55be-4a31-9141-5dbb60f46a77 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:14.640925 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20bd05-55be-4a31-9141-5dbb60f46a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:14.659895 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-5b20bd05-55be-4a31-9141-5dbb60f46a77 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:59:14.661101 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-5b20bd05-55be-4a31-9141-5dbb60f46a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:59:14.669765 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1483/2925] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Sep 15 00:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:59:14.690666 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d439a0-8bd6-4c06-8ae6-e05d32b6f23d service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:59:14.701899 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d439a0-8bd6-4c06-8ae6-e05d32b6f23d service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:59:14.707577 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9beff8-fc61-4a3a-b83e-0f30a724993f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:59:14.708187 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9beff8-fc61-4a3a-b83e-0f30a724993f service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:14.708462 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9beff8-fc61-4a3a-b83e-0f30a724993f service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:14.708730 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9beff8-fc61-4a3a-b83e-0f30a724993f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:14.716841 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9beff8-fc61-4a3a-b83e-0f30a724993f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:59:14.718443 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9beff8-fc61-4a3a-b83e-0f30a724993f service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:59:14.728482 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1443/2926] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:59:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:59:17.726921 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c65f6-74bf-4389-939c-ee46c07651c7 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:17.727398 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c65f6-74bf-4389-939c-ee46c07651c7 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:17.727514 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c65f6-74bf-4389-939c-ee46c07651c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:17.747362 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-e90c65f6-74bf-4389-939c-ee46c07651c7 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:59:17.748600 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-e90c65f6-74bf-4389-939c-ee46c07651c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:59:17.756324 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1484/2927] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Sep 15 00:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:59:17.788994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9beff8-fc61-4a3a-b83e-0f30a724993f service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:59:17.800202 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9beff8-fc61-4a3a-b83e-0f30a724993f service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:59:17.806497 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34751174-de07-44a7-81dd-beb7f996c2e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:59:17.807124 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34751174-de07-44a7-81dd-beb7f996c2e1 service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:17.807398 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34751174-de07-44a7-81dd-beb7f996c2e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:17.807660 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34751174-de07-44a7-81dd-beb7f996c2e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:17.815779 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34751174-de07-44a7-81dd-beb7f996c2e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:59:17.817386 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34751174-de07-44a7-81dd-beb7f996c2e1 service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:59:17.826576 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1444/2928] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:59:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:59:20.887394 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d41d85-2db1-491f-aed2-7a6ae1361810 None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:20.887893 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d41d85-2db1-491f-aed2-7a6ae1361810 None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:20.888014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d41d85-2db1-491f-aed2-7a6ae1361810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:20.907649 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-b0d41d85-2db1-491f-aed2-7a6ae1361810 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:59:20.908851 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-b0d41d85-2db1-491f-aed2-7a6ae1361810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:59:20.916746 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1485/2929] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Sep 15 00:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:59:20.939777 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34751174-de07-44a7-81dd-beb7f996c2e1 service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:59:20.951581 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34751174-de07-44a7-81dd-beb7f996c2e1 service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:59:20.957332 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67954d30-09c7-4e0f-9727-5719d084ec1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:59:20.957913 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67954d30-09c7-4e0f-9727-5719d084ec1b service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:20.958190 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67954d30-09c7-4e0f-9727-5719d084ec1b service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:20.958460 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67954d30-09c7-4e0f-9727-5719d084ec1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:20.966420 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67954d30-09c7-4e0f-9727-5719d084ec1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:59:20.967991 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67954d30-09c7-4e0f-9727-5719d084ec1b service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:59:20.977252 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1445/2930] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:59:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:59:24.039412 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30041eb1-45db-4573-9db6-37d899497e4a None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:24.040015 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30041eb1-45db-4573-9db6-37d899497e4a None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:24.040015 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30041eb1-45db-4573-9db6-37d899497e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:24.059984 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-30041eb1-45db-4573-9db6-37d899497e4a None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:59:24.061203 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-30041eb1-45db-4573-9db6-37d899497e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:59:24.069004 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1486/2931] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Sep 15 00:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:59:24.093912 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67954d30-09c7-4e0f-9727-5719d084ec1b service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:59:24.105682 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67954d30-09c7-4e0f-9727-5719d084ec1b service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:59:24.111074 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18f6a5-30e0-4d0e-974c-ddf715e089ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:59:24.111656 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18f6a5-30e0-4d0e-974c-ddf715e089ea service nova] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:24.111934 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18f6a5-30e0-4d0e-974c-ddf715e089ea service nova] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:24.112205 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18f6a5-30e0-4d0e-974c-ddf715e089ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:24.120079 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18f6a5-30e0-4d0e-974c-ddf715e089ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:59:24.121700 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18f6a5-30e0-4d0e-974c-ddf715e089ea service nova] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:59:24.130913 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1446/2932] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:59:34.055052 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=18 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:59:34.126788 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=64 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 00:59:38.054446 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e13c59-1dba-461c-8fab-765ba3abcaec None None] REQUEST_METHOD: `POST` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:38.054940 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e13c59-1dba-461c-8fab-765ba3abcaec None None] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:38.055059 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e13c59-1dba-461c-8fab-765ba3abcaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:38.074290 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.auth.core [None req-06e13c59-1dba-461c-8fab-765ba3abcaec None None] MFA Rules not processed for user `a1cdec56d1854cbb82cf235fc47418ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:59:38.075472 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-06e13c59-1dba-461c-8fab-765ba3abcaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:59:38.082464 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1487/2933] 10.222.0.52 () {58 vars in 958 bytes} [Thu Sep 15 00:59:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:59:44.446687 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18f6a5-30e0-4d0e-974c-ddf715e089ea service nova] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:59:44.448105 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-8e18f6a5-30e0-4d0e-974c-ddf715e089ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:59:44.460851 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18f6a5-30e0-4d0e-974c-ddf715e089ea service nova] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:59:44.464454 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a43f5-2492-43aa-9f4a-57c291336a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:59:44.465037 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a43f5-2492-43aa-9f4a-57c291336a5a service neutron] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:44.465364 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a43f5-2492-43aa-9f4a-57c291336a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:44.465631 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a43f5-2492-43aa-9f4a-57c291336a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:44.467256 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-022a43f5-2492-43aa-9f4a-57c291336a5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:59:44.480755 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a43f5-2492-43aa-9f4a-57c291336a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:59:44.482213 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a43f5-2492-43aa-9f4a-57c291336a5a service neutron] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:59:44.492994 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1447/2934] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:59:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:59:46.836894 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e13c59-1dba-461c-8fab-765ba3abcaec None None] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:59:46.846820 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e13c59-1dba-461c-8fab-765ba3abcaec None None] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:59:46.850407 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04de65d-7229-496d-9061-79ebd23c89dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50ec251be76543b4ad97442664db6858', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:59:46.851502 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04de65d-7229-496d-9061-79ebd23c89dd service neutron] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:46.851782 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04de65d-7229-496d-9061-79ebd23c89dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:46.852060 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04de65d-7229-496d-9061-79ebd23c89dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:46.853837 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f04de65d-7229-496d-9061-79ebd23c89dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:59:46.876331 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04de65d-7229-496d-9061-79ebd23c89dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:59:46.877899 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04de65d-7229-496d-9061-79ebd23c89dd service neutron] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:59:46.889755 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1488/2935] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:59:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:59:49.877735 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6051670-627f-4f56-a085-70ea3bd04e0a None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:49.878199 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6051670-627f-4f56-a085-70ea3bd04e0a None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:49.878473 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6051670-627f-4f56-a085-70ea3bd04e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:49.902041 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c6051670-627f-4f56-a085-70ea3bd04e0a None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:59:49.903247 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c6051670-627f-4f56-a085-70ea3bd04e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:59:49.911004 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1448/2936] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Sep 15 00:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:59:49.964135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04de65d-7229-496d-9061-79ebd23c89dd service neutron] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:59:49.975336 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04de65d-7229-496d-9061-79ebd23c89dd service neutron] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:59:49.980898 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d71c8-71e3-44e5-999f-49a3ea213b16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:59:49.981535 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d71c8-71e3-44e5-999f-49a3ea213b16 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:49.981812 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d71c8-71e3-44e5-999f-49a3ea213b16 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:49.982082 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d71c8-71e3-44e5-999f-49a3ea213b16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:49.990181 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d71c8-71e3-44e5-999f-49a3ea213b16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:59:49.991731 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d71c8-71e3-44e5-999f-49a3ea213b16 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:59:50.001310 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1489/2937] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:59:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:59:53.099882 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b4978-c591-419a-98dd-27a739caca5b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:53.100421 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b4978-c591-419a-98dd-27a739caca5b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:53.100421 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b4978-c591-419a-98dd-27a739caca5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:53.120478 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-0d6b4978-c591-419a-98dd-27a739caca5b None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:59:53.121696 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-0d6b4978-c591-419a-98dd-27a739caca5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:59:53.129406 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1449/2938] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Sep 15 00:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:59:53.151265 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d71c8-71e3-44e5-999f-49a3ea213b16 service nova] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:59:53.162518 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d71c8-71e3-44e5-999f-49a3ea213b16 service nova] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:59:53.168675 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5226a-8764-490f-b5bc-b23142e5e77e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:59:53.169335 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5226a-8764-490f-b5bc-b23142e5e77e service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:53.169617 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5226a-8764-490f-b5bc-b23142e5e77e service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:53.169891 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5226a-8764-490f-b5bc-b23142e5e77e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:53.178197 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5226a-8764-490f-b5bc-b23142e5e77e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:59:53.179761 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5226a-8764-490f-b5bc-b23142e5e77e service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:59:53.189171 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1490/2939] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:59:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:59:56.186338 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4ef5f-6cdd-4ab8-a8e5-5841075046de None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:56.186845 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4ef5f-6cdd-4ab8-a8e5-5841075046de None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:56.186961 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4ef5f-6cdd-4ab8-a8e5-5841075046de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:56.206688 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-c5b4ef5f-6cdd-4ab8-a8e5-5841075046de None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:59:56.208133 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-c5b4ef5f-6cdd-4ab8-a8e5-5841075046de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:59:56.216043 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1450/2940] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Sep 15 00:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:59:56.236291 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5226a-8764-490f-b5bc-b23142e5e77e service nova] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:59:56.248014 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5226a-8764-490f-b5bc-b23142e5e77e service nova] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:59:56.254223 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91ee6d-5d31-4604-85de-91236afa15cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:59:56.254827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91ee6d-5d31-4604-85de-91236afa15cb service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:56.255106 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91ee6d-5d31-4604-85de-91236afa15cb service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:56.255375 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91ee6d-5d31-4604-85de-91236afa15cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:56.264521 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91ee6d-5d31-4604-85de-91236afa15cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:59:56.266110 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91ee6d-5d31-4604-85de-91236afa15cb service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:59:56.276135 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1491/2941] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 00:59:59.356022 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba3569-d611-4377-9fba-5eb5c8b6ec1b None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:59.356430 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba3569-d611-4377-9fba-5eb5c8b6ec1b None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:59.356563 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba3569-d611-4377-9fba-5eb5c8b6ec1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:59.375700 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-51ba3569-d611-4377-9fba-5eb5c8b6ec1b None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 00:59:59.376877 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-51ba3569-d611-4377-9fba-5eb5c8b6ec1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 00:59:59.385016 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1451/2942] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Sep 15 00:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 00:59:59.407374 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91ee6d-5d31-4604-85de-91236afa15cb service nova] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 00:59:59.419531 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91ee6d-5d31-4604-85de-91236afa15cb service nova] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 00:59:59.424963 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b993e-1762-4fd5-bded-d4ebb3a0c150 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 00:59:59.425585 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b993e-1762-4fd5-bded-d4ebb3a0c150 service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 00:59:59.425868 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b993e-1762-4fd5-bded-d4ebb3a0c150 service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 00:59:59.426145 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b993e-1762-4fd5-bded-d4ebb3a0c150 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 00:59:59.434184 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b993e-1762-4fd5-bded-d4ebb3a0c150 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 00:59:59.435740 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b993e-1762-4fd5-bded-d4ebb3a0c150 service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 00:59:59.445064 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1492/2943] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 00:59:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 01:00:02.510283 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae5392-13df-4ba5-8275-52ae73003b50 None None] REQUEST_METHOD: `POST` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 01:00:02.510759 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae5392-13df-4ba5-8275-52ae73003b50 None None] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 01:00:02.510875 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae5392-13df-4ba5-8275-52ae73003b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 01:00:02.530370 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.auth.core [None req-3eae5392-13df-4ba5-8275-52ae73003b50 None None] MFA Rules not processed for user `bdfcc581c0884ebba7a2c2ed953e039a`. Rule list: `[]` (Enabled: `True`). {{(pid=81615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 01:00:02.531550 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3eae5392-13df-4ba5-8275-52ae73003b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 01:00:02.539618 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1452/2944] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Sep 15 01:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 01:00:02.562160 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b993e-1762-4fd5-bded-d4ebb3a0c150 service nova] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 01:00:02.573866 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b993e-1762-4fd5-bded-d4ebb3a0c150 service nova] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 01:00:02.579244 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15486320-09de-4d30-acaf-0c94e1ee079b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcfcf8061f24231858b9b0205a8abaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 01:00:02.579827 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15486320-09de-4d30-acaf-0c94e1ee079b service nova] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 01:00:02.580104 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15486320-09de-4d30-acaf-0c94e1ee079b service nova] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 01:00:02.580374 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15486320-09de-4d30-acaf-0c94e1ee079b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 01:00:02.589193 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15486320-09de-4d30-acaf-0c94e1ee079b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 01:00:02.590742 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15486320-09de-4d30-acaf-0c94e1ee079b service nova] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 01:00:02.600260 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1493/2945] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 01:00:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 01:00:12.525744 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=21 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 01:00:12.595807 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=39 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 01:00:30.288068 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae5392-13df-4ba5-8275-52ae73003b50 None None] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 01:00:30.289536 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-3eae5392-13df-4ba5-8275-52ae73003b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 01:00:30.304126 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae5392-13df-4ba5-8275-52ae73003b50 None None] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 01:00:30.309200 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378f14a-3029-46c3-861a-a38f01229bda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed987b44d934ac7b2dc64c0aab28099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 01:00:30.309817 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378f14a-3029-46c3-861a-a38f01229bda service placement] REQUEST_METHOD: `GET` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 01:00:30.310148 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378f14a-3029-46c3-861a-a38f01229bda service placement] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 01:00:30.310425 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378f14a-3029-46c3-861a-a38f01229bda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 01:00:30.312394 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.fernet_utils [None req-5378f14a-3029-46c3-861a-a38f01229bda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 01:00:30.327448 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378f14a-3029-46c3-861a-a38f01229bda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 01:00:30.330019 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378f14a-3029-46c3-861a-a38f01229bda service placement] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 01:00:30.342902 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1453/2946] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 01:00:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 01:00:30.594731 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15486320-09de-4d30-acaf-0c94e1ee079b service nova] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 01:00:30.604238 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15486320-09de-4d30-acaf-0c94e1ee079b service nova] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 01:00:30.608932 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2192d-23dd-482c-85ac-18b45cc963cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 01:00:30.609577 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2192d-23dd-482c-85ac-18b45cc963cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 01:00:30.609856 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2192d-23dd-482c-85ac-18b45cc963cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 01:00:30.610126 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2192d-23dd-482c-85ac-18b45cc963cf admin admin] PATH_INFO: `/v3/users/a1cdec56d1854cbb82cf235fc47418ab` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 01:00:30.611252 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2192d-23dd-482c-85ac-18b45cc963cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1cdec56d1854cbb82cf235fc47418ab)` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 01:00:30.613172 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2192d-23dd-482c-85ac-18b45cc963cf admin admin] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 01:00:30.658040 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-24b2192d-23dd-482c-85ac-18b45cc963cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1cdec56d1854cbb82cf235fc47418ab'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 01:00:30.665793 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-24b2192d-23dd-482c-85ac-18b45cc963cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1cdec56d1854cbb82cf235fc47418ab'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 01:00:30.666433 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-24b2192d-23dd-482c-85ac-18b45cc963cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1cdec56d1854cbb82cf235fc47418ab'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 01:00:30.667030 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-24b2192d-23dd-482c-85ac-18b45cc963cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1cdec56d1854cbb82cf235fc47418ab'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 01:00:30.674009 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.notifications [None req-24b2192d-23dd-482c-85ac-18b45cc963cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1cdec56d1854cbb82cf235fc47418ab'} {{(pid=81616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 01:00:30.691276 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1494/2947] 10.222.0.52 () {58 vars in 1224 bytes} [Thu Sep 15 01:00:30 2022] DELETE /identity/v3/users/a1cdec56d1854cbb82cf235fc47418ab => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 01:00:30.857983 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378f14a-3029-46c3-861a-a38f01229bda service placement] Authenticating user token {{(pid=81615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 01:00:30.869251 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378f14a-3029-46c3-861a-a38f01229bda service placement] Validating token access rules against request {{(pid=81615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 01:00:30.927676 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d201923-2dd8-4c32-8ce7-a2d6e1f8f5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdfcc581c0884ebba7a2c2ed953e039a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6940b89e115f47bd8dfdf0af975e2ba9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 01:00:30.928227 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d201923-2dd8-4c32-8ce7-a2d6e1f8f5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 01:00:30.928502 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d201923-2dd8-4c32-8ce7-a2d6e1f8f5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 01:00:30.928770 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d201923-2dd8-4c32-8ce7-a2d6e1f8f5ff admin admin] PATH_INFO: `/v3/projects/0cb2ec57f5db4d86bb67f183f5183273` {{(pid=81615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 01:00:30.930407 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d201923-2dd8-4c32-8ce7-a2d6e1f8f5ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb2ec57f5db4d86bb67f183f5183273)` {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 01:00:30.932309 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d201923-2dd8-4c32-8ce7-a2d6e1f8f5ff admin admin] RBAC: Authorization granted {{(pid=81615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 01:00:30.980196 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9d201923-2dd8-4c32-8ce7-a2d6e1f8f5ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb2ec57f5db4d86bb67f183f5183273', 'request_id': 'req-9d201923-2dd8-4c32-8ce7-a2d6e1f8f5ff'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 01:00:30.986744 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9d201923-2dd8-4c32-8ce7-a2d6e1f8f5ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb2ec57f5db4d86bb67f183f5183273', 'request_id': 'req-9d201923-2dd8-4c32-8ce7-a2d6e1f8f5ff'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 01:00:30.992876 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9d201923-2dd8-4c32-8ce7-a2d6e1f8f5ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb2ec57f5db4d86bb67f183f5183273', 'request_id': 'req-9d201923-2dd8-4c32-8ce7-a2d6e1f8f5ff'} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 01:00:31.003668 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9d201923-2dd8-4c32-8ce7-a2d6e1f8f5ff admin admin] The token cache is being invalidate because project 0cb2ec57f5db4d86bb67f183f5183273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 01:00:31.003955 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9d201923-2dd8-4c32-8ce7-a2d6e1f8f5ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 01:00:31.004578 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG keystone.notifications [None req-9d201923-2dd8-4c32-8ce7-a2d6e1f8f5ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 01:00:31.006072 dv-cinder-857528-2-smb devstack@keystone.service[81615]: [pid: 81615|app: 0|req: 1454/2948] 10.222.0.52 () {58 vars in 1233 bytes} [Thu Sep 15 01:00:30 2022] DELETE /identity/v3/projects/0cb2ec57f5db4d86bb67f183f5183273 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 01:00:40.687836 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 01:00:41.000720 dv-cinder-857528-2-smb devstack@keystone.service[81615]: DEBUG dbcounter [-] [81615] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 01:03:48.484836 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2192d-23dd-482c-85ac-18b45cc963cf admin admin] Authenticating user token {{(pid=81616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 01:03:48.486305 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-24b2192d-23dd-482c-85ac-18b45cc963cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 01:03:48.624244 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2192d-23dd-482c-85ac-18b45cc963cf admin admin] Validating token access rules against request {{(pid=81616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 01:03:48.682721 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c9d0a-2cec-4f7c-b4e4-e6193443e53f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed987b44d934ac7b2dc64c0aab28099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25792dd210b42c4a3491096a735f909', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 01:03:48.683326 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c9d0a-2cec-4f7c-b4e4-e6193443e53f service placement] REQUEST_METHOD: `GET` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 01:03:48.683607 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c9d0a-2cec-4f7c-b4e4-e6193443e53f service placement] SCRIPT_NAME: `/identity` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 01:03:48.683881 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c9d0a-2cec-4f7c-b4e4-e6193443e53f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 01:03:48.685622 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.fernet_utils [None req-f65c9d0a-2cec-4f7c-b4e4-e6193443e53f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 01:03:48.697606 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c9d0a-2cec-4f7c-b4e4-e6193443e53f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 01:03:48.699297 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c9d0a-2cec-4f7c-b4e4-e6193443e53f service placement] RBAC: Authorization granted {{(pid=81616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 01:03:48.709772 dv-cinder-857528-2-smb devstack@keystone.service[81616]: [pid: 81616|app: 0|req: 1495/2949] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Sep 15 01:03:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 01:03:58.704988 dv-cinder-857528-2-smb devstack@keystone.service[81616]: DEBUG dbcounter [-] [81616] Writing DB stats keystone:SELECT=89 {{(pid=81616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}